Multitemporal and multispectral data fusion for super-resolution of Sentinel-2 images

by   Tomasz Tarasiewicz, et al.

Multispectral Sentinel-2 images are a valuable source of Earth observation data, however spatial resolution of their spectral bands limited to 10 m, 20 m, and 60 m ground sampling distance remains insufficient in many cases. This problem can be addressed with super-resolution, aimed at reconstructing a high-resolution image from a low-resolution observation. For Sentinel-2, spectral information fusion allows for enhancing the 20 m and 60 m bands to the 10 m resolution. Also, there were attempts to combine multitemporal stacks of individual Sentinel-2 bands, however these two approaches have not been combined so far. In this paper, we introduce DeepSent – a new deep network for super-resolving multitemporal series of multispectral Sentinel-2 images. It is underpinned with information fusion performed simultaneously in the spectral and temporal dimensions to generate an enlarged multispectral image. In our extensive experimental study, we demonstrate that our solution outperforms other state-of-the-art techniques that realize either multitemporal or multispectral data fusion. Furthermore, we show that the advantage of DeepSent results from how these two fusion types are combined in a single architecture, which is superior to performing such fusion in a sequential manner. Importantly, we have applied our method to super-resolve real-world Sentinel-2 images, enhancing the spatial resolution of all the spectral bands to 3.3 m nominal ground sampling distance, and we compare the outcome with very high-resolution WorldView-2 images. We will publish our implementation upon paper acceptance, and we expect it will increase the possibilities of exploiting super-resolved Sentinel-2 images in real-life applications.


page 5

page 9

page 10

page 11

page 12

page 13

page 14

page 18


Deep Learning for Multiple-Image Super-Resolution

Super-resolution reconstruction (SRR) is a process aimed at enhancing sp...

Advances on CNN-based super-resolution of Sentinel-2 images

Thanks to their temporal-spatial coverage and free access, Sentinel-2 im...

Super-Resolution of Sentinel-2 Images: Learning a Globally Applicable Deep Neural Network

The Sentinel-2 satellite mission delivers multi-spectral imagery with 13...

SIRF: Simultaneous Image Registration and Fusion in A Unified Framework

In this paper, we propose a novel method for image fusion with a high-re...

A full-resolution training framework for Sentinel-2 image fusion

This work presents a new unsupervised framework for training deep learni...

Conditional Chromatic Filtering with Spatial Enhancement for Restoring Pansharpened Images

Pansharpening techniques aim at fusing the structural detail of the panc...

A CNN-Based Super-Resolution Technique for Active Fire Detection on Sentinel-2 Data

Remote Sensing applications can benefit from a relatively fine spatial r...

Please sign up or login with your details

Forgot password? Click here to reset