L1BSR: Exploiting Detector Overlap for Self-Supervised Single-Image Super-Resolution of Sentinel-2 L1B Imagery

04/14/2023
by   Ngoc Long Nguyen, et al.
0

High-resolution satellite imagery is a key element for many Earth monitoring applications. Satellites such as Sentinel-2 feature characteristics that are favorable for super-resolution algorithms such as aliasing and band-misalignment. Unfortunately the lack of reliable high-resolution (HR) ground truth limits the application of deep learning methods to this task. In this work we propose L1BSR, a deep learning-based method for single-image super-resolution and band alignment of Sentinel-2 L1B 10m bands. The method is trained with self-supervision directly on real L1B data by leveraging overlapping areas in L1B images produced by adjacent CMOS detectors, thus not requiring HR ground truth. Our self-supervised loss is designed to enforce the super-resolved output image to have all the bands correctly aligned. This is achieved via a novel cross-spectral registration network (CSR) which computes an optical flow between images of different spectral bands. The CSR network is also trained with self-supervision using an Anchor-Consistency loss, which we also introduce in this work. We demonstrate the performance of the proposed approach on synthetic and real L1B data, where we show that it obtains comparable results to supervised methods.

READ FULL TEXT

page 1

page 4

page 8

05/04/2022

Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellites

Modern Earth observation satellites capture multi-exposure bursts of pus...
02/22/2023

On The Role of Alias and Band-Shift for Sentinel-2 Super-Resolution

In this work, we study the problem of single-image super-resolution (SIS...
10/07/2019

Unsupervised Image Super-Resolution with an Indirect Supervised Path

The task of single image super-resolution (SISR) aims at reconstructing ...
09/19/2022

S^3R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

Benefited from the rich and detailed spectral information in hyperspectr...
03/18/2021

Self-Supervised Adaptation for Video Super-Resolution

Recent single-image super-resolution (SISR) networks, which can adapt th...

Please sign up or login with your details

Forgot password? Click here to reset