Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data

by   Oscar Manas, et al.

Remote sensing and automatic earth monitoring are key to solve global-scale challenges such as disaster prevention, land use monitoring, or tackling climate change. Although there exist vast amounts of remote sensing data, most of it remains unlabeled and thus inaccessible for supervised learning algorithms. Transfer learning approaches can reduce the data requirements of deep learning algorithms. However, most of these methods are pre-trained on ImageNet and their generalization to remote sensing imagery is not guaranteed due to the domain gap. In this work, we propose Seasonal Contrast (SeCo), an effective pipeline to leverage unlabeled data for in-domain pre-training of re-mote sensing representations. The SeCo pipeline is com-posed of two parts. First, a principled procedure to gather large-scale, unlabeled and uncurated remote sensing datasets containing images from multiple Earth locations at different timestamps. Second, a self-supervised algorithm that takes advantage of time and position invariance to learn transferable representations for re-mote sensing applications. We empirically show that models trained with SeCo achieve better performance than their ImageNet pre-trained counterparts and state-of-the-art self-supervised learning methods on multiple downstream tasks. The datasets and models in SeCo will be made public to facilitate transfer learning and enable rapid progress in re-mote sensing applications.


page 1

page 4

page 8


In-Domain Self-Supervised Learning Can Lead to Improvements in Remote Sensing Image Classification

Self-supervised learning (SSL) has emerged as a promising approach for r...

SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observation

Self-supervised pre-training bears potential to generate expressive repr...

Lightweight, Pre-trained Transformers for Remote Sensing Timeseries

Machine learning algorithms for parsing remote sensing data have a wide ...

Satlas: A Large-Scale, Multi-Task Dataset for Remote Sensing Image Understanding

Remote sensing images are useful for a wide variety of environmental and...

Towards Global Crop Maps with Transfer Learning

The continuous increase in global population and the impact of climate c...

Learning Sentinel-2 reflectance dynamics for data-driven assimilation and forecasting

Over the last few years, massive amounts of satellite multispectral and ...

Self-supervised Contrastive Learning for Irrigation Detection in Satellite Imagery

Climate change has caused reductions in river runoffs and aquifer rechar...

Please sign up or login with your details

Forgot password? Click here to reset