Learning Disentangled Representations of Satellite Image Time Series

03/21/2019
by   Eduardo Sanchez, et al.
36

In this paper, we investigate how to learn a suitable representation of satellite image time series in an unsupervised manner by leveraging large amounts of unlabeled data. Additionally , we aim to disentangle the representation of time series into two representations: a shared representation that captures the common information between the images of a time series and an exclusive representation that contains the specific information of each image of the time series. To address these issues, we propose a model that combines a novel component called cross-domain autoencoders with the variational autoencoder (VAE) and generative ad-versarial network (GAN) methods. In order to learn disentangled representations of time series, our model learns the multimodal image-to-image translation task. We train our model using satellite image time series from the Sentinel-2 mission. Several experiments are carried out to evaluate the obtained representations. We show that these disentangled representations can be very useful to perform multiple tasks such as image classification, image retrieval, image segmentation and change detection.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
12/09/2019

Learning Disentangled Representations via Mutual Information Estimation

In this paper, we investigate the problem of learning disentangled repre...
research
03/13/2023

Hybrid Variational Autoencoder for Time Series Forecasting

Variational autoencoders (VAE) are powerful generative models that learn...
research
05/05/2015

Autoencoding Time Series for Visualisation

We present an algorithm for the visualisation of time series. To that en...
research
03/28/2018

Image Generation and Translation with Disentangled Representations

Generative models have made significant progress in the tasks of modelin...
research
02/10/2021

On Disentanglement in Gaussian Process Variational Autoencoders

Complex multivariate time series arise in many fields, ranging from comp...
research
08/25/2022

Riesz-Quincunx-UNet Variational Auto-Encoder for Satellite Image Denoising

Multiresolution deep learning approaches, such as the U-Net architecture...
research
10/24/2022

Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAE

In many imaging modalities, objects of interest can occur in a variety o...

Please sign up or login with your details

Forgot password? Click here to reset