Remote Sensing Image Change Detection Towards Continuous Bitemporal Resolution Differences

05/24/2023
by   Hao Chen, et al.
0

Most contemporary supervised Remote Sensing (RS) image Change Detection (CD) approaches are customized for equal-resolution bitemporal images. Real-world applications raise the need for cross-resolution change detection, aka, CD based on bitemporal images with different spatial resolutions. Current cross-resolution methods that are trained with samples of a fixed resolution difference (resolution ratio between the high-resolution (HR) image and the low-resolution (LR) one) may fit a certain ratio but lack adaptation to other resolution differences. Toward continuous cross-resolution CD, we propose scale-invariant learning to enforce the model consistently predicting HR results given synthesized samples of varying bitemporal resolution differences. Concretely, we synthesize blurred versions of the HR image by random downsampled reconstructions to reduce the gap between HR and LR images. We introduce coordinate-based representations to decode per-pixel predictions by feeding the coordinate query and corresponding multi-level embedding features into an MLP that implicitly learns the shape of land cover changes, therefore benefiting recognizing blurred objects in the LR image. Moreover, considering that spatial resolution mainly affects the local textures, we apply local-window self-attention to align bitemporal features during the early stages of the encoder. Extensive experiments on two synthesized and one real-world different-resolution CD datasets verify the effectiveness of the proposed method. Our method significantly outperforms several vanilla CD methods and two cross-resolution CD methods on the three datasets both in in-distribution and out-of-distribution settings. The empirical results suggest that our method could yield relatively consistent HR change predictions regardless of varying resolution difference ratios. Our code will be public.

READ FULL TEXT

page 1

page 3

page 5

page 10

page 12

page 13

page 14

page 16

research
05/27/2022

Semantic-aware Dense Representation Learning for Remote Sensing Image Change Detection

Training deep learning-based change detection (CD) model heavily depends...
research
08/25/2021

Deep few-shot learning for bi-temporal building change detection

In real-world applications (e.g., change detection), annotating images i...
research
02/21/2023

HCGMNET: A Hierarchical Change Guiding Map Network For Change Detection

Very-high-resolution (VHR) remote sensing (RS) image change detection (C...
research
08/04/2023

T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Images

Remote sensing image change detection aims to identify the differences b...
research
06/03/2023

Lightweight Structure-aware Transformer Network for VHR Remote Sensing Image Change Detection

Popular Transformer networks have been successfully applied to remote se...
research
06/25/2023

Visual Question Answering in Remote Sensing with Cross-Attention and Multimodal Information Bottleneck

In this research, we deal with the problem of visual question answering ...
research
04/01/2020

PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization

Recent advances in image-based 3D human shape estimation have been drive...

Please sign up or login with your details

Forgot password? Click here to reset