SpaceNet 6: Multi-Sensor All Weather Mapping Dataset

by   Jacob Shermeyer, et al.

Within the remote sensing domain, a diverse set of acquisition modalities exist, each with their own unique strengths and weaknesses. Yet, most of the current literature and open datasets only deal with electro-optical (optical) data for different detection and segmentation tasks at high spatial resolutions. optical data is often the preferred choice for geospatial applications, but requires clear skies and little cloud cover to work well. Conversely, Synthetic Aperture Radar (SAR) sensors have the unique capability to penetrate clouds and collect during all weather, day and night conditions. Consequently, SAR data are particularly valuable in the quest to aid disaster response, when weather and cloud cover can obstruct traditional optical sensors. Despite all of these advantages, there is little open data available to researchers to explore the effectiveness of SAR for such applications, particularly at very-high spatial resolutions, i.e. <1m Ground Sample Distance (GSD). To address this problem, we present an open Multi-Sensor All Weather Mapping (MSAW) dataset and challenge, which features two collection modalities (both SAR and optical). The dataset and challenge focus on mapping and building footprint extraction using a combination of these data sources. MSAW covers 120 km^2 over multiple overlapping collects and is annotated with over 48,000 unique building footprints labels, enabling the creation and evaluation of mapping algorithms for multi-modal data. We present a baseline and benchmark for building footprint extraction with SAR data and find that state-of-the-art segmentation models pre-trained on optical data, and then trained on SAR (F1 score of 0.21) outperform those trained on SAR data alone (F1 score of 0.135).


page 2

page 4

page 7


The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion

Deep learning techniques have made an increasing impact on the field of ...

Reciprocal Translation between SAR and Optical Remote Sensing Images with Cascaded-Residual Adversarial Networks

Despite the advantages of all-weather and all-day high-resolution imagin...

Investigating Imbalances Between SAR and Optical Utilization for Multi-Modal Urban Mapping

Accurate urban maps provide essential information to support sustainable...

Multi-Modal Deep Learning for Multi-Temporal Urban Mapping With a Partly Missing Optical Modality

This paper proposes a novel multi-temporal urban mapping approach using ...

Denoising and Optical and SAR Image Classifications Based on Feature Extraction and Sparse Representation

Optical image data have been used by the Remote Sensing workforce to stu...

Robust Rational Polynomial Camera Modelling for SAR and Pushbroom Imaging

The Rational Polynomial Camera (RPC) model can be used to describe a var...

Fusing Optical and SAR time series for LAI gap filling with multioutput Gaussian processes

The availability of satellite optical information is often hampered by t...

Please sign up or login with your details

Forgot password? Click here to reset