Image-to-Height Domain Translation for Synthetic Aperture Sonar

12/12/2021
by   Dylan Stewart, et al.
3

Observations of seabed texture with synthetic aperture sonar are dependent upon several factors. In this work, we focus on collection geometry with respect to isotropic and anisotropic textures. The low grazing angle of the collection geometry, combined with orientation of the sonar path relative to anisotropic texture, poses a significant challenge for image-alignment and other multi-view scene understanding frameworks. We previously proposed using features captured from estimated seabed relief to improve scene understanding. While several methods have been developed to estimate seabed relief via intensity, no large-scale study exists in the literature. Furthermore, a dataset of coregistered seabed relief maps and sonar imagery is nonexistent to learn this domain translation. We address these problems by producing a large simulated dataset containing coregistered pairs of seabed relief and intensity maps from two unique sonar data simulation techniques. We apply three types of models, with varying complexity, to translate intensity imagery to seabed relief: a Gaussian Markov Random Field approach (GMRF), a conditional Generative Adversarial Network (cGAN), and UNet architectures. Methods are compared in reference to the coregistered simulated datasets using L1 error. Additionally, predictions on simulated and real SAS imagery are shown. Finally, models are compared on two datasets of hand-aligned SAS imagery and evaluated in terms of L1 error across multiple aspects in comparison to using intensity. Our comprehensive experiments show that the proposed UNet architectures outperform the GMRF and pix2pix cGAN models on seabed relief estimation for simulated and real SAS imagery.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 9

page 10

page 11

research
09/19/2022

Meta-simulation for the Automated Design of Synthetic Overhead Imagery

The use of synthetic (or simulated) data for training machine learning m...
research
08/15/2018

Measuring Human Assessed Complexity in Synthetic Aperture Sonar Imagery Using the Elo Rating System

Performance of automatic target recognition from synthetic aperture sona...
research
04/10/2021

Physically-Consistent Generative Adversarial Networks for Coastal Flood Visualization

As climate change increases the intensity of natural disasters, society ...
research
08/29/2019

Texture Underfitting for Domain Adaptation

Comprehensive semantic segmentation is one of the key components for rob...
research
05/30/2018

Learning to Generate Facial Depth Maps

In this paper, an adversarial architecture for facial depth map estimati...
research
09/04/2019

Beyond Photo Realism for Domain Adaptation from Synthetic Data

As synthetic imagery is used more frequently in training deep models, it...
research
08/19/2018

Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360° Panoramic Imagery

Recent automotive vision work has focused almost exclusively on processi...

Please sign up or login with your details

Forgot password? Click here to reset