Self-Supervised Localisation between Range Sensors and Overhead Imagery

06/03/2020
by   Tim Y. Tang, et al.
0

Publicly available satellite imagery can be an ubiquitous, cheap, and powerful tool for vehicle localisation when a prior sensor map is unavailable. However, satellite images are not directly comparable to data from ground range sensors because of their starkly different modalities. We present a learned metric localisation method that not only handles the modality difference, but is cheap to train, learning in a self-supervised fashion without metrically accurate ground truth. By evaluating across multiple real-world datasets, we demonstrate the robustness and versatility of our method for various sensor configurations. We pay particular attention to the use of millimetre wave radar, which, owing to its complex interaction with the scene and its immunity to weather and lighting, makes for a compelling and valuable use case.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

page 14

page 15

research
10/21/2022

Self-Supervised Pretraining on Satellite Imagery: a Case Study on Label-Efficient Vehicle Detection

In defense-related remote sensing applications, such as vehicle detectio...
research
01/09/2020

RSL-Net: Localising in Satellite Images From a Radar on the Ground

This paper is about localising a vehicle in an overhead image using FMCW...
research
06/06/2023

Energy-Based Models for Cross-Modal Localization using Convolutional Transformers

We present a novel framework using Energy-Based Models (EBMs) for locali...
research
10/11/2020

H2O-Net: Self-Supervised Flood Segmentation via Adversarial Domain Adaptation and Label Refinement

Accurate flood detection in near real time via high resolution, high lat...
research
08/17/2023

Predicting Crop Yield With Machine Learning: An Extensive Analysis Of Input Modalities And Models On a Field and sub-field Level

We introduce a simple yet effective early fusion method for crop yield p...
research
01/19/2022

ROS georegistration: Aerial Multi-spectral Image Simulator for the Robot Operating System

This article describes a software package called ROS georegistration int...
research
04/27/2023

A Method for Classifying Snow Using Ski-Mounted Strain Sensors

Understanding the structure, quantity, and type of snow in mountain land...

Please sign up or login with your details

Forgot password? Click here to reset