Uncertainty-aware Vision-based Metric Cross-view Geolocalization

by   Florian Fervers, et al.

This paper proposes a novel method for vision-based metric cross-view geolocalization (CVGL) that matches the camera images captured from a ground-based vehicle with an aerial image to determine the vehicle's geo-pose. Since aerial images are globally available at low cost, they represent a potential compromise between two established paradigms of autonomous driving, i.e. using expensive high-definition prior maps or relying entirely on the sensor data captured at runtime. We present an end-to-end differentiable model that uses the ground and aerial images to predict a probability distribution over possible vehicle poses. We combine multiple vehicle datasets with aerial images from orthophoto providers on which we demonstrate the feasibility of our method. Since the ground truth poses are often inaccurate w.r.t. the aerial images, we implement a pseudo-label approach to produce more accurate ground truth poses and make them publicly available. While previous works require training data from the target region to achieve reasonable localization accuracy (i.e. same-area evaluation), our approach overcomes this limitation and outperforms previous results even in the strictly more challenging cross-area case. We improve the previous state-of-the-art by a large margin even without ground or aerial data from the test region, which highlights the model's potential for global-scale application. We further integrate the uncertainty-aware predictions in a tracking framework to determine the vehicle's trajectory over time resulting in a mean position error on KITTI-360 of 0.78m.


page 1

page 6

page 8


Continuous Self-Localization on Aerial Images Using Visual and Lidar Sensors

This paper proposes a novel method for geo-tracking, i.e. continuous met...

Evaluation of Cross-View Matching to Improve Ground Vehicle Localization with Aerial Perception

Cross-view matching refers to the problem of finding the closest match t...

Render-and-Compare: Cross-View 6 DoF Localization from Noisy Prior

Despite the significant progress in 6-DoF visual localization, researche...

Convolutional Cross-View Pose Estimation

We propose a novel end-to-end method for cross-view pose estimation. Giv...

SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimation

This work addresses cross-view camera pose estimation, i.e., determining...

View-Invariant Localization using Semantic Objects in Changing Environments

This paper proposes a novel framework for real-time localization and ego...

A Dataset of Stationary, Fixed-wing Aircraft on a Collision Course for Vision-Based Sense and Avoid

The emerging global market for unmanned aerial vehicle (UAV) services is...

Please sign up or login with your details

Forgot password? Click here to reset