Wide-Area Geolocalization with a Limited Field of View Camera

by   Lena M. Downes, et al.

Cross-view geolocalization, a supplement or replacement for GPS, localizes an agent within a search area by matching images taken from a ground-view camera to overhead images taken from satellites or aircraft. Although the viewpoint disparity between ground and overhead images makes cross-view geolocalization challenging, significant progress has been made assuming that the ground agent has access to a panoramic camera. For example, our prior work (WAG) introduced changes in search area discretization, training loss, and particle filter weighting that enabled city-scale panoramic cross-view geolocalization. However, panoramic cameras are not widely used in existing robotic platforms due to their complexity and cost. Non-panoramic cross-view geolocalization is more applicable for robotics, but is also more challenging. This paper presents Restricted FOV Wide-Area Geolocalization (ReWAG), a cross-view geolocalization approach that generalizes WAG for use with standard, non-panoramic ground cameras by creating pose-aware embeddings and providing a strategy to incorporate particle pose into the Siamese network. ReWAG is a neural network and particle filter system that is able to globally localize a mobile agent in a GPS-denied environment with only odometry and a 90 degree FOV camera, achieving similar localization accuracy as what WAG achieved with a panoramic camera and improving localization accuracy by a factor of 100 compared to a baseline vision transformer (ViT) approach. A video highlight that demonstrates ReWAG's convergence on a test path of several dozen kilometers is available at https://youtu.be/U_OBQrt8qCE.


page 1

page 3

page 4

page 5

page 6


Wide-Area Geolocalization with a Limited Field of View Camera in Challenging Urban Environments

Cross-view geolocalization, a supplement or replacement for GPS, localiz...

City-wide Street-to-Satellite Image Geolocalization of a Mobile Ground Agent

Cross-view image geolocalization provides an estimate of an agent's glob...

Evaluation of Cross-View Matching to Improve Ground Vehicle Localization with Aerial Perception

Cross-view matching refers to the problem of finding the closest match t...

Cross-View Image Sequence Geo-localization

Cross-view geo-localization aims to estimate the GPS location of a query...

Render-and-Compare: Cross-View 6 DoF Localization from Noisy Prior

Despite the significant progress in 6-DoF visual localization, researche...

Learning Camera Performance Models for Active Multi-Camera Visual Teach and Repeat

In dynamic and cramped industrial environments, achieving reliable Visua...

Hinted Networks

We present Hinted Networks: a collection of architectural transformation...

Please sign up or login with your details

Forgot password? Click here to reset