Coarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenes

by   Chengcheng Guo, et al.

Robust and accurate localization is an essential component for robotic navigation and autonomous driving. The use of cameras for localization with high definition map (HD Map) provides an affordable localization sensor set. Existing methods suffer from pose estimation failure due to error prone data association or initialization with accurate initial pose requirement. In this paper, we propose a cost-effective vehicle localization system with HD map for autonomous driving that uses cameras as primary sensors. To this end, we formulate vision-based localization as a data association problem that maps visual semantics to landmarks in HD map. Specifically, system initialization is finished in a coarse to fine manner by combining coarse GPS (Global Positioning System) measurement and fine pose searching. In tracking stage, vehicle pose is refined by implicitly aligning the semantic segmentation result between image and landmarks in HD maps with photometric consistency. Finally, vehicle pose is computed by pose graph optimization in a sliding window fashion. We evaluate our method on two datasets and demonstrate that the proposed approach yields promising localization results in different driving scenarios. Additionally, our approach is suitable for both monocular camera and multi-cameras that provides flexibility and improves robustness for the localization system.


page 1

page 2

page 3

page 4

page 5

page 6

page 7


Efficient 2D-3D Matching for Multi-Camera Visual Localization

Visual localization, i.e., determining the position and orientation of a...

Monocular Vehicle Self-localization method based on Compact Semantic Map

High precision localization is a crucial requirement for the autonomous ...

Robust Monocular Localization in Sparse HD Maps Leveraging Multi-Task Uncertainty Estimation

Robust localization in dense urban scenarios using a low-cost sensor set...

DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map

For applications such as autonomous driving, self-localization/camera po...

A Survey on Visual Map Localization Using LiDARs and Cameras

As the autonomous driving industry is slowly maturing, visual map locali...

S-BEV: Semantic Birds-Eye View Representation for Weather and Lighting Invariant 3-DoF Localization

We describe a light-weight, weather and lighting invariant, Semantic Bir...

You are here! Finding position and orientation on a 2D map from a single image: The Flatlandia localization problem and dataset

We introduce Flatlandia, a novel problem for visual localization of an i...

Please sign up or login with your details

Forgot password? Click here to reset