Loop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency

by   Xingwu Ji, et al.

Visual simultaneous localization and mapping (SLAM) systems face challenges in detecting loop closure under the circumstance of large viewpoint changes. In this paper, we present an object-based loop closure detection method based on the spatial layout and semanic consistency of the 3D scene graph. Firstly, we propose an object-level data association approach based on the semantic information from semantic labels, intersection over union (IoU), object color, and object embedding. Subsequently, multi-view bundle adjustment with the associated objects is utilized to jointly optimize the poses of objects and cameras. We represent the refined objects as a 3D spatial graph with semantics and topology. Then, we propose a graph matching approach to select correspondence objects based on the structure layout and semantic property similarity of vertices' neighbors. Finally, we jointly optimize camera trajectories and object poses in an object-level pose graph optimization, which results in a globally consistent map. Experimental results demonstrate that our proposed data association approach can construct more accurate 3D semantic maps, and our loop closure method is more robust than point-based and object-based methods in circumstances with large viewpoint changes.


page 1

page 7

page 9

page 12


SemanticLoop: loop closure with 3D semantic graph matching

Loop closure can effectively correct the accumulated error in robot loca...

Towards View-invariant and Accurate Loop Detection Based on Scene Graph

Loop detection plays a key role in visual Simultaneous Localization and ...

Simultaneous Localization and Layout Model Selection in Manhattan Worlds

In this paper, we will demonstrate how Manhattan structure can be exploi...

A Variational Observation Model of 3D Object for Probabilistic Semantic SLAM

We present a Bayesian object observation model for complete probabilisti...

Accelerate 3D Object Processing via Spectral Layout

3D image processing is an important problem in computer vision and patte...

Closing the Loop: Graph Networks to Unify Semantic Objects and Visual Features for Multi-object Scenes

In Simultaneous Localization and Mapping (SLAM), Loop Closure Detection ...

Incremental Semantic Localization using Hierarchical Clustering of Object Association Sets

We present a novel approach for relocalization or place recognition, a f...

Please sign up or login with your details

Forgot password? Click here to reset