Deep Semantic Graph Matching for Large-scale Outdoor Point Clouds Registration

by   Shaocong Liu, et al.

The current point cloud registration methods are mainly based on geometric information and usually ignore the semantic information in the point clouds. In this paper, we treat the point cloud registration problem as semantic instance matching and registration task, and propose a deep semantic graph matching method for large-scale outdoor point cloud registration. Firstly, the semantic category labels of 3D point clouds are obtained by utilizing large-scale point cloud semantic segmentation network. The adjacent points with the same category labels are then clustered together by using Euclidean clustering algorithm to obtain the semantic instances. Secondly, the semantic adjacency graph is constructed based on the spatial adjacency relation of semantic instances. Three kinds of high-dimensional features including geometric shape features, semantic categorical features and spatial distribution features are learned through graph convolutional network, and enhanced based on attention mechanism. Thirdly, the semantic instance matching problem is modeled as an optimal transport problem, and solved through an optimal matching layer. Finally, according to the matched semantic instances, the geometric transformation matrix between two point clouds is first obtained by SVD algorithm and then refined by ICP algorithm. The experiments are cconducted on the KITTI Odometry dataset, and the average relative translation error and average relative rotation error of the proposed method are 6.6cm and 0.229 respectively.


End-to-End 3D Point Cloud Learning for Registration Task Using Virtual Correspondences

3D Point cloud registration is still a very challenging topic due to the...

Augmented Semantic Signatures of Airborne LiDAR Point Clouds for Comparison

LiDAR point clouds provide rich geometric information, which is particul...

Learning Dense Features for Point Cloud Registration Using Graph Attention Network

Point cloud registration is a fundamental task in many applications such...

Fast Semantic-Assisted Outlier Removal for Large-scale Point Cloud Registration

With current trends in sensors (cheaper, more volume of data) and applic...

DFC: Deep Feature Consistency for Robust Point Cloud Registration

How to extract significant point cloud features and estimate the pose be...

Learning Compact Geometric Features

We present an approach to learning features that represent the local geo...

Pix2Point: Learning Outdoor 3D Using Sparse Point Clouds and Optimal Transport

Good quality reconstruction and comprehension of a scene rely on 3D esti...

Please sign up or login with your details

Forgot password? Click here to reset