6D Object Pose Regression via Supervised Learning on Point Clouds

by   Ge Gao, et al.
Tsinghua University
University of Hamburg

This paper addresses the task of estimating the 6 degrees of freedom pose of a known 3D object from depth information represented by a point cloud. Deep features learned by convolutional neural networks from color information have been the dominant features to be used for inferring object poses, while depth information receives much less attention. However, depth information contains rich geometric information of the object shape, which is important for inferring the object pose. We use depth information represented by point clouds as the input to both deep networks and geometry-based pose refinement and use separate networks for rotation and translation regression. We argue that the axis-angle representation is a suitable rotation representation for deep learning, and use a geodesic loss function for rotation regression. Ablation studies show that these design choices outperform alternatives such as the quaternion representation and L2 loss, or regressing translation and rotation with the same network. Our simple yet effective approach clearly outperforms state-of-the-art methods on the YCB-video dataset. The implementation and trained model are avaliable at: https://github.com/GeeeG/CloudPose.


CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Clouds

It is often desired to train 6D pose estimation systems on synthetic dat...

Discrete Rotation Equivariance for Point Cloud Recognition

Despite the recent active research on processing point clouds with deep ...

CubeNet: Equivariance to 3D Rotation and Translation

3D Convolutional Neural Networks are sensitive to transformations applie...

3D Convolution on RGB-D Point Clouds for Accurate Model-free Object Pose Estimation

The conventional pose estimation of a 3D object usually requires the kno...

PRIN: Pointwise Rotation-Invariant Network

In recent years, point clouds have earned quite some research interests ...

Shape-Pose Disentanglement using SE(3)-equivariant Vector Neurons

We introduce an unsupervised technique for encoding point clouds into a ...

A Probabilistic Rotation Representation for Symmetric Shapes With an Efficiently Computable Bingham Loss Function

In recent years, a deep learning framework has been widely used for obje...

Code Repositories


Code for "6D Object Pose Regression via Supervised Learning on Point Clouds" @ICRA2020

view repo

Please sign up or login with your details

Forgot password? Click here to reset