Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image

by   Zhaoxin Fan, et al.
Renmin University of China
Nanjing University
Tsinghua University

Recently, RGBD-based category-level 6D object pose estimation has achieved promising improvement in performance, however, the requirement of depth information prohibits broader applications. In order to relieve this problem, this paper proposes a novel approach named Object Level Depth reconstruction Network (OLD-Net) taking only RGB images as input for category-level 6D object pose estimation. We propose to directly predict object-level depth from a monocular RGB image by deforming the category-level shape prior into object-level depth and the canonical NOCS representation. Two novel modules named Normalized Global Position Hints (NGPH) and Shape-aware Decoupled Depth Reconstruction (SDDR) module are introduced to learn high fidelity object-level depth and delicate shape representations. At last, the 6D object pose is solved by aligning the predicted canonical representation with the back-projected object-level depth. Extensive experiments on the challenging CAMERA25 and REAL275 datasets indicate that our model, though simple, achieves state-of-the-art performance.


page 5

page 12

page 18

page 19


ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimation

Recently, category-level 6D object pose estimation has achieved signific...

RGB-based Category-level Object Pose Estimation via Decoupled Metric Scale Recovery

While showing promising results, recent RGB-D camera-based category-leve...

Probabilistic Category-Level Pose Estimation via Segmentation and Predicted-Shape Priors

We introduce a new method for category-level pose estimation which produ...

Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networks

Category-level 6D pose estimation, aiming to predict the location and or...

MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimation

We propose a novel framework for RGB-based category-level 6D object pose...

DONet: Learning Category-Level 6D Object Pose and Size Estimation from Depth Observation

We propose a method of Category-level 6D Object Pose and Size Estimation...

A Visual Navigation Perspective for Category-Level Object Pose Estimation

This paper studies category-level object pose estimation based on a sing...

Please sign up or login with your details

Forgot password? Click here to reset