ZePHyR: Zero-shot Pose Hypothesis Rating

04/28/2021
by   Brian Okorn, et al.
0

Pose estimation is a basic module in many robot manipulation pipelines. Estimating the pose of objects in the environment can be useful for grasping, motion planning, or manipulation. However, current state-of-the-art methods for pose estimation either rely on large annotated training sets or simulated data. Further, the long training times for these methods prohibit quick interaction with novel objects. To address these issues, we introduce a novel method for zero-shot object pose estimation in clutter. Our approach uses a hypothesis generation and scoring framework, with a focus on learning a scoring function that generalizes to objects not used for training. We achieve zero-shot generalization by rating hypotheses as a function of unordered point differences. We evaluate our method on challenging datasets with both textured and untextured objects in cluttered scenes and demonstrate that our method significantly outperforms previous methods on this task. We also demonstrate how our system can be used by quickly scanning and building a model of a novel object, which can immediately be used by our method for pose estimation. Our work allows users to estimate the pose of novel objects without requiring any retraining. Additional information can be found on our website https://bokorn.github.io/zephyr/

READ FULL TEXT

page 1

page 3

page 6

page 12

page 13

research
01/18/2022

OSSID: Online Self-Supervised Instance Detection by (and for) Pose Estimation

Real-time object pose estimation is necessary for many robot manipulatio...
research
05/29/2023

3D Model-based Zero-Shot Pose Estimation Pipeline

Most existing learning-based pose estimation methods are typically devel...
research
04/07/2022

Zero-Shot Category-Level Object Pose Estimation

Object pose estimation is an important component of most vision pipeline...
research
03/17/2021

Generating Annotated Training Data for 6D Object Pose Estimation in Operational Environments with Minimal User Interaction

Recently developed deep neural networks achieved state-of-the-art result...
research
09/21/2023

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers

As robotic systems increasingly encounter complex and unconstrained real...
research
03/14/2022

Panoptic animal pose estimators are zero-shot performers

Animal pose estimation is critical in applications ranging from life sci...
research
05/24/2021

Coarse-to-Fine for Sim-to-Real: Sub-Millimetre Precision Across the Workspace

When training control policies for robot manipulation via deep learning,...

Please sign up or login with your details

Forgot password? Click here to reset