BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects

02/25/2023
by   Martin Sundermeyer, et al.
2

We present the evaluation methodology, datasets and results of the BOP Challenge 2022, the fourth in a series of public competitions organized with the goal to capture the status quo in the field of 6D object pose estimation from an RGB/RGB-D image. In 2022, we witnessed another significant improvement in the pose estimation accuracy -- the state of the art, which was 56.9 AR$_C$ in 2019 (Vidal et al.) and 69.8 AR$_C$ in 2020 (CosyPose), moved to new heights of 83.7 AR$_C$ (GDRNPP). Out of 49 pose estimation methods evaluated since 2019, the top 18 are from 2022. Methods based on point pair features, which were introduced in 2010 and achieved competitive results even in 2020, are now clearly outperformed by deep learning methods. The synthetic-to-real domain gap was again significantly reduced, with 82.7 AR$_C$ achieved by GDRNPP trained only on synthetic images from BlenderProc. The fastest variant of GDRNPP reached 80.5 AR$_C$ with an average time per image of 0.23s. Since most of the recent methods for 6D object pose estimation begin by detecting/segmenting objects, we also started evaluating 2D object detection and segmentation performance based on the COCO metrics. Compared to the Mask R-CNN results from CosyPose in 2020, detection improved from 60.3 to 77.3 AP$_C$ and segmentation from 40.5 to 58.7 AP$_C$. The online evaluation system stays open and is available at: \href{http://bop.felk.cvut.cz/}{bop.felk.cvut.cz}.

READ FULL TEXT

page 2

page 4

page 5

research
09/15/2020

BOP Challenge 2020 on 6D Object Localization

This paper presents the evaluation methodology, datasets, and results of...
research
01/31/2022

Combining Local and Global Pose Estimation for Precise Tracking of Similar Objects

In this paper, we present a multi-object 6D detection and tracking pipel...
research
08/24/2018

BOP: Benchmark for 6D Object Pose Estimation

We propose a benchmark for 6D pose estimation of a rigid object from a s...
research
12/05/2016

Point Pair Feature based Object Detection for Random Bin Picking

Point pair features are a popular representation for free form 3D object...
research
06/21/2018

Symmetry Aware Evaluation of 3D Object Detection and Pose Estimation in Scenes of Many Parts in Bulk

While 3D object detection and pose estimation has been studied for a lon...
research
02/23/2018

6D Pose Estimation using an Improved Method based on Point Pair Features

The Point Pair Feature (Drost et al. 2010) has been one of the most succ...
research
12/30/2021

Pose Estimation of Specific Rigid Objects

In this thesis, we address the problem of estimating the 6D pose of rigi...

Please sign up or login with your details

Forgot password? Click here to reset