CAD Priors for Accurate and Flexible Instance Reconstruction

05/08/2017
by   Tolga Birdal, et al.
0

We present an efficient and automatic approach for accurate reconstruction of instances of big 3D objects from multiple, unorganized and unstructured point clouds, in presence of dynamic clutter and occlusions. In contrast to conventional scanning, where the background is assumed to be rather static, we aim at handling dynamic clutter where background drastically changes during the object scanning. Currently, it is tedious to solve this with available methods unless the object of interest is first segmented out from the rest of the scene. We address the problem by assuming the availability of a prior CAD model, roughly resembling the object to be reconstructed. This assumption almost always holds in applications such as industrial inspection or reverse engineering. With aid of this prior acting as a proxy, we propose a fully enhanced pipeline, capable of automatically detecting and segmenting the object of interest from scenes and creating a pose graph, online, with linear complexity. This allows initial scan alignment to the CAD model space, which is then refined without the CAD constraint to fully recover a high fidelity 3D reconstruction, accurate up to the sensor noise level. We also contribute a novel object detection method, local implicit shape models (LISM) and give a fast verification scheme. We evaluate our method on multiple datasets, demonstrating the ability to accurately reconstruct objects from small sizes up to 125m^3.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
06/15/2023

CAD-Estate: Large-scale CAD Model Annotation in RGB Videos

We propose a method for annotating videos of complex multi-object scenes...
research
06/10/2019

End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans

We present a novel, end-to-end approach to align CAD models to an 3D sca...
research
01/12/2021

PvDeConv: Point-Voxel Deconvolution for Autoencoding CAD Construction in 3D

We propose a Point-Voxel DeConvolution (PVDeConv) module for 3D data aut...
research
03/03/2022

CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation

This paper studies the complex task of simultaneous multi-object 3D reco...
research
07/21/2021

Fabrication-Aware Reverse Engineering for Carpentry

We propose a novel method to generate fabrication blueprints from images...
research
07/31/2023

Part-level Scene Reconstruction Affords Robot Interaction

Existing methods for reconstructing interactive scenes primarily focus o...
research
11/24/2021

Fast mesh denoising with data driven normal filtering using deep variational autoencoders

Recent advances in 3D scanning technology have enabled the deployment of...

Please sign up or login with your details

Forgot password? Click here to reset