HyperPocket: Generative Point Cloud Completion

by   Przemysław Spurek, et al.

Scanning real-life scenes with modern registration devices typically give incomplete point cloud representations, mostly due to the limitations of the scanning process and 3D occlusions. Therefore, completing such partial representations remains a fundamental challenge of many computer vision applications. Most of the existing approaches aim to solve this problem by learning to reconstruct individual 3D objects in a synthetic setup of an uncluttered environment, which is far from a real-life scenario. In this work, we reformulate the problem of point cloud completion into an object hallucination task. Thus, we introduce a novel autoencoder-based architecture called HyperPocket that disentangles latent representations and, as a result, enables the generation of multiple variants of the completed 3D point clouds. We split point cloud processing into two disjoint data streams and leverage a hypernetwork paradigm to fill the spaces, dubbed pockets, that are left by the missing object parts. As a result, the generated point clouds are not only smooth but also plausible and geometrically consistent with the scene. Our method offers competitive performances to the other state-of-the-art models, and it enables a plethora of novel applications.


page 2

page 4

page 6

page 12

page 13


Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results

As real-scanned point clouds are mostly partial due to occlusions and vi...

Towards realistic symmetry-based completion of previously unseen point clouds

3D scanning is a complex multistage process that generates a point cloud...

Points2NeRF: Generating Neural Radiance Fields from 3D point cloud

Contemporary registration devices for 3D visual information, such as LID...

Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysis

Point cloud completion is a generation and estimation issue derived from...

Temporal Point Cloud Completion with Pose Disturbance

Point clouds collected by real-world sensors are always unaligned and sp...

Learning Local Displacements for Point Cloud Completion

We propose a novel approach aimed at object and semantic scene completio...

Instance-incremental Scene Graph Generation from Real-world Point Clouds via Normalizing Flows

This work introduces a new task of instance-incremental scene graph gene...

Please sign up or login with your details

Forgot password? Click here to reset