DeepAI AI Chat
Log In Sign Up

Deformable Shape Completion with Graph Convolutional Autoencoders

by   Or Litany, et al.

The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of reconstructing a (possibly non-rigidly moving) 3D object from a single or multiple partial scans has received increasing attention in recent years. In this work, we propose a novel learning-based method for the completion of partial shapes. Unlike the majority of existing approaches, our method focuses on objects that can undergo non-rigid deformations. The core of our method is a variational autoencoder with graph convolutional operations that learns a latent space for complete realistic shapes. At inference, we optimize to find the representation in this latent space that best fits the generated shape to the known partial input. The completed shape exhibits a realistic appearance on the unknown part. We show promising results towards the completion of synthetic and real scans of human body and face meshes exhibiting different styles of articulation and partiality.


page 11

page 19

page 20


Intraoperative Liver Surface Completion with Graph Convolutional VAE

In this work we propose a method based on geometric deep learning to pre...

Shape Completion via IMLE

Shape completion is the problem of completing partial input shapes such ...

TSCom-Net: Coarse-to-Fine 3D Textured Shape Completion Network

Reconstructing 3D human body shapes from 3D partial textured scans remai...

PCN: Point Completion Network

Shape completion, the problem of estimating the complete geometry of obj...

The Whole Is Greater Than the Sum of Its Nonrigid Parts

According to Aristotle, a philosopher in Ancient Greece, "the whole is g...

ToothInpaintor: Tooth Inpainting from Partial 3D Dental Model and 2D Panoramic Image

In orthodontic treatment, a full tooth model consisting of both the crow...

3D Textured Shape Recovery with Learned Geometric Priors

3D textured shape recovery from partial scans is crucial for many real-w...