TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell

by   Hayato Onizuka, et al.

Recovering the 3D shape of a person from its 2D appearance is ill-posed due to ambiguities. Nevertheless, with the help of convolutional neural networks (CNN) and prior knowledge on the 3D human body, it is possible to overcome such ambiguities to recover detailed 3D shapes of human bodies from single images. Current solutions, however, fail to reconstruct all the details of a person wearing loose clothes. This is because of either (a) huge memory requirement that cannot be maintained even on modern GPUs or (b) the compact 3D representation that cannot encode all the details. In this paper, we propose the tetrahedral outer shell volumetric truncated signed distance function (TetraTSDF) model for the human body, and its corresponding part connection network (PCN) for 3D human body shape regression. Our proposed model is compact, dense, accurate, and yet well suited for CNN-based regression task. Our proposed PCN allows us to learn the distribution of the TSDF in the tetrahedral volume from a single image in an end-to-end manner. Results show that our proposed method allows to reconstruct detailed shapes of humans wearing loose clothes from single RGB images.


page 1

page 3

page 5

page 7

page 8


Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformation

This paper presents a novel framework to recover detailed human body sha...

DeepHuman: 3D Human Reconstruction from a Single Image

We propose DeepHuman, a deep learning based framework for 3D human recon...

Shape-from-Mask: A Deep Learning Based Human Body Shape Reconstruction from Binary Mask Images

3D content creation is referred to as one of the most fundamental tasks ...

3D Human Body Reconstruction from a Single Image via Volumetric Regression

This paper proposes the use of an end-to-end Convolutional Neural Networ...

PeelNet: Textured 3D reconstruction of human body using single view RGB image

Reconstructing human shape and pose from a single image is a challenging...

Moulding Humans: Non-parametric 3D Human Shape Estimation from Single Images

In this paper, we tackle the problem of 3D human shape estimation from s...

Learning to Reconstruct People in Clothing from a Single RGB Camera

We present a learning-based model to infer the personalized 3D shape of ...

Please sign up or login with your details

Forgot password? Click here to reset