Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wild

by   Akash Sengupta, et al.

This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Recent progress in this field has focused on single images, video or multi-view images as inputs. In contrast, we propose a new task: shape and pose estimation from a group of multiple images of a human subject, without constraints on subject pose, camera viewpoint or background conditions between images in the group. Our solution to this task predicts distributions over SMPL body shape and pose parameters conditioned on the input images in the group. We probabilistically combine predicted body shape distributions from each image to obtain a final multi-image shape prediction. We show that the additional body shape information present in multi-image input groups improves 3D human shape estimation metrics compared to single-image inputs on the SSP-3D dataset and a private dataset of tape-measured humans. In addition, predicting distributions over 3D bodies allows us to quantify pose prediction uncertainty, which is useful when faced with challenging input images with significant occlusion. Our method demonstrates meaningful pose uncertainty on the 3DPW dataset and is competitive with the state-of-the-art in terms of pose estimation metrics.


page 1

page 3

page 4

page 5

page 8


Probabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model

This paper addresses the problem of 3D human body shape and pose estimat...

Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wild

This paper addresses the problem of monocular 3D human shape and pose es...

Learning camera viewpoint using CNN to improve 3D body pose estimation

The objective of this work is to estimate 3D human pose from a single RG...

VolNet: Estimating Human Body Part Volumes from a Single RGB Image

Human body volume estimation from a single RGB image is a challenging pr...

Estimation of 3D Body Shape and Clothing Measurements from Frontal- and Side-view Images

The estimation of 3D human body shape and clothing measurements is cruci...

Shape Evasion: Preventing Body Shape Inference of Multi-Stage Approaches

Modern approaches to pose and body shape estimation have recently achiev...

On the Evaluation of RGB-D-based Categorical Pose and Shape Estimation

Recently, various methods for 6D pose and shape estimation of objects ha...

Please sign up or login with your details

Forgot password? Click here to reset