Probabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model

by   Akash Sengupta, et al.

This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input images. This is motivated by the ill-posed nature of the problem wherein multiple 3D reconstructions may match the image evidence, particularly when some parts of the body are locally occluded. However, body shape parameters in widely-used body models (e.g. SMPL) control global deformations over the whole body surface. Distributions over these global shape parameters are unable to meaningfully capture uncertainty in shape estimates associated with locally-occluded body parts. In contrast, we present a method that (i) predicts distributions over local body shape in the form of semantic body measurements and (ii) uses a linear mapping to transform a local distribution over body measurements to a global distribution over SMPL shape parameters. We show that our method outperforms the current state-of-the-art in terms of identity-dependent body shape estimation accuracy on the SSP-3D dataset, and a private dataset of tape-measured humans, by probabilistically-combining local body measurement distributions predicted from multiple images of a subject.


page 3

page 4

page 9

page 13

page 15

page 16

page 17

page 18


Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wild

This paper addresses the problem of 3D human body shape and pose estimat...

Semantify: Simplifying the Control of 3D Morphable Models using CLIP

We present Semantify: a self-supervised method that utilizes the semanti...

Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wild

This paper addresses the problem of 3D human body shape and pose estimat...

HuManiFlow: Ancestor-Conditioned Normalising Flows on SO(3) Manifolds for Human Pose and Shape Distribution Estimation

Monocular 3D human pose and shape estimation is an ill-posed problem sin...

Distributional Depth-Based Estimation of Object Articulation Models

We propose a method that efficiently learns distributions over articulat...

BoPR: Body-aware Part Regressor for Human Shape and Pose Estimation

This paper presents a novel approach for estimating human body shape and...

The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimation

Nonparametric based methods have recently shown promising results in rec...

Please sign up or login with your details

Forgot password? Click here to reset