Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors

by   Xinyu Yi, et al.

Motion capture from sparse inertial sensors has shown great potential compared to image-based approaches since occlusions do not lead to a reduced tracking quality and the recording space is not restricted to be within the viewing frustum of the camera. However, capturing the motion and global position only from a sparse set of inertial sensors is inherently ambiguous and challenging. In consequence, recent state-of-the-art methods can barely handle very long period motions, and unrealistic artifacts are common due to the unawareness of physical constraints. To this end, we present the first method which combines a neural kinematics estimator and a physics-aware motion optimizer to track body motions with only 6 inertial sensors. The kinematics module first regresses the motion status as a reference, and then the physics module refines the motion to satisfy the physical constraints. Experiments demonstrate a clear improvement over the state of the art in terms of capture accuracy, temporal stability, and physical correctness.


page 2

page 3

page 5

page 6

page 9

page 10

page 11

page 13


EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors

Human and environment sensing are two important topics in Computer Visio...

HybridCap: Inertia-aid Monocular Capture of Challenging Human Motions

Monocular 3D motion capture (mocap) is beneficial to many applications. ...

Transformer Inertial Poser: Attention-based Real-time Human Motion Reconstruction from Sparse IMUs

Real-time human motion reconstruction from a sparse set of wearable IMUs...

Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs

We address the problem of making human motion capture in the wild more p...

Particle Filter Based Monocular Human Tracking with a 3D Cardbox Model and a Novel Deterministic Resampling Strategy

The challenge of markerless human motion tracking is the high dimensiona...

QuestEnvSim: Environment-Aware Simulated Motion Tracking from Sparse Sensors

Replicating a user's pose from only wearable sensors is important for ma...

Generation of Accurate Translational Motion for Testing Inertial Sensors

An experimental setup is presented, developed for comprehensive evaluati...

Please sign up or login with your details

Forgot password? Click here to reset