BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

06/23/2022

∙

We present BlazePose GHUM Holistic, a lightweight neural network pipeline for 3D human body landmarks and pose estimation, specifically tailored to real-time on-device inference. BlazePose GHUM Holistic enables motion capture from a single RGB image including avatar control, fitness tracking and AR/VR effects. Our main contributions include i) a novel method for 3D ground truth data acquisition, ii) updated 3D body tracking with additional hand landmarks and iii) full body pose estimation from a monocular image.

READ FULL TEXT

BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

BlazePose: On-device Real-time Body Pose tracking

Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera

Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction

Computer methods for 3D motion tracking in real-time

Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds

Advancements in Repetitive Action Counting: Joint-Based PoseRAC Model With Improved Performance

BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

Related Research

BlazePose: On-device Real-time Body Pose tracking

Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera

Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction

Computer methods for 3D motion tracking in real-time

Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds

Advancements in Repetitive Action Counting: Joint-Based PoseRAC Model With Improved Performance