HumanMAC: Masked Motion Completion for Human Motion Prediction

by   Ling-Hao Chen, et al.
The University of Sydney
Nanyang Technological University
Xidian University

Human motion prediction is a classical problem in computer vision and computer graphics, which has a wide range of practical applications. Previous effects achieve great empirical performance based on an encoding-decoding fashion. The methods of this fashion work by first encoding previous motions to latent representations and then decoding the latent representations into predicted motions. However, in practice, they are still unsatisfactory due to several issues, including complicated loss constraints, cumbersome training processes, and scarce switch of different categories of motions in prediction. In this paper, to address the above issues, we jump out of the foregoing fashion and propose a novel framework from a new perspective. Specifically, our framework works in a denoising diffusion style. In the training stage, we learn a motion diffusion model that generates motions from random noise. In the inference stage, with a denoising procedure, we make motion prediction conditioning on observed motions to output more continuous and controllable predictions. The proposed framework enjoys promising algorithmic properties, which only needs one loss in optimization and is trained in an end-to-end manner. Additionally, it accomplishes the switch of different categories of motions effectively, which is significant in realistic tasks, e.g., the animation task. Comprehensive experiments on benchmarks confirm the superiority of the proposed framework. The project page is available at <>.


page 1

page 2

page 3

page 4


Denoising Diffusion Probabilistic Models for Styled Walking Synthesis

Generating realistic motions for digital humans is time-consuming for ma...

Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models

Generating realistic motions for digital humans is a core but challengin...

Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolation

Deriving sophisticated 3D motions from sparse keyframes is a particularl...

Learning Disentangled Representations for Controllable Human Motion Prediction

Generative model-based motion prediction techniques have recently realiz...

Single Motion Diffusion

Synthesizing realistic animations of humans, animals, and even imaginary...

DeFeeNet: Consecutive 3D Human Motion Prediction with Deviation Feedback

Let us rethink the real-world scenarios that require human motion predic...

R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction

Image-based motion prediction is one of the essential techniques for rob...

Please sign up or login with your details

Forgot password? Click here to reset