MotionMixer: MLP-based 3D Human Body Pose Forecasting

07/01/2022
by   Arij Bouazizi, et al.
6

In this work, we present MotionMixer, an efficient 3D human body pose forecasting model based solely on multi-layer perceptrons (MLPs). MotionMixer learns the spatial-temporal 3D body pose dependencies by sequentially mixing both modalities. Given a stacked sequence of 3D body poses, a spatial-MLP extracts fine grained spatial dependencies of the body joints. The interaction of the body joints over time is then modelled by a temporal MLP. The spatial-temporal mixed features are finally aggregated and decoded to obtain the future motion. To calibrate the influence of each time step in the pose sequence, we make use of squeeze-and-excitation (SE) blocks. We evaluate our approach on Human3.6M, AMASS, and 3DPW datasets using the standard evaluation protocols. For all evaluations, we demonstrate state-of-the-art performance, while having a model with a smaller number of parameters. Our code is available at: https://github.com/MotionMLP/MotionMixer

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/15/2019

Learning Trajectory Dependencies for Human Motion Prediction

Human motion prediction, i.e., forecasting future body poses given obser...
research
03/09/2023

Trajectory-Aware Body Interaction Transformer for Multi-Person Pose Forecasting

Multi-person pose forecasting remains a challenging problem, especially ...
research
01/18/2023

HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimation

Transformer-based approaches have been successfully proposed for 3D huma...
research
08/17/2023

Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction

Exploring spatial-temporal dependencies from observed motions is one of ...
research
01/07/2022

Motion Prediction via Joint Dependency Modeling in Phase Space

Motion prediction is a classic problem in computer vision, which aims at...
research
10/21/2022

MEEV: Body Mesh Estimation On Egocentric Video

This technical report introduces our solution, MEEV, proposed to the Ego...
research
03/17/2021

Aggregated Multi-GANs for Controlled 3D Human Motion Prediction

Human motion prediction from historical pose sequence is at the core of ...

Please sign up or login with your details

Forgot password? Click here to reset