MoDi: Unconditional Motion Synthesis from Diverse Data

06/16/2022
by   Sigal Raab, et al.
0

The emergence of neural networks has revolutionized the field of motion synthesis. Yet, learning to unconditionally synthesize motions from a given distribution remains a challenging task, especially when the motions are highly diverse. In this work, we present MoDi - a generative model trained in a completely unsupervised setting from an extremely diverse, unstructured and unlabeled motion dataset. During inference, MoDi can synthesize high-quality, diverse motions that lay in a well-behaved and highly semantic latent space. We show that despite the lack of any structure in the dataset, the latent space can be semantically clustered, facilitating various applications including, semantic editing, crowd simulation and motion interpolation. Our qualitative and quantitative experiments show that our framework achieves state-of-the-art synthesis quality that can follow the distribution of highly diverse motion datasets. Code and trained models are available at https://sigal-raab.github.io/MoDi.

READ FULL TEXT
research
05/05/2022

GANimator: Neural Motion Synthesis from a Single Sequence

We present GANimator, a generative model that learns to synthesize novel...
research
06/01/2023

Example-based Motion Synthesis via Generative Motion Matching

We present GenMM, a generative model that "mines" as many diverse motion...
research
03/15/2022

MotionCLIP: Exposing Human Motion Generation to CLIP Space

We introduce MotionCLIP, a 3D human motion auto-encoder featuring a late...
research
12/08/2022

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis

Conventional methods for human motion synthesis are either deterministic...
research
10/08/2019

Motion Generation Considering Situation with Conditional Generative Adversarial Networks for Throwing Robots

When robots work in a cluttered environment, the constraints for motions...
research
02/12/2023

Single Motion Diffusion

Synthesizing realistic animations of humans, animals, and even imaginary...
research
04/22/2021

Hierarchical Motion Understanding via Motion Programs

Current approaches to video analysis of human motion focus on raw pixels...

Please sign up or login with your details

Forgot password? Click here to reset