Recurrent Transition Networks for Character Locomotion

10/04/2018
by   Félix G. Harvey, et al.
16

Manually authoring transition animations for a complete locomotion system can be a tedious and time-consuming task, especially for large games that allow complex and constrained locomotion movements, where the number of transitions grows exponentially with the number of states. In this paper, we present a novel approach, based on deep recurrent neural networks, to automatically generate such transitions given a past context of a few frames and a target character state to reach. We present the Recurrent Transition Network (RTN), based on a modified version of the Long-Short-Term-Memory (LSTM) network, designed specifically for transition generation and trained without any gait, phase, contact or action labels. We further propose a simple yet principled way to initialize the hidden states of the LSTM layer for a given sequence which improves the performance and generalization to new motions. We both quantitatively and qualitatively evaluate our system and show that making the network terrain-aware by adding a local terrain representation to the input yields better performance for rough-terrain navigation on long transitions. Our system produces realistic and fluid transitions that rival the quality of Motion Capture-based ground-truth motions, even before applying any inverse-kinematics postprocess. Direct benefits of our approach could be to accelerate the creation of transition variations for large coverage, or even to entirely replace transition nodes in an animation graph. We further explore applications of this model in a animation super-resolution setting where we temporally decompress animations saved at 1 frame per second and show that the network is able to reconstruct motions that are hard to distinguish from un-compressed locomotion sequences.

READ FULL TEXT

page 1

page 4

page 8

page 9

research
02/09/2021

Robust Motion In-betweening

In this work we present a novel, robust transition generation technique ...
research
07/12/2016

Recurrent Highway Networks

Many sequential processing tasks require complex nonlinear transition fu...
research
03/25/2023

Diverse Motion In-betweening with Dual Posture Stitching

In-betweening is a technique for generating transitions given initial an...
research
04/25/2015

Differential Recurrent Neural Networks for Action Recognition

The long short-term memory (LSTM) neural network is capable of processin...
research
05/09/2019

Differential Recurrent Neural Network and its Application for Human Activity Recognition

The Long Short-Term Memory (LSTM) recurrent neural network is capable of...
research
07/13/2022

Diverse Dance Synthesis via Keyframes with Transformer Controllers

Existing keyframe-based motion synthesis mainly focuses on the generatio...
research
03/10/2023

Learning Multimodal Bipedal Locomotion and Implicit Transitions: A Versatile Policy Approach

In this paper, we propose a novel framework for synthesizing a single mu...

Please sign up or login with your details

Forgot password? Click here to reset