EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning

03/20/2023
by   Chenxin Xu, et al.
0

Learning to predict agent motions with relationship reasoning is important for many applications. In motion prediction tasks, maintaining motion equivariance under Euclidean geometric transformations and invariance of agent interaction is a critical and fundamental principle. However, such equivariance and invariance properties are overlooked by most existing methods. To fill this gap, we propose EqMotion, an efficient equivariant motion prediction model with invariant interaction reasoning. To achieve motion equivariance, we propose an equivariant geometric feature learning module to learn a Euclidean transformable feature through dedicated designs of equivariant operations. To reason agent's interactions, we propose an invariant interaction reasoning module to achieve a more stable interaction modeling. To further promote more comprehensive motion features, we propose an invariant pattern feature learning module to learn an invariant pattern feature, which cooperates with the equivariant geometric feature to enhance network expressiveness. We conduct experiments for the proposed model on four distinct scenarios: particle dynamics, molecule dynamics, human skeleton motion prediction and pedestrian trajectory prediction. Experimental results show that our method is not only generally applicable, but also achieves state-of-the-art prediction performances on all the four tasks, improving by 24.0/30.1/8.6/9.2 available at https://github.com/MediaBrain-SJTU/EqMotion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2020

Collaborative Motion Prediction via Neural Motion Message Passing

Motion prediction is essential and challenging for autonomous vehicles a...
research
06/27/2012

Learning Invariant Representations with Local Transformations

Learning invariant representations is an important problem in machine le...
research
06/27/2022

Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoning

Demystifying the interactions among multiple agents from their past traj...
research
03/21/2023

MSTFormer: Motion Inspired Spatial-temporal Transformer with Dynamic-aware Attention for long-term Vessel Trajectory Prediction

Incorporating the dynamics knowledge into the model is critical for achi...
research
07/21/2022

D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights

A profound understanding of inter-agent relationships and motion behavio...
research
03/09/2022

Adaptive Trajectory Prediction via Transferable GNN

Pedestrian trajectory prediction is an essential component in a wide ran...
research
09/18/2023

Holistic Geometric Feature Learning for Structured Reconstruction

The inference of topological principles is a key problem in structured r...

Please sign up or login with your details

Forgot password? Click here to reset