SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints

by   Amir Sadeghian, et al.

We are witnessing an increasing growth of autonomous platforms such as self-driving cars and social robots around us. These mobile machines need to navigate dynamic human environments safely and in a socially acceptable way. Hence, understanding the human behavior and the physical constraints of the environment is crucial. To address the task of path prediction for multiple interacting agents in a scene, we present SoPhie; an interpretable framework based on Generative Adversarial Network (GAN). Sophie leverages two sources of information: the past trajectory of all the agents in the scene and a wide top-view image of the navigation scene. Our approach combines a physical attention mechanism with a social attention mechanism. The physical attention component helps the model to learn where to look in a large scene and extract the most salient parts of the image relevant to the path. Whereas, the social attention component is able to aggregate information across different involved agents and extract the most important trajectory information from the surrounding agents, enabling our method to predict socially aware paths. SoPhie is able to capture the multi-modal nature of the future prediction: given the history of trajectories and a navigation scene, there can be multiple acceptable paths in the future. Through experiments on several trajectory forecasting benchmarks, we show that SoPhie outperforms prior work in terms of accuracy, while predicting physically appropriate paths. We also show that SoPhie is able to classify traversable vs non-traversable locations in a scene.


page 2

page 8


Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks

Predicting the future trajectories of multiple interacting agents in a s...

Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks

Understanding human motion behavior is critical for autonomous moving pl...

CAR-Net: Clairvoyant Attentive Recurrent Network

We present an interpretable framework for path prediction that learns sc...

DAG-Net: Double Attentive Graph Neural Network for Trajectory Forecasting

Understanding human motion behaviour is a critical task for several poss...

Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimation

In this paper, we present Goal-GAN, an interpretable and end-to-end trai...

SIMF: Semantics-aware Interactive Motion Forecasting for Autonomous Driving

Autonomous vehicles require motion forecasting of their surrounding mult...

Social and Scene-Aware Trajectory Prediction in Crowded Spaces

Mimicking human ability to forecast future positions or interpret comple...

Please sign up or login with your details

Forgot password? Click here to reset