An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Images

by   Hao Cheng, et al.

Perception that involves multi-object detection and tracking, and trajectory prediction are two major tasks of autonomous driving. However, they are currently mostly studied separately, which results in most trajectory prediction modules being developed based on ground truth trajectories without taking into account that trajectories extracted from the detection and tracking modules in real-world scenarios are noisy. These noisy trajectories can have a significant impact on the performance of the trajectory predictor and can lead to serious prediction errors. In this paper, we build an end-to-end framework for detection, tracking, and trajectory prediction called ODTP (Online Detection, Tracking and Prediction). It adopts the state-of-the-art online multi-object tracking model, QD-3DT, for perception and trains the trajectory predictor, DCENet++, directly based on the detection results without purely relying on ground truth trajectories. We evaluate the performance of ODTP on the widely used nuScenes dataset for autonomous driving. Extensive experiments show that ODPT achieves high performance end-to-end trajectory prediction. DCENet++, with the enhanced dynamic maps, predicts more accurate trajectories than its base model. It is also more robust when compared with other generative and deterministic trajectory prediction models trained on noisy detection results.


page 1

page 2

page 3

page 6


RobustTP: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs

We present RobustTP, an end-to-end algorithm for predicting future traje...

Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding

Trajectory forecasting is critical for autonomous platforms to make safe...

MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation

Recently, there has been tremendous progress in developing each individu...

Towards Robust Human Trajectory Prediction in Raw Videos

Human trajectory prediction has received increased attention lately due ...

Globally Consistent Multi-People Tracking using Motion Patterns

Many state-of-the-art approaches to people tracking rely on detecting th...

Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervision

Accurate vehicle trajectory prediction is an unsolved problem in autonom...

Challenges of Using Real-World Sensory Inputs for Motion Forecasting in Autonomous Driving

Motion forecasting plays a critical role in enabling robots to anticipat...

Please sign up or login with your details

Forgot password? Click here to reset