Target-point Attention Transformer: A novel trajectory predict network for end-to-end autonomous driving

08/03/2023
by   Jingyu Du, et al.
0

In the field of autonomous driving, there have been many excellent perception models for object detection, semantic segmentation, and other tasks, but how can we effectively use the perception models for vehicle planning? Traditional autonomous vehicle trajectory prediction methods not only need to obey traffic rules to avoid collisions, but also need to follow the prescribed route to reach the destination. In this paper, we propose a Transformer-based trajectory prediction network for end-to-end autonomous driving without rules called Target-point Attention Transformer network (TAT). We use the attention mechanism to realize the interaction between the predicted trajectory and the perception features as well as target-points. We demonstrate that our proposed method outperforms existing conditional imitation learning and GRU-based methods, significantly reducing the occurrence of accidents and improving route completion. We evaluate our approach in complex closed loop driving scenarios in cities using the CARLA simulator and achieve state-of-the-art performance.

READ FULL TEXT

page 2

page 6

research
04/19/2021

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

How should representations from complementary sensors be integrated for ...
research
04/19/2023

Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles

We propose a perception imitation method to simulate results of a certai...
research
04/21/2021

Multi-task Learning with Attention for End-to-end Autonomous Driving

Autonomous driving systems need to handle complex scenarios such as lane...
research
03/22/2022

Learning from All Vehicles

In this paper, we present a system to train driving policies from experi...
research
12/16/2022

Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving

The feasibility of collecting a large amount of expert demonstrations ha...
research
10/20/2020

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

One of the challenges to reduce the gap between the machine and the huma...
research
06/29/2023

MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusion

Multiple Object Tracking (MOT) is crucial to autonomous vehicle percepti...

Please sign up or login with your details

Forgot password? Click here to reset