Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision

by   Ashish Mehta, et al.

Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end trainable network for imitating the expert demonstrator's driving commands. The network intermediately predicts visual affordances and action primitives through direct supervision which provide the aforementioned auxiliary supervised guidance. We demonstrate that such joint learning and supervised guidance facilitates hierarchical task decomposition, assisting the agent to learn faster, achieve better driving performance and increases transparency of the otherwise black-box end-to-end network. We run our experiments to validate the MT-LfD framework in CARLA, an open-source urban driving simulator. We introduce multiple non-player agents in CARLA and induce temporal noise in them for realistic stochasticity.


page 6

page 7


CARLA: An Open Urban Driving Simulator

We introduce CARLA, an open-source simulator for autonomous driving rese...

SUMMIT: A Simulator for Urban Driving in Massive Mixed Traffic

Autonomous driving in an unregulated urban crowd is an outstanding chall...

End-to-End Urban Driving by Imitating a Reinforcement Learning Coach

End-to-end approaches to autonomous driving commonly rely on expert demo...

Explaining Autonomous Driving by Learning End-to-End Visual Attention

Current deep learning based autonomous driving approaches yield impressi...

Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline

Current end-to-end autonomous driving methods either run a controller ba...

Evaluating Robustness over High Level Driving Instruction for Autonomous Driving

In recent years, we have witnessed increasingly high performance in the ...

DeepRacing: Parameterized Trajectories for Autonomous Racing

We consider the challenging problem of high speed autonomous racing in a...

Please sign up or login with your details

Forgot password? Click here to reset