Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving

by   Eli Bronstein, et al.

We demonstrate the first large-scale application of model-based generative adversarial imitation learning (MGAIL) to the task of dense urban self-driving. We augment standard MGAIL using a hierarchical model to enable generalization to arbitrary goal routes, and measure performance using a closed-loop evaluation framework with simulated interactive agents. We train policies from expert trajectories collected from real vehicles driving over 100,000 miles in San Francisco, and demonstrate a steerable policy that can navigate robustly even in a zero-shot setting, generalizing to synthetic scenarios with novel goals that never occurred in real-world driving. We also demonstrate the importance of mixing closed-loop MGAIL losses with open-loop behavior cloning losses, and show our best policy approaches the performance of the expert. We evaluate our imitative model in both average and challenging scenarios, and show how it can serve as a useful prior to plan successful trajectories.


page 3

page 4


CW-ERM: Improving Autonomous Driving Planning with Closed-loop Weighted Empirical Risk Minimization

The imitation learning of self-driving vehicle policies through behavior...

ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst

Our goal is to train a policy for autonomous driving via imitation learn...

Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula

ML-based motion planning is a promising approach to produce agents that ...

Iterative Imitation Policy Improvement for Interactive Autonomous Driving

We propose an imitation learning system for autonomous driving in urban ...

Rethinking Imitation-based Planner for Autonomous Driving

In recent years, imitation-based driving planners have reported consider...

Evaluation of MPC-based Imitation Learning for Human-like Autonomous Driving

This work evaluates and analyzes the combination of imitation learning (...

HG-DAgger: Interactive Imitation Learning with Human Experts

Imitation learning has proven to be useful for many real-world problems,...

Please sign up or login with your details

Forgot password? Click here to reset