Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?

06/26/2020
by   Angelos Filos, et al.
14

Out-of-training-distribution (OOD) scenarios are a common challenge of learning agents at deployment, typically leading to arbitrary deductions and poorly-informed decisions. In principle, detection of and adaptation to OOD scenes can mitigate their adverse effects. In this paper, we highlight the limitations of current approaches to novel driving scenes and propose an epistemic uncertainty-aware planning method, called robust imitative planning (RIP). Our method can detect and recover from some distribution shifts, reducing the overconfident and catastrophic extrapolations in OOD scenes. If the model's uncertainty is too great to suggest a safe course of action, the model can instead query the expert driver for feedback, enabling sample-efficient online adaptation, a variant of our method we term adaptive robust imitative planning (AdaRIP). Our methods outperform current state-of-the-art approaches in the nuScenes prediction challenge, but since no benchmark evaluating OOD detection and adaption currently exists to assess control, we introduce an autonomous car novel-scene benchmark, CARNOVEL, to evaluate the robustness of driving agents to a suite of tasks with distribution shifts.

READ FULL TEXT

page 2

page 4

page 13

page 14

page 16

research
08/11/2023

Defensive Perception: Estimation and Monitoring of Neural Network Performance under Deployment

In this paper, we propose a method for addressing the issue of unnoticed...
research
12/15/2021

Estimating Uncertainty For Vehicle Motion Prediction on Yandex Shifts Dataset

Motion prediction of surrounding agents is an important task in context ...
research
02/09/2023

Robust Question Answering against Distribution Shifts with Test-Time Adaptation: An Empirical Study

A deployed question answering (QA) model can easily fail when the test d...
research
07/01/2021

Managing driving modes in automated driving systems

Current technologies are unable to produce massively deployable, fully a...
research
03/09/2020

FormulaZero: Distributionally Robust Online Adaptation via Offline Population Synthesis

Balancing performance and safety is crucial to deploying autonomous vehi...
research
05/05/2022

Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing

We present the results of our autonomous racing virtual challenge, based...
research
07/07/2022

CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationships

As machine learning models become increasingly prevalent in motion forec...

Please sign up or login with your details

Forgot password? Click here to reset