Failure Prediction for Autonomous Driving

by   Simon Hecker, et al.

The primary focus of autonomous driving research is to improve driving accuracy. While great progress has been made, state-of-the-art algorithms still fail at times. Such failures may have catastrophic consequences. It therefore is important that automated cars foresee problems ahead as early as possible. This is also of paramount importance if the driver will be asked to take over. We conjecture that failures do not occur randomly. For instance, driving models may fail more likely at places with heavy traffic, at complex intersections, and/or under adverse weather/illumination conditions. This work presents a method to learn to predict the occurrence of these failures, i.e. to assess how difficult a scene is to a given driving model and to possibly give the human driver an early headsup. A camera-based driving model is developed and trained over real driving datasets. The discrepancies between the model's predictions and the human `ground-truth' maneuvers were then recorded, to yield the `failure' scores. Experimental results show that the failure score can indeed be learned and predicted. Thus, our prediction method is able to improve the overall safety of an automated driving model by alerting the human driver timely, leading to better human-vehicle collaborative driving.


page 2

page 4

page 6

page 7


Human-Vehicle Cooperation on Prediction-Level: Enhancing Automated Driving with Human Foresight

To maximize safety and driving comfort, autonomous driving systems can b...

On failures of RGB cameras and their effects in autonomous driving applications

RGB cameras are arguably one of the most relevant sensors for autonomous...

Failure Detection for Motion Prediction of Autonomous Driving: An Uncertainty Perspective

Motion prediction is essential for safe and efficient autonomous driving...

Automated Failure-Mode Clustering and Labeling for Informed Car-To-Driver Handover in Autonomous Vehicles

The car-to-driver handover is a critically important component of safe a...

Interpretable Safety Validation for Autonomous Vehicles

An open problem for autonomous driving is how to validate the safety of ...

Gradient Optimization for Single-State RMDPs

As modern problems such as autonomous driving, control of robotic compon...

Rigorous Agent Evaluation: An Adversarial Approach to Uncover Catastrophic Failures

This paper addresses the problem of evaluating learning systems in safet...

Please sign up or login with your details

Forgot password? Click here to reset