Driving-Policy Adaptive Safeguard for Autonomous Vehicles Using Reinforcement Learning

by   Zhong Cao, et al.

Safeguard functions such as those provided by advanced emergency braking (AEB) can provide another layer of safety for autonomous vehicles (AV). A smart safeguard function should adapt the activation conditions to the driving policy, to avoid unnecessary interventions as well as improve vehicle safety. This paper proposes a driving-policy adaptive safeguard (DPAS) design, including a collision avoidance strategy and an activation function. The collision avoidance strategy is designed in a reinforcement learning framework, obtained by Monte-Carlo Tree Search (MCTS). It can learn from past collisions and manipulate both braking and steering in stochastic traffics. The driving-policy adaptive activation function should dynamically assess current driving policy risk and kick in when an urgent threat is detected. To generate this activation function, MCTS' exploration and rollout modules are designed to fully evaluate the AV's current driving policy, and then explore other safer actions. In this study, the DPAS is validated with two typical highway-driving policies. The results are obtained through and 90,000 times in the stochastic and aggressive simulated traffic. The results are calibrated by naturalistic driving data and show that the proposed safeguard reduces the collision rate significantly without introducing more interventions, compared with the state-based benchmark safeguards. In summary, the proposed safeguard leverages the learning-based method in stochastic and emergent scenarios and imposes minimal influence on the driving policy.


A Deep Reinforcement Learning Driving Policy for Autonomous Road Vehicles

This work regards our preliminary investigation on the problem of path p...

A Deep Reinforcement-Learning-based Driving Policy for Autonomous Road Vehicles

In this work we consider the problem of path planning for an autonomous ...

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

In this paper, we present a safe deep reinforcement learning system for ...

RACE: Reinforced Cooperative Autonomous Vehicle Collision AvoidancE

With the rapid development of autonomous driving, collision avoidance ha...

An Agent-based Model for Driving Policy Learning in Connected and Autonomous Vehicles

Due to the complexity of the natural world, a programmer cannot foresee ...

Sequential Spatial Network for Collision Avoidance in Autonomous Driving

Several autonomous driving strategies have been applied to autonomous ve...

Learning the References of Online Model Predictive Control for Urban Self-Driving

In this work, we propose a novel learning-based online model predictive ...

Please sign up or login with your details

Forgot password? Click here to reset