See, Attend and Brake: An Attention-based Saliency Map Prediction Model for End-to-End Driving

by   Ekrem Aksoy, et al.

Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making braking decisions This approach constructs a holistic model to the driving task and can be extended for other driving decisions like steering and acceleration. The proposed model is a deep neural network model that feeds extracted features from input image to a recurrent neural network with an attention mechanism. Then predicted saliency map is used to make braking decision. We trained and evaluated using driving attention dataset BDD-A, and saliency dataset CAT2000.


page 12

page 14


Attention-based Neural Network for Driving Environment Complexity Perception

Environment perception is crucial for autonomous vehicle (AV) safety. Mo...

An HVS-Oriented Saliency Map Prediction Modeling

Visual attention is one of the most significant characteristics for sele...

SalyPath360: Saliency and Scanpath Prediction Framework for Omnidirectional Images

This paper introduces a new framework to predict visual attention of omn...

Learning Accurate and Human-Like Driving using Semantic Maps and Attention

This paper investigates how end-to-end driving models can be improved to...

Novelty Detection via Network Saliency in Visual-based Deep Learning

Machine-learning driven safety-critical autonomous systems, such as self...

Enhancing Deep Neural Network Saliency Visualizations with Gradual Extrapolation

We propose an enhancement technique of the Class Activation Mapping meth...

Personalized Saliency and its Prediction

Almost all existing visual saliency models focus on predicting a univers...

Please sign up or login with your details

Forgot password? Click here to reset