Saliency for free: Saliency prediction as a side-effect of object recognition

07/20/2021
by   Carola Figueroa Flores, et al.
0

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via eyetracking experiments. In the current paper, we demonstrate that saliency maps can be generated as a side-effect of training an object recognition deep neural network that is endowed with a saliency branch. Such a network does not require any ground-truth saliency maps for training.Extensive experiments carried out on both real and synthetic saliency datasets demonstrate that our approach is able to generate accurate saliency maps, achieving competitive results on both synthetic and real datasets when compared to methods that do require ground truth data.

READ FULL TEXT

page 4

page 6

research
07/24/2020

Hallucinating Saliency Maps for Fine-Grained Image Classification for Limited Data Domains

Most of the saliency methods are evaluated on their ability to generate ...
research
07/03/2020

Synergistic saliency and depth prediction for RGB-D saliency detection

Depth information available from an RGB-D camera can be useful in segmen...
research
11/04/2014

Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNet

Recent results suggest that state-of-the-art saliency models perform far...
research
12/09/2021

Evaluating saliency methods on artificial data with different background types

Over the last years, many 'explainable artificial intelligence' (xAI) ap...
research
09/19/2017

SalNet360: Saliency Maps for omni-directional images with CNN

The prediction of Visual Attention data from any kind of media is of val...
research
10/27/2021

Revisiting Sanity Checks for Saliency Maps

Saliency methods are a popular approach for model debugging and explaina...
research
05/23/2018

Learning Illuminant Estimation from Object Recognition

In this paper we present a deep learning method to estimate the illumina...

Please sign up or login with your details

Forgot password? Click here to reset