Exploring to learn visual saliency: The RL-IAC approach

04/02/2018
by   Céline Craye, et al.
0

The problem of object localization and recognition on autonomous mobile robots is still an active topic. In this context, we tackle the problem of learning a model of visual saliency directly on a robot. This model, learned and improved on-the-fly during the robot's exploration provides an efficient tool for localizing relevant objects within their environment. The proposed approach includes two intertwined components. On the one hand, we describe a method for learning and incrementally updating a model of visual saliency from a depth-based object detector. This model of saliency can also be exploited to produce bounding box proposals around objects of interest. On the other hand, we investigate an autonomous exploration technique to efficiently learn such a saliency model. The proposed exploration, called Reinforcement Learning-Intelligent Adaptive Curiosity (RL-IAC) is able to drive the robot's exploration so that samples selected by the robot are likely to improve the current model of saliency. We then demonstrate that such a saliency model learned directly on a robot outperforms several state-of-the-art saliency techniques, and that RL-IAC can drastically decrease the required time for learning a reliable saliency model.

READ FULL TEXT

page 4

page 5

page 10

page 11

page 13

page 14

page 15

page 19

research
03/14/2016

Saliency Detection for Improving Object Proposals

Object proposals greatly benefit object detection task in recent state-o...
research
04/15/2023

ODSmoothGrad: Generating Saliency Maps for Object Detectors

Techniques for generating saliency maps continue to be used for explaina...
research
04/23/2020

Guided Dyna-Q for Mobile Robot Exploration and Navigation

Model-based reinforcement learning (RL) enables an agent to learn world ...
research
07/31/2023

Bi-Level Image-Guided Ergodic Exploration with Applications to Planetary Rovers

We present a method for image-guided exploration for mobile robotic syst...
research
05/12/2020

Generalized State-Dependent Exploration for Deep Reinforcement Learning in Robotics

Reinforcement learning (RL) enables robots to learn skills from interact...
research
02/15/2021

Seeing by haptic glance: reinforcement learning-based 3D object Recognition

Human is able to conduct 3D recognition by a limited number of haptic co...
research
06/19/2017

User-driven mobile robot storyboarding: Learning image interest and saliency from pairwise image comparisons

This paper describes a novel storyboarding scheme that uses a model trai...

Please sign up or login with your details

Forgot password? Click here to reset