A Broad-persistent Advising Approach for Deep Interactive Reinforcement Learning in Robotic Environments

by   Hung Son Nguyen, et al.

Deep Reinforcement Learning (DeepRL) methods have been widely used in robotics to learn about the environment and acquire behaviors autonomously. Deep Interactive Reinforcement Learning (DeepIRL) includes interactive feedback from an external trainer or expert giving advice to help learners choosing actions to speed up the learning process. However, current research has been limited to interactions that offer actionable advice to only the current state of the agent. Additionally, the information is discarded by the agent after a single use that causes a duplicate process at the same state for a revisit. In this paper, we present Broad-persistent Advising (BPA), a broad-persistent advising approach that retains and reuses the processed information. It not only helps trainers to give more general advice relevant to similar states instead of only the current state but also allows the agent to speed up the learning process. We test the proposed approach in two continuous robotic scenarios, namely, a cart pole balancing task and a simulated robot navigation task. The obtained results show that the performance of the agent using BPA improves while keeping the number of interactions required for the trainer in comparison to the DeepIRL approach.


page 1

page 3

page 4

page 9

page 10


Broad-persistent Advice for Interactive Reinforcement Learning Scenarios

The use of interactive advice in reinforcement learning scenarios allows...

Deep Reinforcement Learning with Interactive Feedback in a Human-Robot Environment

Robots are extending their presence in domestic environments every day, ...

Persistent Rule-based Interactive Reinforcement Learning

Interactive reinforcement learning has allowed speeding up the learning ...

ProAPT: Projection of APT Threats with Deep Reinforcement Learning

The highest level in the Endsley situation awareness model is called pro...

Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning

In a Human-in-the-Loop paradigm, a robotic agent is able to act mostly a...

Quantifying the Effect of Feedback Frequency in Interactive Reinforcement Learning for Robotic Tasks

Reinforcement learning (RL) has become widely adopted in robot control. ...

Hints vs Distractions in Intelligent Tutoring Systems: Looking for the proper type of help

The kind of help a student receives during a task has been shown to play...

Please sign up or login with your details

Forgot password? Click here to reset