Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path

03/03/2020
by   Kei Ota, et al.
National Institute of Advanced Industrial Science and Technology
MERL
Mitsubishi Electric Corporation
1

In this paper, we consider the problem of building learning agents that can efficiently learn to navigate in constrained environments. The main goal is to design agents that can efficiently learn to understand and generalize to different environments using high-dimensional inputs (a 2D map), while following feasible paths that avoid obstacles in obstacle-cluttered environment. To achieve this, we make use of traditional path planning algorithms, supervised learning, and reinforcement learning algorithms in a synergistic way. The key idea is to decouple the navigation problem into planning and control, the former of which is achieved by supervised learning whereas the latter is done by reinforcement learning. Specifically, we train a deep convolutional network that can predict collision-free paths based on a map of the environment– this is then used by a reinforcement learning algorithm to learn to closely follow the path. This allows the trained agent to achieve good generalization while learning faster. We test our proposed method in the recently proposed Safety Gym suite that allows testing of safety-constraints during training of learning agents. We compare our proposed method with existing work and show that our method consistently improves the sample efficiency and generalization capability to novel environments.

READ FULL TEXT

page 1

page 4

page 6

11/05/2018

Combining Subgoal Graphs with Reinforcement Learning to Build a Rational Pathfinder

In this paper, we present a hierarchical path planning framework called ...
11/09/2022

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Development of navigation algorithms is essential for the successful dep...
12/06/2019

A pedestrian path-planning model in accordance with obstacle's danger with reinforcement learning

Most microscopic pedestrian navigation models use the concept of "forces...
11/02/2021

Learning to Explore by Reinforcement over High-Level Options

Autonomous 3D environment exploration is a fundamental task for various ...
08/28/2020

Meta Reinforcement Learning-Based Lane Change Strategy for Autonomous Vehicles

Recent advances in supervised learning and reinforcement learning have p...
05/23/2019

Deep Q-Learning with Q-Matrix Transfer Learning for Novel Fire Evacuation Environment

We focus on the important problem of emergency evacuation, which clearly...

Please sign up or login with your details

Forgot password? Click here to reset