An advantage actor-critic algorithm for robotic motion planning in dense and dynamic scenarios

by   Chengmin Zhou, et al.

Intelligent robots provide a new insight into efficiency improvement in industrial and service scenarios to replace human labor. However, these scenarios include dense and dynamic obstacles that make motion planning of robots challenging. Traditional algorithms like A* can plan collision-free trajectories in static environment, but their performance degrades and computational cost increases steeply in dense and dynamic scenarios. Optimal-value reinforcement learning algorithms (RL) can address these problems but suffer slow speed and instability in network convergence. Network of policy gradient RL converge fast in Atari games where action is discrete and finite, but few works have been done to address problems where continuous actions and large action space are required. In this paper, we modify existing advantage actor-critic algorithm and suit it to complex motion planning, therefore optimal speeds and directions of robot are generated. Experimental results demonstrate that our algorithm converges faster and stable than optimal-value RL. It achieves higher success rate in motion planning with lesser processing time for robot to reach its goal.


page 1

page 2

page 3

page 4


A review of motion planning algorithms for intelligent robotics

We investigate and analyze principles of typical motion planning algorit...

Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planning

Motion planning is the soul of robot decision making. Classical planning...

Multi-agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learning

This paper introduces a hybrid algorithm of deep reinforcement learning ...

Integrating Task-Motion Planning with Reinforcement Learning for Robust Decision Making in Mobile Robots

Task-motion planning (TMP) addresses the problem of efficiently generati...

Sample-efficient Reinforcement Learning in Robotic Table Tennis

Reinforcement learning (RL) has recently shown impressive success in var...

Co-Designing Robots by Differentiating Motion Solvers

We present a novel algorithm for the computational co-design of legged r...

Motion Planning for Autonomous Vehicles in the Presence of Uncertainty Using Reinforcement Learning

Motion planning under uncertainty is one of the main challenges in devel...

Please sign up or login with your details

Forgot password? Click here to reset