Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle

by   Qilei Zhang, et al.

Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and deep reinforcement learning have been introduced into the AUV design and research to improve its autonomy. However, these methods are still difficult to apply directly to the actual AUV system because of the sparse rewards and low learning efficiency. In this paper, we proposed a deep interactive reinforcement learning method for path following of AUV by combining the advantages of deep reinforcement learning and interactive RL. In addition, since the human trainer cannot provide human rewards for AUV when it is running in the ocean and AUV needs to adapt to a changing environment, we further propose a deep reinforcement learning method that learns from both human rewards and environmental rewards at the same time. We test our methods in two path following tasks—straight line and sinusoids curve following of AUV by simulating in the Gazebo platform. Our experimental results show that with our proposed deep interactive RL method, AUV can converge faster than a DQN learner from only environmental reward. Moreover, AUV learning with our deep RL from both human and environmental rewards can also achieve a similar or even better performance than that with the deep interactive RL method and can adapt to the actual environment by further learning from environmental rewards.


page 2

page 3

page 4

page 5

page 6

page 8

page 9

page 10


Deep Reinforcement Learning with Interactive Feedback in a Human-Robot Environment

Robots are extending their presence in domestic environments every day, ...

A selected review on reinforcement learning based control for autonomous underwater vehicles

Recently, reinforcement learning (RL) has been extensively studied and a...

Learning swimming via deep reinforcement learning

For decades, people have been seeking for fishlike flapping motions that...

Online Antenna Tuning in Heterogeneous Cellular Networks with Deep Reinforcement Learning

We aim to jointly optimize the antenna tilt angle, and the vertical and ...

Vessel-following model for inland waterways based on deep reinforcement learning

While deep reinforcement learning (RL) has been increasingly applied in ...

Deep Reinforcement Learning for Industrial Insertion Tasks with Visual Inputs and Natural Rewards

Connector insertion and many other tasks commonly found in modern manufa...

A reinforcement learning path planning approach for range-only underwater target localization with autonomous vehicles

Underwater target localization using range-only and single-beacon (ROSB)...

Please sign up or login with your details

Forgot password? Click here to reset