Deep Reinforcement Learning Controller for 3D Path-following and Collision Avoidance by Autonomous Underwater Vehicles

by   Simen Theie Havenstrøm, et al.
Oklahoma State University

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, in complex systems, such as autonomous underwater vehicles performing the dual objective of path-following and collision avoidance, decision making becomes non-trivial. We propose a solution using state-of-the-art Deep Reinforcement Learning (DRL) techniques, to develop autonomous agents capable of achieving this hybrid objective without having à priori knowledge about the goal or the environment. Our results demonstrate the viability of DRL in path-following and avoiding collisions toward achieving human-level decision making in autonomous vehicle systems within extreme obstacle configurations.


Risk-based implementation of COLREGs for autonomous surface vehicles using deep reinforcement learning

Autonomous systems are becoming ubiquitous and gaining momentum within t...

Taming an autonomous surface vehicle for path following and collision avoidance using deep reinforcement learning

In this article, we explore the feasibility of applying proximal policy ...

Collision-Free Flocking with a Dynamic Squad of Fixed-Wing UAVs Using Deep Reinforcement Learning

Developing the collision-free flocking behavior for a dynamic squad of f...

Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning

Robots that navigate among pedestrians use collision avoidance algorithm...

Robust Path Following on Rivers Using Bootstrapped Reinforcement Learning

This paper develops a Deep Reinforcement Learning (DRL)-agent for naviga...

Navigating Assistance System for Quadcopter with Deep Reinforcement Learning

In this paper, we present a deep reinforcement learning method for quadc...

Please sign up or login with your details

Forgot password? Click here to reset