Realtime Collision Avoidance for Mobile Robots in Dense Crowds using Implicit Multi-sensor Fusion and Deep Reinforcement Learning

by   Jing Liang, et al.

We present a novel learning-based collision avoidance algorithm, CrowdSteer, for mobile robots operating in dense and crowded environments. Our approach is end-to-end and uses multiple perception sensors such as a 2-D lidar along with a depth camera to sense surrounding dynamic agents and compute collision-free velocities. Our training approach is based on the sim-to-real paradigm and uses high fidelity 3-D simulations of pedestrians and the environment to train a policy using Proximal Policy Optimization (PPO). We show that our learned navigation model is directly transferable to previously unseen virtual and dense real-world environments. We have integrated our algorithm with differential drive robots and evaluated its performance in narrow scenarios such as dense crowds, narrow corridors, T-junctions, L-junctions, etc. In practice, our approach can perform real-time collision avoidance and generate smooth trajectories in such complex scenarios. We also compare the performance with prior methods based on metrics such as trajectory length, mean time to goal, success rate, and smoothness and observe considerable improvement.


Safe Real-World Reinforcement Learning for Mobile Agent Obstacle Avoidance

Collision avoidance is key for mobile robots and agents to operate safel...

DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviors

We present DenseCAvoid, a novel navigation algorithm for navigating a ro...

OF-VO: Reliable Navigation among Pedestrians Using Commodity Sensors

We present a novel algorithm for safe navigation of a mobile robot among...

DeepMNavigate: Deep Reinforced Multi-Robot Navigation Unifying Local Global Collision Avoidance

We present a novel algorithm (DeepMNavigate) for global multi-agent navi...

NH-TTC: A gradient-based framework for generalized anticipatory collision avoidance

We propose NH-TTC, a general method for fast, anticipatory collision avo...

Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learning

Collision avoidance algorithms are essential for safe and efficient robo...

Please sign up or login with your details

Forgot password? Click here to reset