Motion Planning in Dynamic Environments Using Context-Aware Human Trajectory Prediction

by   Mark Nicholas Finean, et al.

Over the years, the separate fields of motion planning, mapping, and human trajectory prediction have advanced considerably. However, the literature is still sparse in providing practical frameworks that enable mobile manipulators to perform whole-body movements and account for the predicted motion of moving obstacles. Previous optimisation-based motion planning approaches that use distance fields have suffered from the high computational cost required to update the environment representation. We demonstrate that GPU-accelerated predicted composite distance fields significantly reduce the computation time compared to calculating distance fields from scratch. We integrate this technique with a complete motion planning and perception framework that accounts for the predicted motion of humans in dynamic environments, enabling reactive and pre-emptive motion planning that incorporates predicted motions. To achieve this, we propose and implement a novel human trajectory prediction method that combines intention recognition with trajectory optimisation-based motion planning. We validate our resultant framework on a real-world Toyota Human Support Robot (HSR) using live RGB-D sensor data from the onboard camera. In addition to providing analysis on a publicly available dataset, we release the Oxford Indoor Human Motion (Oxford-IHM) dataset and demonstrate state-of-the-art performance in human trajectory prediction. The Oxford-IHM dataset is a human trajectory prediction dataset in which people walk between regions of interest in an indoor environment. Both static and robot-mounted RGB-D cameras observe the people while tracked with a motion-capture system.


page 1

page 2

page 4

page 5

page 8

page 11

page 16

page 17


Simultaneous Scene Reconstruction and Whole-Body Motion Planning for Safe Operation in Dynamic Environments

Recent work has demonstrated real-time mapping and reconstruction from d...

Predicted Composite Signed-Distance Fields for Real-Time Motion Planning in Dynamic Environments

We present a novel framework for motion planning in dynamic environments...

Realtime Trajectory Smoothing with Neural Nets

In order to safely and efficiently collaborate with humans, industrial r...

Planning Robot Motion using Deep Visual Prediction

In this paper, we introduce a novel framework that can learn to make vis...

Neural Motion Prediction for In-flight Uneven Object Catching

In-flight objects capture is extremely challenging. The robot is require...

Where Should I Look? Optimised Gaze Control for Whole-Body Collision Avoidance in Dynamic Environments

As robots operate in increasingly complex and dynamic environments, fast...

Safety-aware time-optimal motion planning with uncertain human state estimation

Human awareness in robot motion planning is crucial for seamless interac...

Please sign up or login with your details

Forgot password? Click here to reset