GPA-Teleoperation: Gaze Enhanced Perception-aware Safe Assistive Aerial Teleoperation

by   Qianhao Wang, et al.

Gaze is an intuitive and direct way to represent the intentions of an individual. However, when it comes to assistive aerial teleoperation which aims to perform operators' intention, rare attention has been paid to gaze. Existing methods obtain intention directly from the remote controller (RC) input, which is inaccurate, unstable, and unfriendly to non-professional operators. Further, most teleoperation works do not consider environment perception which is vital to guarantee safety. In this paper, we present GPA-Teleoperation, a gaze enhanced perception-aware assistive teleoperation framework, which addresses the above issues systematically. We capture the intention utilizing gaze information, and generate a topological path matching it. Then we refine the path into a safe and feasible trajectory which simultaneously enhances the perception awareness to the environment operators are interested in. Additionally, the proposed method is integrated into a customized quadrotor system. Extensive challenging indoor and outdoor real-world experiments and benchmark comparisons verify that the proposed system is reliable, robust and applicable to even unskilled users. We will release the source code of our system to benefit related researches.


page 1

page 3

page 6

page 7

page 8


Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments

In this paper, we propose a complete and robust motion planning system f...

Intention-Aware Planner for Robust and Safe Aerial Tracking

The intention of the target can help us to estimate its future motion st...

RAPTOR: Robust and Perception-aware Trajectory Replanning for Quadrotor Fast Flight

Recent advances in trajectory replanning have enabled quadrotor to navig...

What Timing for an Automated Vehicle to Communicate Its Driving Intentions to Pedestrians for Improving Their Perception of Safety?

Although automated driving systems have been used frequently, they are s...

Towards Generation of Visual Attention Map for Source Code

Program comprehension is a dominant process in software development and ...

Efficiently Guiding Imitation Learning Algorithms with Human Gaze

Human gaze is known to be an intention-revealing signal in human demonst...

'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation

Over the past few years, there has been an increasing interest to interp...

Please sign up or login with your details

Forgot password? Click here to reset