Recognition and Localisation of Pointing Gestures using a RGB-D Camera

by   Naina Dhingra, et al.

Non-verbal communication is part of our regular conversation, and multiple gestures are used to exchange information. Among those gestures, pointing is the most important one. If such gestures cannot be perceived by other team members, e.g. by blind and visually impaired people (BVIP), they lack important information and can hardly participate in a lively workflow. Thus, this paper describes a system for detecting such pointing gestures to provide input for suitable output modalities to BVIP. Our system employs an RGB-D camera to recognize the pointing gestures performed by the users. The system also locates the target of pointing e.g. on a common workspace. We evaluated the system by conducting a user study with 26 users. The results show that the system has a success rate of 89.59 and 79.92 arm respectively, and 73.57 and 68.99 right arm respectively.


page 5

page 6


Zoomorphic Gestures for Communicating Cobot States

Communicating the robot state is vital to creating an efficient and trus...

MoRSE: Deep Learning-based Arm Gesture Recognition for Search and Rescue Operations

Efficient and quick remote communication in search and rescue operations...

Selecting a Small Set of Optimal Gestures from an Extensive Lexicon

Finding the best set of gestures to use for a given computer recognition...

Touchless Typing using Head Movement-based Gestures

Physical contact-based typing interfaces are not suitable for people wit...

XR Input Error Mediation for Hand-Based Input: Task and Context Influences a User's Preference

Many XR devices use bare-hand gestures to reduce the need for handheld c...

Towards Predicting Fine Finger Motions from Ultrasound Images via Kinematic Representation

A central challenge in building robotic prostheses is the creation of a ...

Please sign up or login with your details

Forgot password? Click here to reset