Adaptive Grasp Control through Multi-Modal Interactions for Assistive Prosthetic Devices

by   Michelle Esponda, et al.

The hand is one of the most complex and important parts of the human body. The dexterity provided by its multiple degrees of freedom enables us to perform many of the tasks of daily living which involve grasping and manipulating objects of interest. Contemporary prosthetic devices for people with transradial amputations or wrist disarticulation vary in complexity, from passive prosthetics to complex devices that are body or electrically driven. One of the important challenges in developing smart prosthetic hands is to create devices which are able to mimic all activities that a person might perform and address the needs of a wide variety of users. The approach explored here is to develop algorithms that permit a device to adapt its behavior to the preferences of the operator through interactions with the wearer. This device uses multiple sensing modalities including muscle activity from a myoelectric armband, visual information from an on-board camera, tactile input through a touchscreen interface, and speech input from an embedded microphone. Presented within this paper are the design, software and controls of a platform used to evaluate this architecture as well as results from experiments deigned to quantify the performance.


page 1

page 3

page 4

page 5

page 7


EMG Pattern Classification to Control a Hand Orthosis for Functional Grasp Assistance after Stroke

Wearable orthoses can function both as assistive devices, which allow th...

Human Robot Interface for Assistive Grasping

This work describes a new human-in-the-loop (HitL) assistive grasping sy...

Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses

State-of-the-art motorized hand prostheses are endowed with actuators ab...

Assistive Robot Teleoperation Using Behavior Trees

Robotic assistance in robot arm teleoperation tasks has recently gained ...

Dynamic Modeling of Hand-Object Interactions via Tactile Sensing

Tactile sensing is critical for humans to perform everyday tasks. While ...

Multi-modal data fusion of Voice and EMG data for Robotic Control

Wearable electronic equipment is constantly evolving and is increasing t...

SensiX: A Platform for Collaborative Machine Learning on the Edge

The emergence of multiple sensory devices on or near a human body is unc...

Please sign up or login with your details

Forgot password? Click here to reset