Machine Learning for Motor Learning: EEG-based Continuous Assessment of Cognitive Engagement for Adaptive Rehabilitation Robots

by   Neelesh Kumar, et al.
Rutgers University

Although cognitive engagement (CE) is crucial for motor learning, it remains underutilized in rehabilitation robots, partly because its assessment currently relies on subjective and gross measurements taken intermittently. Here, we propose an end-to-end computational framework that assesses CE in real-time, using electroencephalography (EEG) signals as objective measurements. The framework consists of i) a deep convolutional neural network (CNN) that extracts task-discriminative spatiotemporal EEG to predict the level of CE for two classes – cognitively engaged vs. disengaged; and ii) a novel sliding window method that predicts continuous levels of CE in real-time. We evaluated our framework on 8 subjects using an in-house Go/No-Go experiment that adapted its gameplay parameters to induce cognitive fatigue. The proposed CNN had an average leave-one-out accuracy of 88.13%. The CE prediction correlated well with a commonly used behavioral metric based on self-reports taken every 5 minutes (ρ=0.93). Our results objectify CE in real-time and pave the way for using CE as a rehabilitation parameter for tailoring robotic therapy to each patient's needs and skills.


page 1

page 2

page 4

page 5


Deep Learning of Movement Intent and Reaction Time for EEG-informed Adaptation of Rehabilitation Robots

Mounting evidence suggests that adaptation is a crucial mechanism for re...

EEG-Inception: An Accurate and Robust End-to-End Neural Network for EEG-based Motor Imagery Classification

Classification of EEG-based motor imagery (MI) is a crucial non-invasive...

EEG-NeXt: A Modernized ConvNet for The Classification of Cognitive Activity from EEG

One of the main challenges in electroencephalogram (EEG) based brain-com...

BRAIN2DEPTH: Lightweight CNN Model for Classification of Cognitive States from EEG Recordings

Several Convolutional Deep Learning models have been proposed to classif...

Deep Models for Engagement Assessment With Scarce Label Information

Task engagement is defined as loadings on energetic arousal (affect), ta...

Multimodal Brain-Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines

Through this paper, we introduce a novel driver cognitive load assessmen...

Please sign up or login with your details

Forgot password? Click here to reset