A Deep-Learning-Based Neural Decoding Framework for Emotional Brain-Computer Interfaces

by   Xinming Wu, et al.

Reading emotions precisely from segments of neural activity is crucial for the development of emotional brain-computer interfaces. Among all neural decoding algorithms, deep learning (DL) holds the potential to become the most promising one, yet progress has been limited in recent years. One possible reason is that the efficacy of DL strongly relies on training samples, yet the neural data used for training are often from non-human primates and mixed with plenty of noise, which in turn mislead the training of DL models. Given it is difficult to accurately determine animals' emotions from humans' perspective, we assume the dominant noise in neural data representing different emotions is the labeling error. Here, we report the development and application of a neural decoding framework called Emo-Net that consists of a confidence learning (CL) component and a DL component. The framework is fully data-driven and is capable of decoding emotions from multiple datasets obtained from behaving monkeys. In addition to improving the decoding ability, Emo-Net significantly improves the performance of the base DL models, making emotion recognition in animal models possible. In summary, this framework may inspire novel understandings of the neural basis of emotion and drive the realization of close-loop emotional brain-computer interfaces.


page 1

page 2

page 3

page 4


Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity

Decoding emotional states from human brain activity plays an important r...

A Multi-Componential Approach to Emotion Recognition and the Effect of Personality

Emotions are an inseparable part of human nature affecting our behavior ...

Analyzing the impact of Driving tasks when detecting emotions through Brain-Computer Interfaces

Traffic accidents are the leading cause of death among young people, a p...

Automatic Emotion Recognition (AER) System based on Two-Level Ensemble of Lightweight Deep CNN Models

Emotions play a crucial role in human interaction, health care and secur...

Towards Neural Co-Processors for the Brain: Combining Decoding and Encoding in Brain-Computer Interfaces

The field of brain-computer interfaces is poised to advance from the tra...

Towards Neural Co-Processors: Combining Neural Decoding and Encoding in Brain-Computer Interfaces

The field of brain-computer interfaces is poised to advance from the tra...

Prediction of Human Empathy based on EEG Cortical Asymmetry

Humans constantly interact with digital devices that disregard their fee...

Please sign up or login with your details

Forgot password? Click here to reset