Neuromorphic Event-based Facial Expression Recognition

by   Lorenzo Berlincioni, et al.
Università di Siena

Recently, event cameras have shown large applicability in several computer vision fields especially concerning tasks that require high temporal resolution. In this work, we investigate the usage of such kind of data for emotion recognition by presenting NEFER, a dataset for Neuromorphic Event-based Facial Expression Recognition. NEFER is composed of paired RGB and event videos representing human faces labeled with the respective emotions and also annotated with face bounding boxes and facial landmarks. We detail the data acquisition process as well as providing a baseline method for RGB and event data. The collected data captures subtle micro-expressions, which are hard to spot with RGB data, yet emerge in the event domain. We report a double recognition accuracy for the event-based approach, proving the effectiveness of a neuromorphic approach for analyzing fast and hardly detectable expressions and the emotions they conceal.


page 1

page 4

page 5

page 6

page 7


The Indian Spontaneous Expression Database for Emotion Recognition

Automatic recognition of spontaneous facial expressions is a major chall...

Dynamic Model of Facial Expression Recognition based on Eigen-face Approach

Emotions are best way of communicating information; and sometimes it car...

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model

Automated facial expression analysis has a variety of applications in hu...

Continuous Emotion Recognition via Deep Convolutional Autoencoder and Support Vector Regressor

Automatic facial expression recognition is an important research area in...

MAFER: a Multi-resolution Approach to Facial Expression Recognition

Emotions play a central role in the social life of every human being, an...

Magnifying Subtle Facial Motions for Effective 4D Expression Recognition

In this paper, an effective pipeline to automatic 4D Facial Expression R...

Neuromorphic Sensing for Yawn Detection in Driver Drowsiness

Driver monitoring systems (DMS) are a key component of vehicular safety ...

Please sign up or login with your details

Forgot password? Click here to reset