Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

by   Shervin Minaee, et al.

Facial expression recognition has been an active research area over the past few decades, and it is still challenging due to the high intra-class variation. Traditional approaches for this problem rely on hand-crafted features such as SIFT, HOG and LBP, followed by a classifier trained on a database of images or videos. Most of these works perform reasonably well on datasets of images captured in a controlled condition, but fail to perform as good on more challenging datasets with more image variation and partial faces. In recent years, several works proposed an end-to-end framework for facial expression recognition, using deep learning models. Despite the better performance of these works, there still seems to be a great room for improvement. In this work, we propose a deep learning approach based on attentional convolutional network, which is able to focus on important parts of the face, and achieves significant improvement over previous models on multiple datasets, including FER-2013, CK+, FERG, and JAFFE. We also use a visualization technique which is able to find important face regions for detecting different emotions, based on the classifier's output. Through experimental results, we show that different emotions seems to be sensitive to different parts of the face.


page 1

page 2

page 3

page 4

page 5

page 6

page 7


Facial Expression Recognition using Deep Learning

Throughout the various ages, facial expressions have become one of the u...

Going Deeper in Facial Expression Recognition using Deep Neural Networks

Automated Facial Expression Recognition (FER) has remained a challenging...

FaceTopoNet: Facial Expression Recognition using Face Topology Learning

Prior work has shown that the order in which different components of the...

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Automated Facial Expression Recognition (FER) has been a challenging tas...

Generating near-infrared facial expression datasets with dimensional affect labels

Facial expression analysis has long been an active research area of comp...

A Peek at Peak Emotion Recognition

Despite much progress in the field of facial expression recognition, lit...

Code Repositories


Facial Expression Recognition Using Attentional Convolutional Network, Pytorch implementation

view repo



view repo


Une implémentation (pytorch) du papier "Deep-emotion" avce des essais de prédictions en temps réels (webcam))

view repo

Please sign up or login with your details

Forgot password? Click here to reset