EmotionNAS: Two-stream Architecture Search for Speech Emotion Recognition

03/25/2022
by   Haiyang Sun, et al.
3

Speech emotion recognition (SER) is a crucial research topic in human-computer interactions. Existing works are mainly based on manually designed models. Despite their great success, these methods heavily rely on historical experience, which are time-consuming but cannot exhaust all possible structures. To address this problem, we propose a neural architecture search (NAS) based framework for SER, called "EmotionNAS". We take spectrogram and wav2vec features as the inputs, followed with NAS to optimize the network structure for these features separately. We further incorporate complementary information in these features through decision-level fusion. Experimental results on IEMOCAP demonstrate that our method succeeds over existing state-of-the-art strategies on SER.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2022

Neural Architecture Search for Speech Emotion Recognition

Deep neural networks have brought significant advancements to speech emo...
research
05/23/2023

Improving Speech Emotion Recognition Performance using Differentiable Architecture Search

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware ...
research
06/12/2023

MFAS: Emotion Recognition through Multiple Perspectives Fusion Architecture Search Emulating Human Cognition

Speech emotion recognition aims to identify and analyze emotional states...
research
08/25/2020

A Survey on Evolutionary Neural Architecture Search

Deep Neural Networks (DNNs) have achieved great success in many applicat...
research
01/24/2022

Neural Architecture Searching for Facial Attributes-based Depression Recognition

Recent studies show that depression can be partially reflected from huma...
research
02/12/2023

Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia

Alzheimer's dementia (AD) affects memory, thinking, and language, deteri...
research
02/20/2023

Medical Face Masks and Emotion Recognition from the Body: Insights from a Deep Learning Perspective

The COVID-19 pandemic has undoubtedly changed the standards and affected...

Please sign up or login with your details

Forgot password? Click here to reset