SFF-DA: Sptialtemporal Feature Fusion for Detecting Anxiety Nonintrusively

by   Haimiao Mo, et al.

Early detection of anxiety disorders is essential to reduce the suffering of people with mental disorders and to improve treatment outcomes. Anxiety screening based on the mHealth platform is of particular practical value in improving screening efficiency and reducing screening costs. In practice, differences in mobile devices in subjects' physical and mental evaluations and the problems faced with uneven data quality and small sample sizes of data in the real world have made existing methods ineffective. Therefore, we propose a framework based on spatiotemporal feature fusion for detecting anxiety nonintrusively. To reduce the impact of uneven data quality, we constructed a feature extraction network based on "3DCNN+LSTM" and fused spatiotemporal features of facial behavior and noncontact physiology. Moreover, we designed a similarity assessment strategy to solve the problem that the small sample size of data leads to a decline in model accuracy. Our framework was validated with our crew dataset from the real world and two public datasets, UBFC-PHYS and SWELL-KW. The experimental results show that the overall performance of our framework was better than that of the state-of-the-art comparison methods.


page 5

page 18


A Multimodal Data-driven Framework for Anxiety Screening

Early screening for anxiety and appropriate interventions are essential ...

Machine vision detection to daily facial fatigue with a nonlocal 3D attention network

Fatigue detection is valued for people to keep mental health and prevent...

Infrared and Visible Image Fusion with ResNet and zero-phase component analysis

In image fusion task, feature extraction and processing are keys for fus...

Gastrointestinal Polyps and Tumors Detection Based on Multi-scale Feature-fusion with WCE Sequences

Wireless Capsule Endoscopy(WCE) has been widely used for the screening o...

Online Feature Screening for Data Streams with Concept Drift

Screening feature selection methods are often used as a preprocessing st...

Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks

Driver drowsiness increases crash risk, leading to substantial road trau...

Advances in Artificial Intelligence to Reduce Polyp Miss Rates during Colonoscopy

BACKGROUND AND CONTEXT: Artificial intelligence has the potential to aid...

Please sign up or login with your details

Forgot password? Click here to reset