End-To-End Prediction of Emotion From Heartbeat Data Collected by a Consumer Fitness Tracker

07/16/2019
by   Ross Harper, et al.
4

Automatic detection of emotion has the potential to revolutionize mental health and wellbeing. Recent work has been successful in predicting affect from unimodal electrocardiogram (ECG) data. However, to be immediately relevant for real-world applications, physiology-based emotion detection must make use of ubiquitous photoplethysmogram (PPG) data collected by affordable consumer fitness trackers. Additionally, applications of emotion detection in healthcare settings will require some measure of uncertainty over model predictions. We present here a Bayesian deep learning model for end-to-end classification of emotional valence, using only the unimodal heartbeat time series collected by a consumer fitness tracker (Garmin Vívosmart 3). We collected a new dataset for this task, and report a peak F1 score of 0.7. This demonstrates a practical relevance of physiology-based emotion detection `in the wild' today.

READ FULL TEXT

page 2

page 4

page 6

research
02/08/2019

A Bayesian Deep Learning Framework for End-To-End Prediction of Emotion from Heartbeat

Automatic prediction of emotion promises to revolutionise human-computer...
research
04/29/2018

Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond

Automatic understanding of human affect using visual signals is of great...
research
04/20/2021

WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning for Emotion Classification and Empathy Prediction

This paper describes our contribution to the WASSA 2021 shared task on E...
research
02/08/2022

Predicting and Visualizing Daily Mood of People Using Tracking Data of Consumer Devices and Services

Users can easily export personal data from devices (e.g., weather statio...
research
06/08/2023

Utterance Emotion Dynamics in Children's Poems: Emotional Changes Across Age

Emerging psychopathology studies are showing that patterns of changes in...
research
07/22/2019

Emotion Detection in Text: Focusing on Latent Representation

In recent years, emotion detection in text has become more popular due t...
research
11/21/2018

PersEmoN: A Deep Network for Joint Analysis of Apparent Personality, Emotion and Their Relationship

Personality and emotion are both central to affective computing. Existin...

Please sign up or login with your details

Forgot password? Click here to reset