The Invariant Ground Truth of Affect

10/14/2022
by   Konstantinos Makantasis, et al.
0

Affective computing strives to unveil the unknown relationship between affect elicitation, manifestation of affect and affect annotations. The ground truth of affect, however, is predominately attributed to the affect labels which inadvertently include biases inherent to the subjective nature of emotion and its labeling. The response to such limitations is usually augmenting the dataset with more annotations per data point; however, this is not possible when we are interested in self-reports via first-person annotation. Moreover, outlier detection methods based on inter-annotator agreement only consider the annotations themselves and ignore the context and the corresponding affect manifestation. This paper reframes the ways one may obtain a reliable ground truth of affect by transferring aspects of causation theory to affective computing. In particular, we assume that the ground truth of affect can be found in the causal relationships between elicitation, manifestation and annotation that remain invariant across tasks and participants. To test our assumption we employ causation inspired methods for detecting outliers in affective corpora and building affect models that are robust across participants and tasks. We validate our methodology within the domain of digital games, with experimental results showing that it can successfully detect outliers and boost the accuracy of affect models. To the best of our knowledge, this study presents the first attempt to integrate causation tools in affective computing, making a crucial and decisive step towards general affect modeling.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
04/06/2021

The Affect Game AnnotatIoN (AGAIN) Dataset

How can we model affect in a general fashion, across dissimilar tasks, a...
research
05/06/2020

Joint Multi-Dimensional Model for Global and Time-Series Annotations

Crowdsourcing is a popular approach to collect annotations for unlabeled...
research
07/01/2019

PAGAN: Video Affect Annotation Made Easy

How could we gather affect annotations in a rapid, unobtrusive, and acce...
research
12/31/2022

Approaching Peak Ground Truth

Machine learning models are typically evaluated by computing similarity ...
research
07/01/2013

An Empirical Study into Annotator Agreement, Ground Truth Estimation, and Algorithm Evaluation

Although agreement between annotators has been studied in the past from ...
research
10/12/2021

Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations

Majority voting and averaging are common approaches employed to resolve ...

Please sign up or login with your details

Forgot password? Click here to reset