Reading Task Classification Using EEG and Eye-Tracking Data

12/12/2021
by   Nora Hollenstein, et al.
0

The Zurich Cognitive Language Processing Corpus (ZuCo) provides eye-tracking and EEG signals from two reading paradigms, normal reading and task-specific reading. We analyze whether machine learning methods are able to classify these two tasks using eye-tracking and EEG features. We implement models with aggregated sentence-level features as well as fine-grained word-level features. We test the models in within-subject and cross-subject evaluation scenarios. All models are tested on the ZuCo 1.0 and ZuCo 2.0 data subsets, which are characterized by differing recording procedures and thus allow for different levels of generalizability. Finally, we provide a series of control experiments to analyze the results in more detail.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2021

Dynamic Graph Modeling of Simultaneous EEG and Eye-tracking Data for Reading Task Identification

We present a new approach, that we call AdaGTCN, for identifying human r...
research
04/15/2021

TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction

Eye movement data during reading is a useful source of information for u...
research
12/02/2019

ZuCo 2.0: A Dataset of Physiological Recordings During Natural Reading and Annotation

We recorded and preprocessed ZuCo 2.0, a new dataset of simultaneous eye...
research
07/31/2022

Vector-Based Data Improves Left-Right Eye-Tracking Classifier Performance After a Covariate Distributional Shift

The main challenges of using electroencephalogram (EEG) signals to make ...
research
11/06/2021

EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction

We present a new dataset and benchmark with the goal of advancing resear...
research
06/02/2018

A new approach for a safe car assistance system

Drowsiness, which is the state when drivers do not have scheduled breaks...
research
04/06/2022

EMMT: A simultaneous eye-tracking, 4-electrode EEG and audio corpus for multi-modal reading and translation scenarios

We present the Eyetracked Multi-Modal Translation (EMMT) corpus, a datas...

Please sign up or login with your details

Forgot password? Click here to reset