Every word counts: A multilingual analysis of individual human alignment with model attention

by   Stephanie Brandl, et al.
Københavns Uni

Human fixation patterns have been shown to correlate strongly with Transformer-based attention. Those correlation analyses are usually carried out without taking into account individual differences between participants and are mostly done on monolingual datasets making it difficult to generalise findings. In this paper, we analyse eye-tracking data from speakers of 13 different languages reading both in their native language (L1) and in English as language learners (L2). We find considerable differences between languages but also that individual reading behaviour such as skipping rate, total reading time and vocabulary knowledge (LexTALE) influence the alignment between humans and models to an extent that should be considered in future studies.


Predicting Native Language from Gaze

A fundamental question in language learning concerns the role of a speak...

Testing the Predictions of Surprisal Theory in 11 Languages

A fundamental result in psycholinguistics is that less predictable words...

Relating Eye-Tracking Measures With Changes In Knowledge on Search Tasks

We conducted an eye-tracking study where 30 participants performed searc...

Zero Shot Crosslingual Eye-Tracking Data Prediction using Multilingual Transformer Models

Eye tracking data during reading is a useful source of information to un...

WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset

We create WebQAmGaze, a multilingual low-cost eye-tracking-while-reading...

Characterizing the Influence of Features on Reading Difficulty Estimation for Non-native Readers

In recent years, the number of people studying English as a second langu...

Multidisciplinary Reading Patterns of Digital Documents

Reading plays a vital role in updating the researchers on recent develop...

Please sign up or login with your details

Forgot password? Click here to reset