On the Importance of Signer Overlap for Sign Language Detection

03/19/2023
by   Abhilash Pal, et al.
0

Sign language detection, identifying if someone is signing or not, is becoming crucially important for its applications in remote conferencing software and for selecting useful sign data for training sign language recognition or translation tasks. We argue that the current benchmark data sets for sign language detection estimate overly positive results that do not generalize well due to signer overlap between train and test partitions. We quantify this with a detailed analysis of the effect of signer overlap on current sign detection benchmark data sets. Comparing accuracy with and without overlap on the DGS corpus and Signing in the Wild, we observed a relative decrease in accuracy of 4.17 new data set partitions that are free of overlap and allow for more realistic performance assessment. We hope this work will contribute to improving the accuracy and generalization of sign language detection systems.

READ FULL TEXT
research
11/05/2021

BBC-Oxford British Sign Language Dataset

In this work, we introduce the BBC-Oxford British Sign Language (BOBSL) ...
research
08/23/2023

Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods

Sign language, which conveys meaning through gestures, is the chief mean...
research
09/06/2021

Comparing the Machine Readability of Traffic Sign Pictograms in Austria and Germany

We compare the machine readability of pictograms found on Austrian and G...
research
07/28/2021

Sign and Search: Sign Search Functionality for Sign Language Lexica

Sign language lexica are a useful resource for researchers and people le...
research
04/03/2021

Fingerspelling Detection in American Sign Language

Fingerspelling, in which words are signed letter by letter, is an import...
research
05/03/2021

Misuse of the sign test in narrative synthesis of evidence

In narrative synthesis of evidence, it can be the case that the only qua...
research
08/28/2019

Fingerspelling recognition in the wild with iterative visual attention

Sign language recognition is a challenging gesture sequence recognition ...

Please sign up or login with your details

Forgot password? Click here to reset