Deaf, Hard of Hearing, and Hearing Perspectives on using Automatic Speech Recognition in Conversation

by   Abraham Glasser, et al.
Rochester Institute of Technology

Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce costs and interactive friction, supported by the rapid growth in capabilities of speech-controlled interfaces, e.g., Amazon Echo or Apple's Siri. A consequence is that people who are deaf or hard of hearing (DHH) may be unable to use these speech-controlled devices. We show that deaf speech has a high error rate compared to hearing speech, in commercial speech-controlled interfaces. Deaf speech had approximately a 78 word error rate (WER) compared to a hearing speech 18 that current speech-controlled interfaces are not usable by DHH people. Based on our findings, significant advances in speech recognition software or alternative approaches will be needed for deaf use of speech-controlled interfaces. We show that current speech-controlled interfaces are not usable by DHH people.


Feasibility of Using Automatic Speech Recognition with Voices of Deaf and Hard-of-Hearing Individuals

Many personal devices have transitioned from visual-controlled interface...

Evaluating the Performance of a Speech Recognition based System

Speech based solutions have taken center stage with growth in the servic...

Automatic Speech Recognition Services: Deaf and Hard-of-Hearing Usability

Nowadays, speech is becoming a more common, if not standard, interface t...

Mapping Perceptions of Humanness in Speech-Based Intelligent Personal Assistant Interaction

Humanness is core to speech interface design. Yet little is known about ...

Residual Excitation Skewness for Automatic Speech Polarity Detection

Detecting the correct speech polarity is a necessary step prior to sever...

Speech Is 3x Faster than Typing for English and Mandarin Text Entry on Mobile Devices

With laptops and desktops, the dominant method of text entry is the full...

Please sign up or login with your details

Forgot password? Click here to reset