A Deep Learning Approach to Tongue Detection for Pediatric Population

by   Javad Rahimipour Anaraki, et al.

Children with severe disabilities and complex communication needs face limitations in the usage of access technology (AT) devices. Conventional ATs (e.g., mechanical switches) can be insufficient for nonverbal children and those with limited voluntary motion control. Automatic techniques for the detection of tongue gestures represent a promising pathway. Previous studies have shown the robustness of tongue detection algorithms on adult participants, but further research is needed to use these methods with children. In this study, a network architecture for tongue-out gesture recognition was implemented and evaluated on videos recorded in a naturalistic setting when children were playing a video-game. A cascade object detector algorithm was used to detect the participants' faces, and an automated classification scheme for tongue gesture detection was developed using a convolutional neural network (CNN). In evaluation experiments conducted, the network was trained using adults and children's images. The network classification accuracy was evaluated using leave-one-subject-out cross-validation. Preliminary classification results obtained from the analysis of videos of five typically developing children showed an accuracy of up to 99 Moreover, we demonstrated that using only children data for training the classifier yielded better performance than adult's one supporting the need for pediatric tongue gesture datasets.


Hand gesture detection in tests performed by older adults

Our team are developing a new online test that analyses hand movement fe...

Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networks

Real-time recognition of dynamic hand gestures from video streams is a c...

Handwashing Action Detection System for an Autonomous Social Robot

Young children are at an increased risk of contracting contagious diseas...

Training an Emotion Detection Classifier using Frames from a Mobile Therapeutic Game for Children with Developmental Disorders

Automated emotion classification could aid those who struggle to recogni...

Jcave: A 3D Interactive Game to Assist Home Physiotherapy Rehabilitation

The purpose of this paper is to investigate the applicability of applyin...

Machine-learning-based investigation on classifying binary and multiclass behavior outcomes of children with PIMD/SMID

Recently, the importance of weather parameters and location information ...

Please sign up or login with your details

Forgot password? Click here to reset