Sign Language Recognition System using TensorFlow Object Detection API

by   Sharvani Srivastava, et al.

Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case of deaf and dumb people, the means of communication are different. Deaf is the inability to hear and dumb is the inability to speak. They communicate using sign language among themselves and with normal people but normal people do not take seriously the importance of sign language. Not everyone possesses the knowledge and understanding of sign language which makes communication difficult between a normal person and a deaf and dumb person. To overcome this barrier, one can build a model based on machine learning. A model can be trained to recognize different gestures of sign language and translate them into English. This will help a lot of people in communicating and conversing with deaf and dumb people. The existing Indian Sing Language Recognition systems are designed using machine learning algorithms with single and double-handed gestures but they are not real-time. In this paper, we propose a method to create an Indian Sign Language dataset using a webcam and then using transfer learning, train a TensorFlow model to create a real-time Sign Language Recognition system. The system achieves a good level of accuracy even with a limited size dataset.


page 5

page 6

page 9

page 10


Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

People with vocal and hearing disabilities use sign language to express ...

Multilingual Communication System with Deaf Individuals Utilizing Natural and Visual Languages

According to the World Federation of the Deaf, more than two hundred sig...

PerSign: Personalized Bangladeshi Sign Letters Synthesis

Bangladeshi Sign Language (BdSL) - like other sign languages - is tough ...

Sign-to-Speech Model for Sign Language Understanding: A Case Study of Nigerian Sign Language

Through this paper, we seek to reduce the communication barrier between ...

Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform

The target of this research is to experiment, iterate and recommend a sy...

Efficient sign language recognition system and dataset creation method based on deep learning and image processing

New deep-learning architectures are created every year, achieving state-...

BdSL36: A Dataset for Bangladeshi Sign Letters Recognition

Bangladeshi Sign Language (BdSL) is a commonly used medium of communicat...

Please sign up or login with your details

Forgot password? Click here to reset