Recognition of Sign Language using Deep Neural Network

Pallavi P, Sarvamangala D R


Speech impairment affects an individual’s ability to communicate. People affected by this problem, suffer by the communication barrier with the normal people. Hence, to express their emotions and thoughts people will use sign language for their communication and. Although sign language is common in world, there may be a difficulty for people who do not have knowledge about sign language to communicate with speech impaired people who knows the sign language. Now there is a prominent growth in the field of computer vision and deep learning, which has been tremendous development in the fields of sign and motion recognition. The proposed model focusses on overcoming the challenges in verbal communication between non-sign language speakers and sign language speakers by building a deep learning model to recognize alphabets of American sign language.   The model was trained on the dataset collected from Kaggle website which consisted of 26 American Sign Language alphabets. The model achieved 99.3% mean average precision in recognition of sign and average probability value for test image achieved was 0.99. The deep learning method used to build the model achieved more accuracy than the previous solutions.




American Sign Language, Deep learning, Neural network, YOLOV3 model, Sign Language recognition.

Full Text:



American Sign Language Recognition using Deep Learning and Computer Vision, Kshitij Bantupalli, Ying Xie, 2018 IEEE International Conference on Big Data (Big Data).

Deep Convolutional Neural Networks for Sign Language Recognition, G.Anantha Rao , K.Syamala, P.V.V.Kishore, A.S.C.S.Sastry, Dept. of ECE, K L Deemed to be UNIVERSITY, 2018 IEEE International Conference.

Hand sign language recognition using multi-view hand skeleton, Razieh Rastgooa, Kourosh Kiani, Sergio Escalera, , 2020 Elsevier.

Static Sign Language Recognition Using Deep Learning, Lean Karlo S. Tolentino, Ronnie O. Serfa Juan, August C. Thio-ac, Maria Abigail B. Pamahoy, Joni Rose R. Forteza, and Xavier Jet O. Garcia, December 2019 IEEE International Journal of Machine Learning and Computing.

Deep learning-based sign language recognition system for static signs, Ankita Wadhawan, Parteek Kumar, 2020 Springer Nature.

SignFi: Sign Language Recognition Using WiFi, Yongsen Ma, Gang Zhou, Shuangquan Wang, Hongyang Zhao, Woosub Jung, March 2018, ACM Journals.

Independent Bayesian classifier combination based sign language recognition using facial expression,Pradeep Kumara, Partha Pratim Roy, Debi Prosad Dogra, 2018 Springer.

Video-Based Sign Language Recognition Without Temporal Segmentation, Huang J., Zhou W., Zhang, 2018 the AAAI Conference on Artificial Intelligence.

Iterative Alignment Network for Continuous Sign Language Recognition, Junfu Pu, Wengang Zhou, Houqiang Li, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

Sign Language Recognition Based on Intelligent Glove Using Machine Learning Techniques, Paul D. Rosero-Montalvo, Pamela Godoy-Trujillo, Edison Flores-Bosmediano, Jorge Carrascal-Garcia, 2019 IEEE conference.

Deep Sign: Enabling Robust Statistical Continuous Sign Language Recognition via Hybrid CNN-HMMs, Oscar Koller, Sepehr Zargaran, Hermann Ney & Richard Bowden, 2019 Springer International Journal of Computer Vision.

Ashwinkumar.U.M and Dr. Anandakumar K.R, "Predicting Early Detection of cardiac and Diabetes symptoms using Data mining techniques", International conference on computer Design and Engineering, vol.49, 2012.



  • There are currently no refbacks.

Copyright (c) 2021 International Journal of Advanced Research in Computer Science