An Integrated Two Way ISL (Indian Sign Language) Translation System – A New Approach

M.Suresh Anand, A.Kumaresan, Dr.N.Mohan Kumar


Sign language is a language which uses visually transmitted sign patterns to convey meaning. It is the combination of hand shapes, orientation and movement of hands, arms or body, and facial expressions. Our System is capable of recognizing sign-language symbols can be used as a means of communication with hard of hearing people and hard speaking people. Our paper proposes a system to help those people to communicate with normal people without sophisticated devices like power, data gloves and coloured finger cap and etc. Instead we are using a camera and microphone as a device to implement the Integrated Two Way ISL (Indian Sign Language) system. The Two Way ISL translation system has two parts, translation of sign language into voice and reverse. The Two Way ISL translation system uses webcam or USB camera to get images or continuous video image (from hard speaking) which can be interpreted by the application. Acquired images are assumed to be translation, scale and rotation invariant. Assuming signer is right angle to the camera. In this process the steps of translation are acquisition of images, binarised, classification, hand shape edge detection and feature extraction. After getting vectors feature extraction state then pattern matching done by comparing existing database. The interpreted symbols (meaning – words) can be translated into text information (Words in English or Tamil). Using text to voice synthesis, text will be converted as a voice output or voices file (to normal person). The GUI application is displaying and sending the message as a text message or voice message to the receiver. The reverse is, getting voice input (from normal person) converted to text then it is matching with database for sign symbol to display (to hard hearing receiver).This system makes deaf/dumb people to communicate easily with normal speaking person. Also in video calling or chatting this application helps the hard speaking and hearing people.

Keywords – Indian sign language(ISL), translation, image processing, hard hearing and hard speaking

Full Text:




  • There are currently no refbacks.

Copyright (c) 2016 International Journal of Advanced Research in Computer Science