Automated Sign Language to Speech Interpreter

This paper proposes an automated sign language to speech interpreter that begins by capturing the 3D video stream through Kinect and the joints of interest in the human skeleton are then worked upon. The proposed system deals with the problems faced by mute people in conveying their message through Pakistani sign language. This research makes use of the 3D trajectory algorithm for processing the normalized data. Performed gestures are classified using the robust learning technique of ensemble. Once recognized, the gestures are translated to speech. This system has been tested on several signs taken from PSL, demonstrating the real time practicality of using ASLSI.