Cost effective portable system for sign language gesture recognition

Author

Khambaty, Yousuf ; Quintana, Rolando ; Shadaram, Mehdi ; Nehal, Sana ; Virk, Muneeb Ali ; Ahmed, Waqar ; Ahmedani, Ghayas

Author_Institution

Dept. of Electr. & Comput. Eng., Univ. of Texas, San Antonio, TX

fYear

2008

fDate

2-4 June 2008

Firstpage

1

Lastpage

6

Abstract

This paper presents a standalone system that converts static gestures into voice. It is also known as GesTALK. The primary input device is the self design and cost effective Data Glove. It operates in two basic modes. In first mode the system speaks a single alphabet for a static gestures made by the user, while in second mode the system speaks complete string by concatenating words. Various gestures of alphabets are made to spell out the words involved in string. This system has been shown to work for both American Sign Language (ASL) and Pakistan Sign Language (PSL) and other language models. Results show that the system recognizes 24 out of 26 letters; an overall accuracy of 90% is achieved.

Keywords

data gloves; gesture recognition; handicapped aids; natural languages; speech processing; American Sign Language; GesTALK; Pakistan Sign Language; data glove; sign language gesture recognition; standalone system; static gestures; Auditory system; Costs; Data gloves; Dictionaries; Fingers; Handicapped aids; Pattern recognition; Shape; Toy manufacturing industry; Virtual reality; American Sign Language; Data Glove; GesTALK; Gesture Recognition; Hearing Impaired; Pakistan Sign Language (PSL); Pattern Recognition; Portable Device; Voice Synthesizer;

fLanguage

English

Publisher

ieee

Conference_Titel

System of Systems Engineering, 2008. SoSE '08. IEEE International Conference on

Conference_Location

Singapore

Print_ISBN

978-1-4244-2172-5

Electronic_ISBN

978-1-4244-2173-2

Type

conf

DOI

10.1109/SYSOSE.2008.4724149

Filename

4724149