Title :
A system for teaching sign language using live gesture feedback
Author :
Kelly, Daniel ; McDonald, John ; Markham, Charles
Author_Institution :
N.U.I. Maynooth, Maynooth
Abstract :
This paper presents a computer vision based virtual learning environment for teaching communicative hand gestures used in sign language. A virtual learning environment was developed to demonstrate signs to the user. The system then gives real time feedback to the user on their performance of the demonstrated sign. Gesture features are extracted from a standard web-cam video stream and shape and trajectory matching techniques are applied to these features to determine the feedback given to the user.
Keywords :
computer aided instruction; computer vision; feedback; gesture recognition; virtual reality; communicative hand gestures; computer vision; live gesture feedback; real time feedback; shape matching techniques; sign language teaching; standard web-cam video stream; trajectory matching techniques; virtual learning environment; Deafness; Education; Feature extraction; Feedback; Handicapped aids; Performance analysis; Principal component analysis; Real time systems; Shape; Streaming media;
Conference_Titel :
Automatic Face & Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on
Conference_Location :
Amsterdam
Print_ISBN :
978-1-4244-2153-4
Electronic_ISBN :
978-1-4244-2154-1
DOI :
10.1109/AFGR.2008.4813350
