Analysis of Sign Language Gestures Using Size Functions and Principal Component Analysis

Author

Kelly, Daniel ; McDonald, John ; Lysaght, Tom ; Markham, Charles

Author_Institution

Dept. of Comput. Sci., N.U.I. Maynooth, Maynooth

fYear

2008

fDate

3-5 Sept. 2008

Firstpage

31

Lastpage

36

Abstract

This paper presents a computer vision based virtual learning environment for teaching communicative hand gestures used in Sign Language. A virtual learning environment was developed to demonstrate signs to the user. The system then gives real time feedback to the user on their performance of the demonstrated sign. Gesture features are extracted from a standard web-cam video stream and shape and trajectory matching techniques are applied to these features to determine the feedback given to the user.

Keywords

computer aided instruction; computer vision; feature extraction; gesture recognition; handicapped aids; image matching; principal component analysis; communicative hand gesture; computer vision; feature extraction; principal component analysis; sign language gesture; size function; trajectory matching technique; virtual learning; Deafness; Education; Feature extraction; Feedback; Handicapped aids; Principal component analysis; Probability distribution; Real time systems; Shape; Streaming media; Principal Component Analysis; Sign Language; Size Functions;

fLanguage

English

Publisher

ieee

Conference_Titel

Machine Vision and Image Processing Conference, 2008. IMVIP '08. International

Conference_Location

Portrush

Print_ISBN

978-0-7695-3332-2

Type

conf

DOI

10.1109/IMVIP.2008.17

Filename

4624381