Video-based handshape recognition using a handshape structure model in real time

Author

Grobel, Kirsti ; Hienz, Hermann

Author_Institution

Lehrstuhl fur Tech. Inf., Aachen Univ. of Technol., Germany

Volume

3

fYear

1996

fDate

25-29 Aug 1996

Firstpage

446

Abstract

This paper presents a visual prototype for the recognition of 32 different handshapes used in finger spelling and in German sign language. A signer performs handshapes in front of a single video camera. In order to reach real-time performance the signer wears a coloured glove. The handshapes are recognized by the system with an accuracy of 94%. A description of the overall system is given and an approach to distinguish handshapes by their structure is presented. The lack of information within a recorded image is compensated by the use of a handshape structure model. This model is based on the features of the coloured areas and on relations between these areas

Keywords

computer vision; feature extraction; image colour analysis; pattern classification; real-time systems; German sign language; colour coding; computer vision; feature extraction; finger spelling; handshape recognition; handshape structure model; real time systems; video camera; Cameras; Deafness; Fingers; Handicapped aids; Humans; Image processing; Image recognition; Natural languages; Printing; Prototypes;

fLanguage

English

Publisher

ieee

Conference_Titel

Pattern Recognition, 1996., Proceedings of the 13th International Conference on

Conference_Location

Vienna

ISSN

1051-4651

Print_ISBN

0-8186-7282-X

Type

conf

DOI

10.1109/ICPR.1996.546987

Filename

546987