Incorporating facial features into a multi-channel gesture recognition system for the interpretation of Irish Sign Language sequences

Author

Kelly, Daniel ; Delannoy, Jane Reilly ; Donald, John Mc ; Markham, Charles

Author_Institution

Comput. Sci. Dept., Nat. Univ. of Ireland, Maynooth, Ireland

fYear

2009

fDate

Sept. 27 2009-Oct. 4 2009

Firstpage

1977

Lastpage

1984

Abstract

In this paper we present a novel gesture recognition system for the interpretation of Irish Sign Language sequences which incorporates manual and non-manual information. We implement a set of independent Hidden Markov Model networks to recognize hand gestures, head movements and facial features into a single framework for interpreting Irish Sign Language. This framework is not specific to any particular type of gesture and we demonstrate this by showing that manual and non manual signals can be robustly spotted and classified from with continuous sign sequences.

Keywords

feature extraction; gesture recognition; hidden Markov models; image recognition; Irish sign language sequences; facial features; hidden Markov Model networks; multichannel gesture recognition system; non manual information; Active appearance model; Computer science; Conferences; Eyebrows; Eyes; Face recognition; Facial features; Handicapped aids; Hidden Markov models; Robustness;

fLanguage

English

Publisher

ieee

Conference_Titel

Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on

Conference_Location

Kyoto

Print_ISBN

978-1-4244-4442-7

Electronic_ISBN

978-1-4244-4441-0

Type

conf

DOI

10.1109/ICCVW.2009.5457524

Filename

5457524