DocumentCode :
3278073
Title :
Combination of manual and non-manual features for sign language recognition based on conditional random field and active appearance model
Author :
Yang, Hee-Deok ; Lee, Seong-Whan
Author_Institution :
Sch. of Comput. Eng., Chosun Univ., Gwangju, South Korea
Volume :
4
fYear :
2011
fDate :
10-13 July 2011
Firstpage :
1726
Lastpage :
1731
Abstract :
Sign language recognition is the task of detection and recognition of manual signals (MSs) and non-manual signals (NMSs) in a signed utterance. In this paper, a novel method for recognizing MS and facial expressions as a NMS is proposed. This is achieved through a framework consisting of three components: (1) Candidate segments of MSs are discriminated using an hierarchical conditional random field (CRF) and Boost-Map embedding. It can distinguish signs, fingerspellings and non-sign patterns, and is robust to the various sizes, scales and rotations of the signer´s hand. (2) Facial expressions as a NMS are recognized with support vector machine (SVM) and active appearance model (AAM), AAM is used to extract facial feature points. From these facial feature points, several measurements are computed to distinguish each facial component into defined facial expressions with SVM. (3) Finally, the recognition results of MSs and NMSs are fused in order to recognize signed sentences. Experiments demonstrate that the proposed method can successfully combine MSs and NMSs features for recognizing signed sentences from utterance data.
Keywords :
feature extraction; gesture recognition; support vector machines; AAM; NMS; SVM; active appearance model; facial expressions; feature points; hierarchical conditional random field; manual signals; nonmanual signals; sign language recognition; support vector machine; Active appearance model; Cameras; Manuals; Sign language recognition; active appearance model; conditional random held; manual sign; non-manual sign; support vector machine;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2011 International Conference on
Conference_Location :
Guilin
ISSN :
2160-133X
Print_ISBN :
978-1-4577-0305-8
Type :
conf
DOI :
10.1109/ICMLC.2011.6016973
Filename :
6016973
Link To Document :
بازگشت