DocumentCode :
2630239
Title :
Hybrid feature and decision level fusion of face and speech information for bimodal emotion recognition
Author :
Mansoorizadeh, Muharram ; Charkari, Nasrollah Moghaddam
Author_Institution :
Distrib. Process. Lab., Tarbiat Modares Univ., Tehran, Iran
fYear :
2009
fDate :
20-21 Oct. 2009
Firstpage :
652
Lastpage :
657
Abstract :
A hybrid feature and decision level information fusion architecture is proposed for human emotion recognition from facial expression and speech prosody. An active buffer stores the most recent information extracted from face and speech. This buffer allows fusion of asynchronous information through keeping track of individual modality updates. The contents of the buffer will be fused at feature level; if their respective update times are close to each other. Based on the classifiers´ reliability, a decision level fusion block combines results of the unimodal speech and face based systems and the feature level fusion based classifier. Experimental results on a database of 12 people show that the proposed fusion architecture performs better than unimodal classification, pure feature level fusion and decision level fusion.
Keywords :
emotion recognition; human computer interaction; image fusion; active buffer; bimodal emotion recognition; classifier reliability; decision level information fusion architecture; face based systems; face fusion; feature level fusion; human computer interaction; human emotion recognition; information extraction; speech information; unimodal speech based systems; Buffer storage; Computer architecture; Data mining; Distributed processing; Emotion recognition; Face; Human computer interaction; Robustness; Spatial databases; Speech processing; Audiovisual Emotion Recognition; Emotion Recognition; Human Computer Interaction; Multimodal Emotion Recognition;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Conference, 2009. CSICC 2009. 14th International CSI
Conference_Location :
Tehran
Print_ISBN :
978-1-4244-4261-4
Electronic_ISBN :
978-1-4244-4262-1
Type :
conf
DOI :
10.1109/CSICC.2009.5349653
Filename :
5349653
Link To Document :
بازگشت