Title :
Audio-lingual and Visual-facial Emotion Recognition: Towards a Bi-modal Interaction System
Author :
Alepis, E. ; Stathopoulou, I.-O. ; Virvou, M. ; Tsihrintzis, G.A. ; Kabassi, K.
Author_Institution :
Dept. of Inf., Univ. of Piraeus, Piraeus, Greece
Abstract :
Towards building a multimodal affect recognition system, we have built a facial expression recognition system and a audio-lingual affect recognition system. In this paper, we present and discuss the development and evaluation process of the two subsystems, concerning the recognition of emotions from audio-lingual and visual-facial modalities. Many researchers agree that these modalities are complementary to each other and that the combination of the two can improve the accuracy in affective user models. Therefore in this paper we present a combination of two modes using multi-criteria decision making theories. The resulted system takes advantage of the strengths of each mode and is more accurate in emotion recognition.
Keywords :
audio signal processing; decision making; emotion recognition; face recognition; audio-lingual affect recognition system; audio-lingual emotion recognition; bi-modal interaction system; facial expression recognition system; multicriteria decision making theories; multimodal affect recognition system; visual-facial emotion recognition; Artificial neural networks; Databases; Emotion recognition; Face; Face recognition; Humans; Speech; affective user modeling; audio-lingual affect recognition; facial expression analysis; multi-modal interfaces; visua-lfacial affect recognition;
Conference_Titel :
Tools with Artificial Intelligence (ICTAI), 2010 22nd IEEE International Conference on
Conference_Location :
Arras
Print_ISBN :
978-1-4244-8817-9
DOI :
10.1109/ICTAI.2010.111
