DocumentCode :
778687
Title :
Toward an affect-sensitive multimodal human-computer interaction
Author :
Pantic, Maja ; Rothkrantz, Leon J M
Author_Institution :
Mediamatics Dept., Delft Univ. of Technol., Netherlands
Volume :
91
Issue :
9
fYear :
2003
Firstpage :
1370
Lastpage :
1390
Abstract :
The ability to recognize affective states of a person we are communicating with is the core of emotional intelligence. Emotional intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for successful interpersonal social interaction. This paper argues that next-generation human-computer interaction (HCI) designs need to include the essence of emotional intelligence - the ability to recognize a user´s affective states-in order to become more human-like, more effective, and more efficient. Affective arousal modulates all nonverbal communicative cues (facial expressions, body movements, and vocal and physiological reactions). In a face-to-face interaction, humans detect and interpret those interactive signals of their communicator with little or no effort. Yet design and development of an automated system that accomplishes these tasks is rather difficult. This paper surveys the past work in solving these problems by a computer and provides a set of recommendations for developing the first part of an intelligent multimodal HCI-an automatic personalized analyzer of a user´s nonverbal affective feedback.
Keywords :
emotion recognition; user interfaces; affect-sensitive multimodal human-computer interaction; automatic personalized analyzer; emotional intelligence; face-to-face interaction; human intelligence; intelligent multimodal HCI; interactive signals; nonverbal communicative cues; Animation; Anthropometry; Cognitive science; Emotion recognition; Face detection; Feedback; Human computer interaction; Knowledge based systems; Neuroscience; Psychology;
fLanguage :
English
Journal_Title :
Proceedings of the IEEE
Publisher :
ieee
ISSN :
0018-9219
Type :
jour
DOI :
10.1109/JPROC.2003.817122
Filename :
1230215
Link To Document :
بازگشت