Emotion recognition and its application to computer agents with spontaneous interactive capabilities

Author

Nakatsu, Ryohei ; Solomides, Alexandre ; Tosa, Naoko

Author_Institution

ATR Media Integration & Commun. Res. Labs., Kyoto, Japan

Volume

2

fYear

1999

fDate

36342

Firstpage

804

Abstract

Nonverbal information such as emotion plays an essential role in human communication. We first study the recognition of emotions involved in human speech. We propose an emotion recognition algorithm based on a neural network. An emotion recognition rate of approximately 50% was obtained in a speaker-independent mode for eight emotion states. We tried to apply this emotion recognition algorithm to a computer agent that plays a character role in the interactive movie system we are developing. We propose to use emotion recognition as key technology for an architecture of the computer characters with both narrative-based and spontaneous interaction capabilities

Keywords

interactive systems; neural nets; speech recognition; computer agents; computer characters; emotion recognition; emotion recognition algorithm; human communication; human speech; interactive movie system; neural network; nonverbal information; speaker-independent mode; spontaneous interactive capabilities; Application software; Computer applications; Databases; Emotion recognition; Feature extraction; Humans; Motion pictures; Neural networks; Speech processing; Speech recognition;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia Computing and Systems, 1999. IEEE International Conference on

Conference_Location

Florence

Print_ISBN

0-7695-0253-9

Type

conf

DOI

10.1109/MMCS.1999.778589

Filename

778589