A demonstration of audiovisual sensitive artificial listeners

Author

Schröder, Marc ; Bevacqua, Elisabetta ; Eyben, Florian ; Gunes, Hatice ; Heylen, Dirk ; Maat, Mark Ter ; Pammi, Sathish ; Pantic, Maja ; Pelachaud, Catherine ; Schuller, Björn ; De Sevin, Etienne ; Valstar, Michel ; Wollmer, Martin

Author_Institution

DFKI GmbH, Saarbrucken, Germany

fYear

2009

fDate

10-12 Sept. 2009

Firstpage

1

Lastpage

2

Abstract

Sensitive artificial listeners (SAL) are virtual dialogue partners who, despite their very limited verbal understanding, intend to engage the user in a conversation by paying attention to the user´s emotions and non-verbal expressions. The SAL characters have their own emotionally defined personality, and attempt to drag the user towards their dominant emotion, through a combination of verbal and non-verbal expression. The demonstrator shows an early version of the fully autonomous SAL system based on audiovisual analysis and synthesis.

Keywords

audio signal processing; audio-visual systems; interactive systems; audiovisual analysis; audiovisual sensitive artificial listeners; audiovisual synthesis; nonverbal expressions; user emotions; verbal understanding; virtual dialogue partners; Cameras; Communication standards; Educational institutions; Face; Humans; Loudspeakers; Middleware; Speech analysis; Telecommunications; Testing;

fLanguage

English

Publisher

ieee

Conference_Titel

Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on

Conference_Location

Amsterdam

Print_ISBN

978-1-4244-4800-5

Electronic_ISBN

978-1-4244-4799-2

Type

conf

DOI

10.1109/ACII.2009.5349530

Filename

5349530