• DocumentCode
    3187503
  • Title

    Come and have an emotional workout with sensitive artificial listeners!

  • Author

    Schröder, Marc ; Pammi, Sathish ; Gunes, Hatice ; Pantic, Maja ; Valstar, Michel F. ; Cowie, Roddy ; McKeown, Gary ; Heylen, Dirk ; Maat, Mark Ter ; Eyben, Florian ; Schuller, Björn ; Wöllmer, Martin ; Bevacqua, Elisabetta ; Pelachaud, Catherine ; De Sevi

  • Author_Institution
    DFKI GmbH, Saarbrücken, Germany
  • fYear
    2011
  • fDate
    21-25 March 2011
  • Firstpage
    646
  • Lastpage
    646
  • Abstract
    This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user´s emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.
  • Keywords
    audio-visual systems; emotion recognition; virtual reality; SAL character; SEMAINE system; audiovisual analysis; autonomous sensitive artificial listeners system; dialog management; emotional workout; incremental analysis; user behavior; verbal expression; virtual agent; virtual dialog partner; Adaptive systems; Buildings; Europe; Face; Humans; Operating systems; Real time systems;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on
  • Conference_Location
    Santa Barbara, CA
  • Print_ISBN
    978-1-4244-9140-7
  • Type

    conf

  • DOI
    10.1109/FG.2011.5771472
  • Filename
    5771472