• DocumentCode
    1437927
  • Title

    Automatic Recognition of Non-Acted Affective Postures

  • Author

    Kleinsmith, Andrea ; Bianchi-Berthouze, Nadia ; Steed, Anthony

  • Author_Institution
    Dept. of Comput., Goldsmiths, Univ. of London, London, UK
  • Volume
    41
  • Issue
    4
  • fYear
    2011
  • Firstpage
    1027
  • Lastpage
    1038
  • Abstract
    The conveyance and recognition of affect and emotion partially determine how people interact with others and how they carry out and perform in their day-to-day activities. Hence, it is becoming necessary to endow technology with the ability to recognize users´ affective states to increase the technologies´ effectiveness. This paper makes three contributions to this research area. First, we demonstrate recognition models that automatically recognize affective states and affective dimensions from non-acted body postures instead of acted postures. The scenario selected for the training and testing of the automatic recognition models is a body-movement-based video game. Second, when attributing affective labels and dimension levels to the postures represented as faceless avatars, the level of agreement for observers was above chance level. Finally, with the use of the labels and affective dimension levels assigned by the observers as ground truth and the observers´ level of agreement as base rate, automatic recognition models grounded on low-level posture descriptions were built and tested for their ability to generalize to new observers and postures using random repeated subsampling validation. The automatic recognition models achieve recognition percentages comparable to the human base rates as hypothesized.
  • Keywords
    computer games; emotion recognition; pose estimation; automatic nonacted affective postures recognition; body movement based video game; ground truth; observers; random repeated subsampling validation; Computational modeling; Emotion recognition; Games; Humans; Joints; Labeling; Observers; Affective posture; automatic emotion recognition; human emotion recognition; non-acted posture;
  • fLanguage
    English
  • Journal_Title
    Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1083-4419
  • Type

    jour

  • DOI
    10.1109/TSMCB.2010.2103557
  • Filename
    5704207