Title :
User-centric Affective Video Tagging from MEG and Peripheral Physiological Responses
Author :
Abadi, Mojtaba Khomami ; Kia, Seyed Mostafa ; Subramanian, Ramanathan ; Avesani, Paolo ; Sebe, Nicu
Author_Institution :
Univ. of Trento, Trento, Italy
Abstract :
This paper presents a new multimodal database and the associated results for characterization of affect (valence, arousal and dominance) using the Magneto encephalogram (MEG) brain signals and peripheral physiological signals (horizontal EOG, ECG, trapezius EMG). We attempt single-trial classification of affect in movie and music video clips employing emotional responses extracted from eighteen participants. The main findings of this study are that: (i) the MEG signal effectively encodes affective viewer responses, (ii) clip arousal is better predicted by MEG, while peripheral physiological signals are more effective for predicting valence and (iii) prediction performance is better for movie clips as compared to music video clips.
Keywords :
electro-oculography; electrocardiography; electromyography; human factors; magnetoencephalography; music; neurophysiology; psychology; signal classification; ECG; MEG response; affect characterization; clip arousal; emotional response; horizontal EOG; magnetoencephalogram brain signal; movie video clips; multimodal database; music video clips; peripheral physiological response; peripheral physiological signal; single-trial affect classification; trapezius EMG; user-centric affective video tagging; Electromyography; Electrooculography; Feature extraction; Heart rate; Motion pictures; Physiology; Time-frequency analysis; MEG; affective video tagging; movie vs. music clips; user-centric;
Conference_Titel :
Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on
Conference_Location :
Geneva
DOI :
10.1109/ACII.2013.102