Title :
Correlation between stimulated emotion extracted from EEG and its manifestation on facial expression
Author :
Chakraborty, A. ; Bhowmik, P. ; Das, S. ; Halder, A. ; Konar, A. ; Nagar, A.K.
Author_Institution :
Dept. of Comput. Sci. & Eng., St. Thomas´´ Coll. of Eng. & Technol., Kolkata, India
Abstract :
Determining correlation between aroused emotion and its manifestation on facial expression, voice, gesture and posture have interesting applications in psychotherapy. A set of audiovisual stimulus, selected by a group of experts, is used to excite emotion of the subjects. EEG and facial expression of the subjects excited by the selected audio-visual stimulus are collected, and the nonlinear-correlation from EEG to facial expression, and vice-versa is obtained by employing feed-forward neural network trained with back-propagation algorithm. Experiments undertaken reveals that the trained network can reproduce the correlated EEG-facial expression trained instances with 100 % accuracy, and is also able to predict facial expression (EEG) from unknown EEG (facial expression) of the same subject with an accuracy of around 95.2%.
Keywords :
backpropagation; correlation methods; electroencephalography; emotion recognition; feature extraction; feedforward neural nets; medical signal processing; neurophysiology; psychology; EEG-facial expression; audiovisual stimulus; back-propagation algorithm; feed-forward neural network training; psychotherapy; stimulated emotion extraction; Biological neural networks; Computer science; Cybernetics; Electroencephalography; Feature extraction; Feedforward neural networks; Feedforward systems; Neural networks; Psychology; USA Councils; EEG; Facial expression; Feedforward neural learning; Nonlinear Correlation;
Conference_Titel :
Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on
Conference_Location :
San Antonio, TX
Print_ISBN :
978-1-4244-2793-2
DOI :
10.1109/ICSMC.2009.5346157