Title :
Effect of visual representation in recognizing emotion expressed in a musical performance
Author :
Hiraga, Rumi ; Kato, Nobuko ; Matsuda, Noriyuki
Author_Institution :
Fac. of Ind. Technol., Tsukuba Univ. of Technol., Tsukuba
Abstract :
We have conducted a series of experiment to investigate the potential of music communication based on emotion for hearing-impaired people and people with hearing abilities. The purpose of the experiments is to design a performance assistance system to enable hearing-impaired people to enjoy taking part in a music ensemble. In this paper, we describe an experiment on recognizing emotion in two media: moving images of a professional percussionist giving an improvised performance and the sounds extracted from the performance. The experiment was designed to investigate whether the image of a performance is important in recognizing emotion in the performance. The result showed that there was no significant difference in recognition of emotion between the two media. Our results were consistent with those of previous experiments: (1) there was no significant difference in recognizing emotion between hearing-impaired people and people with hearing abilities, and (2) ldquofearrdquo was the least recognized of the four emotions.
Keywords :
emotion recognition; handicapped aids; image motion analysis; music; emotion recognition; hearing abilities; hearing-impaired people; music communication; music ensemble; musical performance; performance assistance system; professional percussionist moving images; visual representation; Auditory system; Communication industry; Consumer electronics; Deafness; Emotion recognition; Image recognition; Instruments; Music; Performance loss; Systems engineering and theory; Emotion; Hearing impairment; Music performance; Recgonition;
Conference_Titel :
Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on
Conference_Location :
Singapore
Print_ISBN :
978-1-4244-2383-5
Electronic_ISBN :
1062-922X
DOI :
10.1109/ICSMC.2008.4811263