Title :
Recognizing the sentiments of web images using hand-designed features
Author :
Ko, Eunjeong ; Kim, Eun Yi
Author_Institution :
Visual Information Processing Lab., Dept. of Internet & Multimedia Engineering, Konkuk University, Seoul, South Korea
Abstract :
Recently, understanding sentiment expressed in social images and multimedia has attracted increasing attention by researchers. For sentiment analysis of social image, we should identify the visual features with high relations to human sentiments and then conduct analysis based on such visual features. Here, two visual vocabularies are built from color compositions and SIFT (scale-invariant feature transform) descriptors. Thereafter, the pLSA (probabilistic latent semantic analysis)-learning is employed to predict the human sentiment hidden in social images from visual words. The proposed system was evaluated to the images collected from Photo.net and Google and 15 Kobayashi´s sentiments were considered to label the images. The results were compared with man-labeled ground truth and then the proposed method shows the performance with an F1-measure results of above 70%.
Keywords :
Bag-of-visual-word; Color composition; Hand-designed feature; Human affects; Image sentiment analysis;
Conference_Titel :
Cognitive Informatics & Cognitive Computing (ICCI*CC), 2015 IEEE 14th International Conference on
Conference_Location :
Beijing, China
Print_ISBN :
978-1-4673-7289-3
DOI :
10.1109/ICCI-CC.2015.7259380