Analysis of the interaction between image and music focused on physical features

Auditory information plays an integral role in AV media because even identical images are perceived differently when they are matched with different music. We now present a few studies in which the changes in subjective impressions of when visual information is matched with auditory information were analyzed on the basis of the physical features. The purpose of this study is to investigate the effects of music on image impressions in terms of physical features of images or music. In this paper, we first elucidate the changes in subjective impressions when the image is presented without music and when it is presented with music using the semantic differential method and factor analysis. Secondly, to clarify the relationship between the impression and physical features, we compare their respective physical features, which include color information, structural information, tempo, tonality, and frequency characteristics with subjective impressions. As a result, the factor analysis extracted two factors: "comfort" and "potency & activity". In the relationship between factors and physical features, red-green characteristic of image was strongly correlated with "comfort". Green element, saturation, and red-green characteristic were correlated with "potency & activity". Moreover, tempo as music feature was related to "potency & activity".