On the Harmony of Audiovisual Materials in Cross-Media Retrieval System Based on Impression

The effect of the harmony of the audio clip and the video one of an audiovisual clip on the estimation of its score has experimentally been clarified for the cross-media retrieval. Two estimation formulas have been proposed. One is of the estimation of the scores of the impression of audiovisual clips, and the other is of the estimation of the score of the total harmony based on the scores of static harmony and dynamic one. This paper confirms the first formula through another experiment. It is shown that the formula estimates the scores well. This paper also proposes the formula estimating the scores of the static harmony of audiovisual ones by using the scores of the impressive harmony and the semantic harmony.