Combination analysis of motion and melody in phrase animation

Impressions of phrase motion and those of a melody are expressed by adjectives and their combinations for the phrase animation generation are analyzed in this paper. Factors in a sound impression space and those in a phrase motion impression space are extracted by the factor analysis using data obtained by the pre-experiments. Melody and phrase motion database are constructed using data obtained by the pre-experiments. The melody candidate and the phrase motion candidate are chosen according to the impression value on the sound impression space and that on the motion impression space, which are obtained using the concept of co-occurrence of adjectives. Subject experiments are performed to analyze the combination of phrase motion and a melody for the phrase animation generation. The following three combinations are considered: (1) Impressions of phrase motion and those of a melody are expressed by same adjectives. (2) Impressions of phrase motion and those of a melody are expressed by opposite adjectives. (3) Impressions of phrase motion and those of melody are expressed by adjectives giving similar impressions. Experimental results show that combination (1) and combination (3) are effective.