Title :
Automatic voice assignment tool for Instant Casting movie System
Author :
Adachi, Yoshihiro ; Kawamoto, Shinichi ; Yotsukura, Tatsuo ; Morishima, Shigeo ; Nakamura, Satoshi
Author_Institution :
Sci. & Eng., Waseda Univ., Shinjuku
Abstract :
In instant casting movie system, a personal CG character is automatically generated. The character resembles a participant in a face geometry and texture. However, the voice of a character was an alternative voice determined by the gender of the participant. Therefore sometimes it´s not enough to identify the personality of a CG character. In this paper, an automatic pre-scored voice assignment tool for a personal CG character is presented. Voice is essential to identify a personal character as well as a face feature. Our proposed system selects the most similar voice to the participants from voice database, and assigns it as a voice of CG character. Voice similarity criterion is presented by combination of eight acoustic features. After assigning voice data to a personal character, the voice track is played back in synchronization with the movement of the CG character. 60 voice variations have been prepared to our voice database. Validity of the assigned voice has been evaluated by MOS value. The proposed method has achieved 68% of the theoretical figure that is calculated by preliminary experiments.
Keywords :
cinematography; face recognition; speaker recognition; automatic voice assignment tool; face geometry; face texture; instant casting movie system; personal CG character; speaker recognition; speech analysis; voice database; voice similarity criterion; Casting; Character generation; Equations; Facial animation; Loudspeakers; Motion pictures; Optimization methods; Spatial databases; Speaker recognition; Speech; Computer applications; Speaker recognition; Speech analysis;
Conference_Titel :
Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on
Conference_Location :
Taipei
Print_ISBN :
978-1-4244-2353-8
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2009.4959979