Title :
Image-based talking heads using radial basis functions
Author :
Edge, James D. ; Maddock, Steve
Author_Institution :
Sheffield Univ., UK
Abstract :
In recent years talking heads have received a great deal of interest, both in their application to natural human-computer dialogue, and their benefit to the intelligibility of synthesized speech. A model for the realistic synthesis of visual speech animation is described. Images representing the key visual speech poses (visemes) are pre-recorded and labeled. Transitions between visemes are created by using an image morphing technique based upon the use of radial basis functions. Timing information from the festival speech synthesis system is used to plan the appropriate transitions to create realistic speech animation. A model of coarticulation is included in the system to improve the realism of articulatory motion.
Keywords :
computer animation; image morphing; radial basis function networks; speech intelligibility; speech synthesis; speech-based user interfaces; Festival speech synthesis system; articulatory motion; audio-visual speech synthesizer; coarticulation model; image morphing; image-based talking head; key visual speech poses; natural human-computer dialogue; radial basis function; realistic speech animation; realistic synthesis; synthesized speech intelligibility; timing information; visemes; visual speech animation; Deformable models; Facial animation; Focusing; Head; Interpolation; Lattices; Muscles; Scattering; Speech synthesis; Synthesizers;
Conference_Titel :
Theory and Practice of Computer Graphics, 2003. Proceedings
Print_ISBN :
0-7695-1942-3
DOI :
10.1109/TPCG.2003.1206933