Title :
Real-time lip-synch face animation driven by human voice
Author :
Huang, Fu Jie ; Chen, Tsuhan
Author_Institution :
Dept. of Electr. & Comput. Eng., Carnegie Mellon Univ., Pittsburgh, PA, USA
Abstract :
In this demo, we present a technique for synthesizing the mouth movement from acoustic speech information. The algorithm maps the audio parameter set to the visual parameter set using the Gaussian mixture model and the hidden Markov model. With this technique, we can create smooth and realistic lip movements
Keywords :
Gaussian processes; computer animation; hidden Markov models; real-time systems; speech processing; synchronisation; Gaussian mixture model; acoustic speech information; audio parameter set; hidden Markov model; human voice; mouth movement; real-time lip-synch face animation; smooth realistic lip movements; visual parameter set; Covariance matrix; Face; Facial animation; Hidden Markov models; Human voice; Mouth; Probability distribution; Speech analysis; Speech recognition; Speech synthesis;
Conference_Titel :
Multimedia Signal Processing, 1998 IEEE Second Workshop on
Conference_Location :
Redondo Beach, CA
Print_ISBN :
0-7803-4919-9
DOI :
10.1109/MMSP.1998.738959
