Real-time lip-synch face animation driven by human voice

Author

Huang, Fu Jie ; Chen, Tsuhan

Author_Institution

Dept. of Electr. & Comput. Eng., Carnegie Mellon Univ., Pittsburgh, PA, USA

fYear

1998

fDate

7-9 Dec 1998

Firstpage

352

Lastpage

357

Abstract

In this demo, we present a technique for synthesizing the mouth movement from acoustic speech information. The algorithm maps the audio parameter set to the visual parameter set using the Gaussian mixture model and the hidden Markov model. With this technique, we can create smooth and realistic lip movements

Keywords

Gaussian processes; computer animation; hidden Markov models; real-time systems; speech processing; synchronisation; Gaussian mixture model; acoustic speech information; audio parameter set; hidden Markov model; human voice; mouth movement; real-time lip-synch face animation; smooth realistic lip movements; visual parameter set; Covariance matrix; Face; Facial animation; Hidden Markov models; Human voice; Mouth; Probability distribution; Speech analysis; Speech recognition; Speech synthesis;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia Signal Processing, 1998 IEEE Second Workshop on

Conference_Location

Redondo Beach, CA

Print_ISBN

0-7803-4919-9

Type

conf

DOI

10.1109/MMSP.1998.738959

Filename

738959

Link To Document

https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=2467213