Audio to visual signal mappings with HMM

Author

Liu, Wentao ; Yin, Baocai ; Jia, Xibin ; Kong, Dehui

Author_Institution

Multimedia & Intelligent Software Technol., Beijing Univ. of Technol., China

Volume

5

fYear

2004

fDate

17-21 May 2004

Abstract

There has been a large amount of research on speech driven face animation. Particularly, recently research efforts have been demonstrated that the hidden Markov model techniques could achieve a high level of success in the field of audio/visual mapping without language information. In this paper, firstly a linear model based facial representation method was applied, which extracts face features as a global feature. Secondly, a HMM based method was presented, which includes a two-level frame to promote the audio-visual mapping result.

Keywords

audio signal processing; computer animation; feature extraction; hidden Markov models; image representation; audio to visual signal mapping; facial feature extraction; global feature; hidden Markov model techniques; linear model based facial representation; speech driven face animation; two-level frame HMM; Delay effects; Facial animation; Feature extraction; Hidden Markov models; Signal generators; Signal mapping; Speech; State estimation; Vector quantization; Video sharing;

fLanguage

English

Publisher

ieee

Conference_Titel

Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on

ISSN

1520-6149

Print_ISBN

0-7803-8484-9

Type

conf

DOI

10.1109/ICASSP.2004.1327253

Filename

1327253