Title :
Audio to visual signal mappings with HMM
Author :
Liu, Wentao ; Yin, Baocai ; Jia, Xibin ; Kong, Dehui
Author_Institution :
Multimedia & Intelligent Software Technol., Beijing Univ. of Technol., China
Abstract :
There has been a large amount of research on speech driven face animation. Particularly, recently research efforts have been demonstrated that the hidden Markov model techniques could achieve a high level of success in the field of audio/visual mapping without language information. In this paper, firstly a linear model based facial representation method was applied, which extracts face features as a global feature. Secondly, a HMM based method was presented, which includes a two-level frame to promote the audio-visual mapping result.
Keywords :
audio signal processing; computer animation; feature extraction; hidden Markov models; image representation; audio to visual signal mapping; facial feature extraction; global feature; hidden Markov model techniques; linear model based facial representation; speech driven face animation; two-level frame HMM; Delay effects; Facial animation; Feature extraction; Hidden Markov models; Signal generators; Signal mapping; Speech; State estimation; Vector quantization; Video sharing;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on
Print_ISBN :
0-7803-8484-9
DOI :
10.1109/ICASSP.2004.1327253