Title :
Near-videorealistic synthetic visual speech using non-rigid appearance models
Author :
Theobald, Barry J. ; Cawley, Gavin C. ; Matthews, Iain A. ; Bangham, J. Andrew
Author_Institution :
Sch. of Inf. Syst., East Anglia Univ., Norwich, UK
Abstract :
We present work towards videorealistic synthetic visual speech using non-rigid appearance models. These models are used to track a talking face enunciating a set of training sentences. The resultant parameter trajectories are used in a concatenative synthesis scheme, where samples of original data are extracted from a corpus and concatenated to form new unseen sequences. Here we explore the effect on the synthesiser output of blending several synthesis units considered similar to the desired unit. We present preliminary subjective and objective results used to judge the realism of the system.
Keywords :
computer animation; image sequences; solid modelling; speech processing; video signal processing; computer graphics; computer vision; concatenative synthesis scheme; near-videorealistic synthetic visual speech; nonrigid appearance models; parameter trajectories; speech processing; talking face; training sentences; video sequences; visual speech synthesiser; Application software; Bandwidth; Covariance matrix; Face detection; Facial animation; Hidden Markov models; Principal component analysis; Shape; Speech synthesis; Training data;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). 2003 IEEE International Conference on
Print_ISBN :
0-7803-7663-3
DOI :
10.1109/ICASSP.2003.1200092