DocumentCode :
2232548
Title :
Appearance based lip tracking and cloning on speaking faces
Author :
Abboud, Bouchra ; Chollet, Gérard
Author_Institution :
ENST-TSI, Paris, France
fYear :
2005
fDate :
15-17 Sept. 2005
Firstpage :
301
Lastpage :
305
Abstract :
This paper addresses the issue of lip tracking and cloning using appearance models. In this perspective, a statistical color-based lip detector is first used to classify the pixels of an image into lip and non-lip pixels. This rough estimation of the lip position is then used to initialize an appearance model. This models convergence allows to refine the positions of the MPEG-4 compatible feature points placed around the lip contours. The optimal position of the feature points is then used as a first estimate to compute the position at the next frame of an image sequence to perform speaking lip tracking. To animate an unknown face image in such a way that it reproduces the lip motion of the driving sequence a piecewise affine transform is applied forcing the target lips feature points to match the automatically detected feature points of each frame of the training sequence to perform lip motion cloning. Preliminary results show that the synthetic talking faces obtained are photorealistic and reproduce accurately the movements of the tracked mouth.
Keywords :
affine transforms; face recognition; image classification; image colour analysis; image resolution; image sequences; appearance based lip tracking; color-based lip detector; image sequence; lip cloning; lip pixels; nonlip pixels; piecewise affine transform; speaking faces; Cloning; Convergence; Detectors; Face detection; Facial animation; Image sequences; Lips; MPEG 4 Standard; Pixel; Target tracking;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Image and Signal Processing and Analysis, 2005. ISPA 2005. Proceedings of the 4th International Symposium on
ISSN :
1845-5921
Print_ISBN :
953-184-089-X
Type :
conf
DOI :
10.1109/ISPA.2005.195427
Filename :
1521306
Link To Document :
بازگشت