Title :
A Generic Framework for Efficient 2-D and 3-D Facial Expression Analogy
Author :
Song, Mingli ; Dong, Zhao ; Theobalt, Christian ; Wang, Huiqiong ; Liu, Zicheng ; Seidel, Hans-Peter
Author_Institution :
Zhejiang Univ., Hangzhou
Abstract :
Facial expression analogy provides computer animation professionals with a tool to map expressions of an arbitrary source face onto an arbitrary target face. In the recent past, several algorithms have been presented in the literature that aim at putting the expression analogy paradigm into practice. Some of these methods exclusively handle expression mapping between 3-D face models, while others enable the transfer of expressions between images of faces only. None of them, however, represents a more general framework that can be applied to either of these two face representations. In this paper, we describe a novel generic method for analogy-based facial animation that employs the same efficient framework to transfer facial expressions between arbitrary 3-D face models, as well as between images of performer´s faces. We propose a novel geometry encoding for triangle meshes, vertex-tent-coordinates, that enables us to formulate expression transfer in the 2-D and the 3-D case as a solution to a simple system of linear equations. Our experiments show that our method outperforms many previous analogy-based animation approaches in terms of achieved animation quality, computation time and generality.
Keywords :
computational geometry; computer animation; face recognition; image representation; mesh generation; solid modelling; 2D facial expression analogy; 3D face models; 3D facial expression analogy; computer animation; face representations; facial animation; geometry encoding; linear equations; triangle meshes; vertex-tent-coordinates; Expression analogy; facial animation; facial image synthesis;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2007.906591