DocumentCode :
78243
Title :
FaceWarehouse: A 3D Facial Expression Database for Visual Computing
Author :
Chen Cao ; Yanlin Weng ; Shun Zhou ; Yiying Tong ; Kun Zhou
Author_Institution :
State Key Lab. of CAD&CG, Zhejiang Univ., Hangzhou, China
Volume :
20
Issue :
3
fYear :
2014
fDate :
Mar-14
Firstpage :
413
Lastpage :
425
Abstract :
We present FaceWarehouse, a database of 3D facial expressions for visual computing applications. We use Kinect, an off-the-shelf RGBD camera, to capture 150 individuals aged 7-80 from various ethnic backgrounds. For each person, we captured the RGBD data of her different expressions, including the neutral expression and 19 other expressions such as mouth-opening, smile, kiss, etc. For every RGBD raw data record, a set of facial feature points on the color image such as eye corners, mouth contour, and the nose tip are automatically localized, and manually adjusted if better accuracy is required. We then deform a template facial mesh to fit the depth data as closely as possible while matching the feature points on the color image to their corresponding points on the mesh. Starting from these fitted face meshes, we construct a set of individual-specific expression blendshapes for each person. These meshes with consistent topology are assembled as a rank-3 tensor to build a bilinear face model with two attributes: identity and expression. Compared with previous 3D facial databases, for every person in our database, there is a much richer matching collection of expressions, enabling depiction of most human facial actions. We demonstrate the potential of FaceWarehouse for visual computing with four applications: facial image manipulation, face component transfer, real-time performance-based facial image animation, and facial animation retargeting from video to image.
Keywords :
computer animation; emotion recognition; face recognition; visual databases; 3D facial expression database; FaceWarehouse; Kinect; face component transfer; facial animation retargeting; facial feature points; facial image manipulation; facial mesh; off-the-shelf RGBD camera; real-time performance-based facial image animation; visual computing; Color; Computational modeling; Databases; Face; Mouth; Solid modeling; Three-dimensional displays; Face modeling; RGBD camera; face database; facial animation; mesh deformation;
fLanguage :
English
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
Publisher :
ieee
ISSN :
1077-2626
Type :
jour
DOI :
10.1109/TVCG.2013.249
Filename :
6654137
Link To Document :
بازگشت