Title :
Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild
Author :
Tzimiropoulos, Georgios ; Pantic, Maja
Author_Institution :
Sch. of Comput. Sci., Univ. of Lincoln, Lincoln, UK
Abstract :
Arguably, Deformable Part Models (DPMs) are one of the most prominent approaches for face alignment with impressive results being recently reported for both controlled lab and unconstrained settings. Fitting in most DPM methods is typically formulated as a two-step process during which discriminatively trained part templates are first correlated with the image to yield a filter response for each landmark and then shape optimization is performed over these filter responses. This process, although computationally efficient, is based on fixed part templates which are assumed to be independent, and has been shown to result in imperfect filter responses and detection ambiguities. To address this limitation, in this paper, we propose to jointly optimize a part-based, trained in-the-wild, flexible appearance model along with a global shape model which results in a joint translational motion model for the model parts via Gauss-Newton (GN) optimization. We show how significant computational reductions can be achieved by building a full model during training but then efficiently optimizing the proposed cost function on a sparse grid using weighted least-squares during fitting. We coin the proposed formulation Gauss-Newton Deformable Part Model (GN-DPM). Finally, we compare its performance against the state-of-the-art and show that the proposed GN-DPM outperforms it, in some cases, by a large margin. Code for our method is available from http://ibug.doc.ic.ac.uk/resources.
Keywords :
computer vision; face recognition; filtering theory; image motion analysis; GN optimization; GN-DPM; Gauss-Newton deformable part models; ambiguity detection; cost function; face alignment; filter response; fixed part templates; flexible appearance model; global shape model; image correlation; joint translational motion model; shape optimization; Computational modeling; Deformable models; Face; Optimization; Robustness; Shape; Training; Deformable Part Models; Face Alignment; Gauss-Newton; In-the-wild;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on
Conference_Location :
Columbus, OH
DOI :
10.1109/CVPR.2014.239