A Novel Appearance Model and Adaptive Condensation Algorithm for Human Face Tracking

We present an adaptive framework for condensation algorithms in the context of human face tracking. We attack the face tracking problem by making factored sampling more efficient and the appearance update more effective. An adaptive affine cascade factored sampling strategy is introduced to sample the parameter space such that coarse face locations are located first followed by a fine factored sampling with a small number of particles. In addition, local linearity of an appearance manifold is used in conjunction with a new criterion to select a tangent plane for updating an appearance in face tracking. Our proposed method seeks the best linear variety from the selected tangent plane to form a reference image. Finally, we demonstrate the effectiveness and efficiency of the proposed method on four challenging videos. These test video sequences show that our method is robust to illumination, appearance, and pose changes, as well as temporary occlusions.