A real-time system for automatic creation of 3D face models from a video sequence

In this paper, a real-time system for automatic creation of 3D face models from a video sequence is presented. The system consists of a novel scheme to extract face shape and a 3D model adaptation method based on a least-square approach. The proposed face shape extractor, which is accurate and computationally cheap, is based on an ellipse controlled by three anchor points. The least-square approach is selected to adapt a generic 3D model to input face, minimizing errors between feature points on a created 3D face and extracted feature points from input video. Experimental results show that the proposed system can efficiently builds 3D face models, which are compatible with MPEG-4 facial objects, from a video sequence without any user intervention.