Title :
3D face reconstruction from video using a generic model
Author :
Chowdhury, A. Roy ; Chellappa, R. ; Krishnamurthy, S. ; Vo, T.
Author_Institution :
Center for Autom. Res., Maryland Univ., College Park, MD, USA
Abstract :
Reconstructing a 3D model of a human face from a video sequence is an important problem in computer vision, with applications to recognition, surveillance, multimedia etc. However, the quality of 3D reconstructions using structure from motion (SfM) algorithms is often not satisfactory. One common method of overcoming this problem is to use a generic model of a face. Existing work using this approach initializes the reconstruction algorithm with this generic model. The problem with this approach is that the algorithm can converge to a solution very close to this initial value, resulting in a reconstruction which resembles the generic model rather than the particular face in the video which needs to be modeled. We propose a method of 3D reconstruction of a human face from video in which the 3D reconstruction algorithm and the generic model are handled separately. A 3D estimate is obtained purely from the video sequence using SfM algorithms without use of the generic model. The final 3D model is obtained after combining the SfM estimate and the generic model using an energy function that corrects for the errors in the estimate by comparing local regions in the two models. The optimization is done using a Markov chain Monte Carlo (MCMC) sampling strategy. The main advantage of our algorithm over others is that it is able to retain the specific features of the face in the video sequence even when these features are different from those of the generic model. The evolution of the 3D model through the various stages of the algorithm is presented.
Keywords :
Markov processes; Monte Carlo methods; image motion analysis; image recognition; image sampling; image sequences; optimisation; video signal processing; 3D human face reconstruction; MCMC sampling; Markov chain Monte Carlo sampling; SfM algorithms; computer vision; generic model; image recognition; optimization function; reconstruction algorithm; structure from motion algorithms; surveillance; video sequence; Application software; Computer vision; Error correction; Face detection; Face recognition; Humans; Monte Carlo methods; Reconstruction algorithms; Surveillance; Video sequences;
Conference_Titel :
Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on
Print_ISBN :
0-7803-7304-9
DOI :
10.1109/ICME.2002.1035815