Title :
Enhancing silhouette-based human motion capture with 3D motion fields
Author :
Theobalt, Christian ; Carranza, J.
Author_Institution :
Max-Planck-Inst. fur Informatik, Max-Planck-Gesellschaft, Saarbrucken, Germany
Abstract :
High-quality nonintrusive human motion capture is necessary for acquisition of model-based free-viewpoint video of human actors. Silhouette-based approaches have demonstrated that they are able to accurately recover a large range of human motion from multiview video. However, they fail to make use of all available information, specifically that of texture information. This paper presents an algorithm that uses motion fields constructed from optical flow in multiview video sequences. The use of motion fields augments the silhouette-based method by incorporating texture-information into the tracking process. The algorithm is a key-component in a larger free-viewpoint video system of human actors. Our results demonstrate that our method accurately estimates pose parameters and allows for realistic texture generation in 3D video sequences.
Keywords :
image sequences; image texture; motion estimation; realistic images; rendering (computer graphics); 3D motion field; 3D video sequence; human actor; model-based free-viewpoint video; multiview video sequence; nonintrusive human motion capture; optical flow; pose parameter; realistic texture generation; silhouette-based human motion capture; texture information; tracking process; Computer graphics; Computer vision; Humans; Image generation; Image motion analysis; Motion estimation; Parameter estimation; Rendering (computer graphics); Tracking; Video sequences;
Conference_Titel :
Computer Graphics and Applications, 2003. Proceedings. 11th Pacific Conference on
Print_ISBN :
0-7695-2028-6
DOI :
10.1109/PCCGA.2003.1238260