Title :
Spatio-temporal motion tracking with unsynchronized cameras
Author :
Elhayek, A. ; Stoll, C. ; Hasler, N. ; Kim, K.I. ; Seidel, H. -P ; Theobalt, C.
Abstract :
We present a new spatio-temporal method for markerless motion capture. We reconstruct the pose and motion of a character from a multi-view video sequence without requiring the cameras to be synchronized and without aligning captured frames in time. By formulating the model-to-image similarity measure as a temporally continuous functional, we are also able to reconstruct motion in much higher temporal detail than was possible with previous synchronized approaches. By purposefully running cameras unsynchronized we can capture even very fast motion at speeds that off-the-shelf but high quality cameras provide.
Keywords :
cameras; image motion analysis; image reconstruction; image sequences; object tracking; pose estimation; video signal processing; character motion reconstruction; character pose reconstruction; markerless motion capture; model-to-image similarity measure; multiview video sequence; spatio-temporal motion tracking; unsynchronized cameras; Cameras; Image color analysis; Joints; Motion segmentation; Streaming media; Synchronization; Tracking;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on
Conference_Location :
Providence, RI
Print_ISBN :
978-1-4673-1226-4
Electronic_ISBN :
1063-6919
DOI :
10.1109/CVPR.2012.6247886