3D tracking of deformable surface by propagating feature correspondences

This paper addresses the problem of 3D tracking deformable surfaces undergoing non-rigid motion from multi-view video sequences. We propose a method that starts from a set of feature points which have been matched across views and time. A data-driven motion propagation technique makes the motion dense enough to give initial guess to the parameter estimation of the vertices of the 3D model. Finally after rejecting some outliers the 3D mesh model is deformed using the estimated vertex motion. Experimental results demonstrate the proposed method is accurate and robust even at a low frame rate and for medium elastic deformations.