A match moving technique for merging CG and human video sequences

Merging virtual objects with human video sequences is an important technique for many applications such as special effects in movies and augmented reality. In the traditional method, the operator manually fits a 3D body model onto the human video sequence, and generates virtual objects at the current 3D body pose. However, the manual fitting is a time consuming task, and automatic registration is required. We propose a new method for merging virtual objects onto the human video sequence. First, we track the current 3D pose of the human figure by using spatio-temporal analysis and structural knowledge of the human body. Then we generate a CG object and merge it with the human figure in video. We demonstrate examples of merging virtual cloth with the video captured images