3D video generation with multiple perspective camera views

Conventional video limits the viewers to a fixed predetermined viewpoint. With the advancement of image generation and analysis techniques, it becomes possible to overcome this limitation. We present a framework for the generation of 3D video, based on the uses of multiple cameras from different perspectives. Exploiting a priori knowledge of the scene geometry and dynamic objects, we can reconstruct 3D shapes of objects and generate virtual views of spatio-temporal events. An overview of the framework is first presented. Then we report our ongoing research to overcome issues in segmentation and playback