Title :
Towards Automatic Stereoscopic Video Synthesis from a Casual Monocular Video
Author :
Lin Zhong ; Sen Wang ; Minwoo Park ; Miller, Ross ; Metaxas, Dimitris
Author_Institution :
Comput. Sci. Dept., Rutgers Univ., Piscataway, NJ, USA
Abstract :
Automatically synthesizing 3D content from a causal monocular video has become an important problem. Previous works either use no geometry information, or rely on precise 3D geometry information. Therefore, they cannot obtain reasonable results if the 3D structure in the scene is complex, or noisy 3D geometry information is estimated from monocular videos. In this paper, we present an automatic and robust framework to synthesize stereoscopic videos from casual 2D monocular videos. First, 3D geometry information (e.g., camera parameters, depth map) are extracted from the 2D input video. Then a Bayesian-based View Synthesis (BVS) approach is proposed to render high-quality new virtual views for stereoscopic video to deal with noisy 3D geometry information. Extensive experiments on various videos demonstrate that BVS can synthesize more accurate views than other methods, and our proposed framework also be able to generate high-quality 3D videos.
Keywords :
Bayes methods; geometry; stereo image processing; visual perception; 2D input video extraction; 2D monocular video; 3D geometry information; 3D video quality; BVS approach; Bayesian-based view synthesis approach; automatic 3D content synthesis; automatic stereoscopic video synthesis; camera parameter; casual monocular video; Bayesian methods; Cameras; Geometry; Image color analysis; Noise measurement; Stereo image processing; USA Councils; Bayesian-based View Synthesis; Stereoscopic video synthesis; automatic;
Conference_Titel :
Multimedia (ISM), 2012 IEEE International Symposium on
Conference_Location :
Irvine, CA
Print_ISBN :
978-1-4673-4370-1
DOI :
10.1109/ISM.2012.64