Title :
Surface Estimation and Tracking using Sequential MCMC Methods for Video Based Rendering
Author :
Bowen, Adam ; Mullins, Andrew ; Wilson, Roland ; Rajpoot, Nasir
Author_Institution :
Univ. of Warwick, Coventry
fDate :
Sept. 16 2007-Oct. 19 2007
Abstract :
Video based rendering algorithms attempt to render videos of a scene from an arbitrary viewpoint, given a set of input video sequences taken from several fixed viewpoints. These algorithms require either a dense camera array or some knowledge of scene structure. By applying sequential Markov Chain Monte Carlo (MCMC) methods, we show it is possible to estimate the surfaces visible within a scene, and track them over time, in an efficient manner. Initially, a particle filter is applied across image scale to estimate the surfaces present in a scene at a fixed point in time. Following this, surfaces are tracked over time using a particle filter which takes advantage of both frame-to-frame dependancies, and a hierarchical surface model derived from a multiresolution Gaussian mixture model analysis of the surface data. This time-varying surface model, and the images, are the input for a rendering algorithm which uses a fuzzy z-buffer and projective texturing to generate reconstructions.
Keywords :
Gaussian processes; Markov processes; Monte Carlo methods; fuzzy systems; image reconstruction; image resolution; image sequences; image texture; rendering (computer graphics); tracking filters; video signal processing; Markov chain Monte Carlo method; camera array; fuzzy z-buffer; image reconstruction; image texture; multiresolution Gaussian mixture model analysis; particle filter; sequential MCMC method; surface estimation; time-varying surface model; tracking; video based rendering algorithm; video sequence; Cameras; Image reconstruction; Layout; Monte Carlo methods; Particle filters; Particle tracking; Rendering (computer graphics); Surface reconstruction; Surface texture; Video sequences; Gaussian mixture models; Monte Carlo methods; Rendering; Tracking filters;
Conference_Titel :
Image Processing, 2007. ICIP 2007. IEEE International Conference on
Conference_Location :
San Antonio, TX
Print_ISBN :
978-1-4244-1437-6
Electronic_ISBN :
1522-4880
DOI :
10.1109/ICIP.2007.4379217