Title :
Error Analysis for Image-Based Rendering With Depth Information
Author :
Nguyen, Ha Thai ; Do, Minh N.
Author_Institution :
Media Process. Lab., Sony Electron., San Jose, CA
fDate :
4/1/2009 12:00:00 AM
Abstract :
We propose a new approach to quantitatively analyze the rendering quality of image-based rendering (IBR) algorithms with depth information. The resulting error bounds for synthesized views depend on IBR configurations including the depth and intensity estimate errors, the scene geometry and texture, the number of actual cameras, their positions and resolution. Specifically, the IBR error is bounded by the summation of three terms, highlighting the impact of using multiple actual cameras, the impact of the noise level at the actual cameras, and the impact of the depth accuracy. We also quantify the impact of occlusions and intensity discontinuities. The proposed methodology is applicable to a large class of common IBR algorithms and can be applied locally. Experiments with synthetic and real scenes show that the developed error bounds accurately characterize the rendering errors. In particular, the error bounds correctly characterize the decay rates of synthesized views´ mean absolute errors as O(lambda-1) and O(lambda-2), where lambda is the local density of actual samples, for 2D and 3D scenes, respectively. Finally, we discuss the implications of the proposed analysis on camera placement, budget allocation, and bit allocation.
Keywords :
error analysis; image texture; rendering (computer graphics); depth information; error analysis; image-based rendering; intensity discontinuity; occlusion; scene geometry; scene texture; Algorithm design and analysis; Cameras; Error analysis; Error correction; Geometry; Image analysis; Information analysis; Layout; Noise level; Rendering (computer graphics); Error bound; image-based rendering (IBR); jitter; nonuniform interpolation; plenoptic function;
Journal_Title :
Image Processing, IEEE Transactions on
DOI :
10.1109/TIP.2009.2012884