View Synthesis from Reference Images with Different Resolutions

An image-based rendering (IBR) approach to synthesizing new views for virtual viewpoint from two reference images is proposed in this paper. The one reference image with a low-resolution was taken at far-viewpoint and the other with a high-resolution at near-viewpoint for the same or similar scene. The processes of synthesizing new views at arbitrary virtual viewpoint between far-and near-viewpoint comprises determining the region in the low-resolution image that have corresponding points in the high-resolution image based on scale-space representation of the high-resolution image and the comparison between them and low-resolution image using contour phase correlation algorithms, recovering the corresponding relations of epipolar geometry and matching all the source epipolar lines in the common region, and synthesizing the new view through interpolating two source epipolar lines into new epipolar line in the new view and treating the region without corresponding points. Some synthesis examples show that image quality is good and the synthesis approach is feasible