Transform-domain super-resolution for multiview images using depth information

Mixed resolution formats have been employed in video encoding complexity reduction as well as data compression of stereoscopic video. High resolution frames within such formats may also be used as a means of enhancing lower resolution images. In this paper we present a super-resolution method for use in a mixed resolution, multiview video plus depth setup. High resolution views are initially projected onto the view point of low resolution images with the aid of available depth maps. The method introduces the use of transform-domain techniques for up-sampling the low resolution images and for appending high frequency content from projected views. The DCT is used for the necessary frequency decompositions. Results show gains over previous work for several test sequences and affirm the aptitude of transform-domain approaches for super-resolution within mixed resolution formats.