Title :
Backward view synthesis prediction using virtual depth map for multiview video plus depth map coding
Author :
Shimizu, Shogo ; Sugimoto, Satoshi ; Kimata, H. ; Kojima, Akira
Author_Institution :
NTT Media Intell. Labs., NTT Corp., Japan
Abstract :
View synthesis prediction has been studied as an efficient inter-view prediction scheme. Existing view synthesis prediction schemes fall into two types according to the pixel warping direction. While backward warping based view synthesis prediction enables block-based processing, forward warping based view synthesis prediction can handle occlusions properly. This paper proposes a two-step warping based view synthesis prediction; a virtual depth map is first generated by forward warping, and then prediction signals are generated by block-based backward warping using the virtual depth map. The technique of backward-warping-aware depth inpainting is also proposed. Experiments show that the proposed VSP scheme can achieve the decoder runtime reductions of about 37% on average with slight bitrate reductions relative to the conventional forward warping based VSP. Compared to the conventional backward warping based VSP, the proposed method reduces the bitrate for the synthesized views by up to 2.9% and about 2.2% on average.
Keywords :
decoding; error statistics; image reconstruction; prediction theory; video coding; 3D video coding; backward warping based VSP; backward warping based view synthesis prediction; backward-warping-aware depth inpainting; bitrate reductions; block-based backward warping; block-based processing; decoder runtime reductions; depth map coding; forward warping based VSP; forward warping based view synthesis prediction; inter-view prediction scheme; multiview video; occlusions; pixel warping direction; prediction signals; two-step warping based view synthesis prediction; virtual depth map; Bit rate; Decoding; Encoding; PSNR; Runtime; Three-dimensional displays; Vectors; 3D video coding; Multiview video plus depth map; View synthesis prediction;
Conference_Titel :
Visual Communications and Image Processing (VCIP), 2013
Conference_Location :
Kuching
Print_ISBN :
978-1-4799-0288-0
DOI :
10.1109/VCIP.2013.6706435