Title :
View synthesis prediction via motion field synthesis for 3D video coding
Author :
Shimizu, Shinya ; Shiori, Sugimoto ; Kojima, Akira
Author_Institution :
NTT Media Intell. Labs., Nippon Telegraph & Telephone Corp., Japan
Abstract :
View synthesis prediction is critical for efficient compression of 3D video, which consists of multiview video and depth maps. However, its performance is limited in practical situations since it is necessary to use erroneous depth information and to perform block-based compensation instead of pixel-based warping. This paper proposes a novel view synthesis prediction scheme where motion field is synthesized by utilizing coarse disparity filed derived from erroneous depth information. As part of the proposed depth-based motion field synthesis, occlusion-aware backward mapping and 3D motion field warping are performed. In order to improve prediction performance with block-based compensation, an adaptive prediction sample generation that utilizes both temporal and inter-view correlations is also proposed. Experiments show that the proposed scheme achieves average bitrate reductions of 1.38% and 1.19% for coded views and synthesized views. The maximum gain is 11.57% for dependent view.
Keywords :
correlation methods; motion compensation; prediction theory; video coding; 3D motion field warping; 3D video; adaptive prediction sample generation; block-based compensation; coarse disparity filed; depth maps; depth-based motion field synthesis; erroneous depth information; interview correlations; multiview video; occlusion-aware backward mapping; temporal correlations; view synthesis prediction scheme; Bit rate; Collaboration; Encoding; Joints; Three-dimensional displays; Vectors; Video coding; 3D Video Coding; 3D-HEVC; Motion Field Synthesis; View Synthesis Prediction (VSP);
Conference_Titel :
Visual Communications and Image Processing Conference, 2014 IEEE
DOI :
10.1109/VCIP.2014.7051530