Title :
View Synthesis Prediction in the 3-D Video Coding Extensions of AVC and HEVC
Author :
Feng Zou ; Dong Tian ; Vetro, Anthony ; Huifang Sun ; Au, Oscar C. ; Shimizu, Shogo
Author_Institution :
Mitsubishi Electr. Res. Labs., Cambridge, MA, USA
Abstract :
Advanced multiview video systems are able to generate intermediate viewpoints of a 3-D scene. To enable low-complexity free view generation, texture and its associated depth are used as input data for each viewpoint. To improve the coding efficiency of such content, view synthesis prediction (VSP) is proposed to further reduce interview redundancy in addition to traditional disparity compensated prediction. This paper describes and analyzes rate-distortion optimized VSP designs, which were adopted in the 3-D extensions of both Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC). In particular, we propose a novel backward-VSP scheme using a derived disparity vector, as well as efficient signalling methods in the context of AVC and HEVC. In addition, we put forward a novel depth-assisted motion vector prediction method to optimize the coding efficiency. A thorough analysis of coding performance is provided using different VSP schemes and configurations. Experimental results demonstrate average bit rate reductions of 2.5% and 1.2% in AVC and HEVC coding frameworks, respectively, with up to 23.1% bit rate reduction for dependent views.
Keywords :
optimisation; prediction theory; rate distortion theory; video coding; 3-D video coding extensions; AVC extension; HEVC extension; advanced multiview video systems; advanced video coding; average bit rate reductions; backward-VSP scheme; coding efficiency optimizing; depth-assisted motion vector prediction method; derived disparity vector; efficient signalling methods; high efficiency video coding; rate-distortion optimized VSP designs; view synthesis prediction; Cameras; Complexity theory; Encoding; Standards; Three-dimensional displays; Vectors; Video coding; 3-D; depth; video coding; view synthesis prediction (VSP);
Journal_Title :
Circuits and Systems for Video Technology, IEEE Transactions on
DOI :
10.1109/TCSVT.2014.2313891