• DocumentCode
    34187
  • Title

    Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis

  • Author

    Sheng-Jie Luo ; Ying-Tse Sun ; I-Chao Shen ; Bing-Yu Chen ; Yung-Yu Chuang

  • Author_Institution
    Nat. Taiwan Univ., Taipei, Taiwan
  • Volume
    21
  • Issue
    1
  • fYear
    2015
  • fDate
    Jan. 1 2015
  • Firstpage
    56
  • Lastpage
    67
  • Abstract
    This paper presents a patch-based synthesis framework for stereoscopic image editing. The core of the proposed method builds upon a patch-based optimization framework with two key contributions: First, we introduce a depth-dependent patch-pair similarity measure for distinguishing and better utilizing image contents with different depth structures. Second, a joint patch-pair search is proposed for properly handling the correlation between two views. The proposed method successfully overcomes two main challenges of editing stereoscopic 3D media: (1) maintaining the depth interpretation, and (2) providing controllability of the scene depth. The method offers patch-based solutions to a wide variety of stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion. Several challenging cases are demonstrated to show the effectiveness of the proposed method. The results of user studies also show that the proposed method produces stereoscopic images with good stereoscopics and visual quality.
  • Keywords
    controllability; image texture; optimisation; stereo image processing; 2D to 3D conversion; content adaptation; depth interpretation; depth-dependent patch-pair similarity measure; depth-guided texture synthesis; geometrically consistent stereoscopic image editing; joint patch-pair search; paint by depth; patch-based optimization framework; patch-based synthesis; scene depth controllability; stereoscopic 3D media editing; stereoscopic NPR; visual quality; Image color analysis; Joints; Media; Stereo image processing; Three-dimensional displays; Visualization; Stereoscopic images; patch-based synthesis;
  • fLanguage
    English
  • Journal_Title
    Visualization and Computer Graphics, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1077-2626
  • Type

    jour

  • DOI
    10.1109/TVCG.2014.2327979
  • Filename
    6824802