• DocumentCode
    77832
  • Title

    Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors

  • Author

    Yu-Hsun Lin ; Ja-Ling Wu

  • Author_Institution
    Grad. Inst. of Networking & Multimedia, Nat. Taiwan Univ., Taipei, Taiwan
  • Volume
    23
  • Issue
    4
  • fYear
    2014
  • fDate
    Apr-14
  • Firstpage
    1527
  • Lastpage
    1542
  • Abstract
    The objective approaches of 3D image quality assessment play a key role for the development of compression standards and various 3D multimedia applications. The quality assessment of 3D images faces more new challenges, such as asymmetric stereo compression, depth perception, and virtual view synthesis, than its 2D counterparts. In addition, the widely used 2D image quality metrics (e.g., PSNR and SSIM) cannot be directly applied to deal with these newly introduced challenges. This statement can be verified by the low correlation between the computed objective measures and the subjectively measured mean opinion scores (MOSs), when 3D images are the tested targets. In order to meet these newly introduced challenges, in this paper, besides traditional 2D image metrics, the binocular integration behaviors-the binocular combination and the binocular frequency integration, are utilized as the bases for measuring the quality of stereoscopic 3D images. The effectiveness of the proposed metrics is verified by conducting subjective evaluations on publicly available stereoscopic image databases. Experimental results show that significant consistency could be reached between the measured MOS and the proposed metrics, in which the correlation coefficient between them can go up to 0.88. Furthermore, we found that the proposed metrics can also address the quality assessment of the synthesized color-plus-depth 3D images well. Therefore, it is our belief that the binocular integration behaviors are important factors in the development of objective quality assessment for 3D images.
  • Keywords
    correlation methods; data compression; image coding; image colour analysis; multimedia communication; stereo image processing; visual databases; 2D image metrics; 3D multimedia applications; MOS; PSNR; SSIM; binocular combination; binocular frequency integration; correlation coefficient; depth perception; image databases; mean opinion scores; objective quality assessment; stereoscopic 3D image compression; subjective evaluations; synthesized color-plus-depth 3D images; virtual view synthesis; Biological system modeling; Brightness; Image coding; Measurement; Quality assessment; Three-dimensional displays; Visualization; HEVC; MS-SSIM; PSNR; SSIM; Stereo 3D image; UQI; VIF; VSNR; WSNR; binocular frequency integration; binocular vision; color plus depth 3D images; dorsal stream; frequency integrated metric (FI-metric); human visual system (HVS); quality assessment; stereopsis; ventral stream;
  • fLanguage
    English
  • Journal_Title
    Image Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1057-7149
  • Type

    jour

  • DOI
    10.1109/TIP.2014.2302686
  • Filename
    6725658