DocumentCode
54052
Title
Brain-Inspired Framework for Fusion of Multiple Depth Cues
Author
Chung-Te Li ; Yen-Chieh Lai ; Chien Wu ; Sung-Fang Tsai ; Tung-Chien Chen ; Shao-Yi Chien ; Liang-Gee Chen
Author_Institution
Grad. Inst. of Electron. Eng., Nat. Taiwan Univ., Taipei, Taiwan
Volume
23
Issue
7
fYear
2013
fDate
Jul-13
Firstpage
1137
Lastpage
1149
Abstract
2-D-to-3-D conversion is an important step for obtaining 3-D videos, as a variety of monocular depth cues have been explored to generate 3-D videos from 2-D videos. As in a human brain, a fusion of these monocular depth cues can regenerate 3-D data from 2-D data. By mimicking how our brains generate depth perception, we propose a reliability-based fusion of multiple depth cues for an automatic 2-D-to-3-D video conversion. A series of comparisons between the proposed framework and the previous methods is also presented. It shows that significant improvement is achieved in both subjective and objective experimental results. From the subjective viewpoint, the brain-inspired framework outperforms earlier conversion methods by preserving more reliable depth cues. Moreover, an enhancement of 0.70-3.14 dB and 0.0059-0.1517 in the perceptual quality of the videos is realized in terms of the objective-modified peak signal-to-noise ratio and disparity distortion model, respectively.
Keywords
brain; image enhancement; image fusion; medical image processing; reliability; video signal processing; 2-D-to-3-D conversion; 2D-to-3D video conversion; brain-inspired framework; disparity distortion model; human brain; monocular depth cues; multiple depth cue reliability-based fusion; objective-modified peak signal-to-noise ratio; Humans; Image color analysis; Image edge detection; Reliability; Vectors; Videos; Visualization; 2-D-to-3-D conversion; brain-inspired fusion; depth generation; multiple depth cues;
fLanguage
English
Journal_Title
Circuits and Systems for Video Technology, IEEE Transactions on
Publisher
ieee
ISSN
1051-8215
Type
jour
DOI
10.1109/TCSVT.2012.2223874
Filename
6328251
Link To Document