Title :
An MRF-Based Depth Upsampling: Upsample the Depth Map With Its Own Property
Author :
Wei Liu ; Shaoyong Jia ; Penglin Li ; Xiaogang Chen ; Jie Yang ; Qiang Wu
Author_Institution :
Key Lab. of Minist. of Educ. for Syst. Control & Inf. Process., Shanghai Jiao Tong Univ., Shanghai, China
Abstract :
In this letter, we propose a novel method for upsampling the noisy low resolution depth map with the guidance of the companion color image. The problem is modeled with an Markov Random Field (MRF)-based optimization framework. The novelty relies on the smoothness term that is modeled with an exponential function as the error norm. By using this novel error norm, our method can take the property of the depth map into account. Depth discontinuity cues are not only obtained from the color image but also the depth map itself. Our method has much better performance in preserving sharp depth discontinuities and suppressing the texture copy artifacts. Experimental results show that our method outperforms state-of-art solutions in both visual quality and accuracy.
Keywords :
Markov processes; image colour analysis; image sampling; image texture; optimisation; random processes; MRF-based depth upsampling; Markov random field framework; depth map resolution; error norm exponential function; image color analysis; image texture; optimization framework; sharp depth discontinuity; Color; Image color analysis; Image edge detection; Image resolution; Joints; Noise measurement; Visualization; Depth map upsampling; MRF; ToF; optimization;
Journal_Title :
Signal Processing Letters, IEEE
DOI :
10.1109/LSP.2015.2427376