Title :
Temporal consistency enhancement of depth video sequence
Author :
Shih-Hung Lin ; Pau-Choo Chung
Author_Institution :
Inst. of Comput. & Commun. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Abstract :
Stereo matching algorithms base on image similarity to find correspondence between two images. All of the stereo matching methods suffer from lack of texture, occlusion, spontaneous noise, which would result in incorrect depth estimation. Such caused random depth errors in a video sequence would cause sporadic flickering, thus reducing the perceptive quality of the rendered 3D video. This paper proposes the consistency check of the depth values in temporal sequence to identify the instances with occlusion and noise and based on the results, correct the depth errors due to occlusion and spontaneous noise. The resultant depth values are then gone through evaluation using Newton´s Law of motion. The depth values which do not comply with the Newton´s Law of motion are corrected. Finally we use a bilateral filter to further smooth the video depth values.
Keywords :
filtering theory; image enhancement; image matching; image sequences; object tracking; stereo image processing; video signal processing; Newton´s law of motion; bilateral filter; consistency check; depth estimation; image similarity; occlusion; perceptive quality; random depth errors; rendered 3D video; spontaneous noise; sporadic flickering; stereo matching algorithms; temporal sequence; video depth values; video sequence; Computer vision; Computers; Conferences; PSNR; Stereo vision; Streaming media; Stereo matching; disparity map;
Conference_Titel :
Information Science, Electronics and Electrical Engineering (ISEEE), 2014 International Conference on
Conference_Location :
Sapporo
Print_ISBN :
978-1-4799-3196-5
DOI :
10.1109/InfoSEEE.2014.6946252