Title :
Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction
Author :
Chung, Adrian J. ; Deligianni, Fani ; Shah, Pallav ; Wells, Athol ; Yang, Guang-Zhong
Author_Institution :
Dept. of Comput., Imperial Coll. London, UK
fDate :
4/1/2006 12:00:00 AM
Abstract :
This paper presents an image-based method for virtual bronchoscope with photo-realistic rendering. The technique is based on recovering bidirectional reflectance distribution function (BRDF) parameters in an environment where the choice of viewing positions, directions, and illumination conditions are restricted. Video images of bronchoscopy examinations are combined with patient-specific three-dimensional (3-D) computed tomography data through two-dimensional (2-D)/3-D registration and shading model parameters are then recovered by exploiting the restricted lighting configurations imposed by the bronchoscope. With the proposed technique, the recovered BRDF is used to predict the expected shading intensity, allowing a texture map independent of lighting conditions to be extracted from each video frame. To correct for disocclusion artefacts, statistical texture synthesis was used to recreate the missing areas. New views not present in the original bronchoscopy video are rendered by evaluating the BRDF with different viewing and illumination parameters. This allows free navigation of the acquired 3-D model with enhanced photo-realism. To assess the practical value of the proposed technique, a detailed visual scoring that involves both real and rendered bronchoscope images is conducted.
Keywords :
computerised tomography; image registration; image texture; medical image processing; statistical analysis; video signal processing; bidirectional reflectance distribution function estimation; disocclusion correction; image registration; patient-specific bronchoscopy visualization; patient-specific three-dimensional computed tomography; shading intensity; statistical texture synthesis; video images; virtual bronchoscope; Bidirectional control; Bronchoscopy; Computed tomography; Data mining; Distribution functions; Lighting; Navigation; Rendering (computer graphics); Two dimensional displays; Visualization; Bidirectional reflectance distribution function; image-based rendering; virtual bronchoscopy; Algorithms; Artifacts; Artificial Intelligence; Bronchoscopy; Computer Simulation; Humans; Image Enhancement; Image Interpretation, Computer-Assisted; Imaging, Three-Dimensional; Information Storage and Retrieval; Models, Biological; Pattern Recognition, Automated; Reproducibility of Results; Sensitivity and Specificity; Subtraction Technique; Tomography, X-Ray Computed; User-Computer Interface;
Journal_Title :
Medical Imaging, IEEE Transactions on
DOI :
10.1109/TMI.2006.871550