Title :
3D LayoutCRF for Multi-View Object Class Recognition and Segmentation
Author :
Hoiem, Derek ; Rother, Carsten ; Winn, John
Author_Institution :
Carnegie Mellon Univ., Pittsburgh
Abstract :
We introduce an approach to accurately detect and segment partially occluded objects in various viewpoints and scales. Our main contribution is a novel framework for combining object-level descriptions (such as position, shape, and color) with pixel-level appearance, boundary, and occlusion reasoning. In training, we exploit a rough 3D object model to learn physically localized part appearances. To find and segment objects in an image, we generate proposals based on the appearance and layout of local parts. The proposals are then refined after incorporating object-level information, and overlapping objects compete for pixels to produce a final description and segmentation of objects in the scene. A further contribution is a novel instance penalty, which is handled very efficiently during inference. We experimentally validate our approach on the challenging PASCAL´06 car database.
Keywords :
computer graphics; image resolution; image segmentation; object recognition; random processes; visual databases; 3D LayoutCRF; PASCAL´06 car database; instance penalty; layout conditional random field algorithm; multiview object class recognition; multiview object class segmentation; occlusion reasoning; pixel-level appearance; Costs; Face detection; Image generation; Image segmentation; Labeling; Object detection; Proposals; Refining; Robots; Shape;
Conference_Titel :
Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on
Conference_Location :
Minneapolis, MN
Print_ISBN :
1-4244-1179-3
Electronic_ISBN :
1063-6919
DOI :
10.1109/CVPR.2007.383045