Title :
Multiview extensive partition operators for semantic video object extraction
Author :
Gatica-Perez, Daniel ; Sun, Ming-Ting ; Gu, Chuang
Author_Institution :
Dept. of Electr. Eng., Washington Univ., Seattle, WA, USA
fDate :
7/1/2001 12:00:00 AM
Abstract :
Occlusion/disocclusion is one of the fundamental problems for semantic video object (SVO) extraction, where pixel-wise accuracy is required. This issue is critical because the degradation in tracking due to object occlusion/disocclusion significantly increases the amount of user interaction required in off-line video editing applications. We present an approach based on the application of an extensive operator on a lattice of partitions, which exploits information from various views of the scene, based on a probabilistic formulation. Our multiview operator builds on the regional application of the maximum a posteriori principle, by integrating a single-view region classification stage with a multiview stage that improves classification for those disoccluded regions labeled as uncertain. Results on several real sequences show that our approach improves the SVO tracking compared to the single-view case and that, as a result, increases the quality of the extracted SVOs and reduces the total amount of user interaction
Keywords :
feature extraction; image classification; image sequences; mathematical morphology; mathematical operators; probability; tracking; video signal processing; mathematical morphology; maximum a posteriori principle; multiview extensive partition operators; object occlusion/disocclusion; off-line video editing applications; pixel-wise accuracy; probabilistic formulation; real sequences; semantic video object extraction; semantic video object tracking; single-view region classification; user interaction; Books; Degradation; Helium; Humans; Lattices; Layout; Lighting; MPEG 4 Standard; Morphology; Sun;
Journal_Title :
Circuits and Systems for Video Technology, IEEE Transactions on