Title :
A video object segmentation algorithm based on the feature learning and shape tracking
Author :
Lee, Sang Hak ; Koo, Hyung Il ; Cho, Nam Ik
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
Abstract :
This paper proposes a video object segmentation algorithm based on the conditional random field (CRF) framework. A foreground object in the first frame is segmented by training the CRF on user interaction, i.e., by using user scribbles corresponding to foreground and background respectively for CRF training. The data term of the energy function in this CRF framework is designed as a function of the score of texture-color classifier trained by AdaBoost. From the second frame, a weighted data term that encodes the shape of the object is added to this energy function. The boundary pixels of the current frame are predicted by the optical flow, and a smaller cost is given to a pixel closer to the boundary and vice versa. Also, a confidence of optical flow is defined, and a larger weight is given to the data term when the confident is high. As a result, the data term related with the shape becomes important when the motion estimation is reliable, and conversely the color-texture term becomes important otherwise. Experimental results show that the proposed data term keeps the boundary correctly in most cases and provides comparable result when compared to a state-of-the-art method.
Keywords :
feature extraction; image classification; image colour analysis; image segmentation; learning (artificial intelligence); motion estimation; object tracking; CRF; adaboost classifier; color texture; conditional random field; feature learning; motion estimation; shape tracking; video object segmentation; Adaptive optics; Image segmentation; Object segmentation; Optical imaging; Pixel; Shape; Video sequences; AdaBoost; machine learning; object segmentation; optical flow; shape tracking;
Conference_Titel :
Image Processing (ICIP), 2010 17th IEEE International Conference on
Conference_Location :
Hong Kong
Print_ISBN :
978-1-4244-7992-4
Electronic_ISBN :
1522-4880
DOI :
10.1109/ICIP.2010.5650802