Title :
A fast image segmentation algorithm for interactive video hotspot retrieval
Author :
Liu, Tiecheng ; Kender, John R. ; Hjelsvold, Rune ; Pizano, Arturo
Author_Institution :
Dept. of Comput. Sci., Columbia Univ., New York, NY, USA
Abstract :
This paper presents a fast image segmentation algorithm for extracting areas-of-interest ("hotspots") from video sequences. Because video hotspots, which are the visual analogues of HTML hyperlinks, highly depend on a user\´s interest, it is very difficult to automatically extract the exact outlines of objects of interest in videos. Our approach to interactive video hotspot retrieval is to provide candidate hotspots with segmented regions of video frames when requested, and a Web designer using the tool for Web site creation may select the area (or areas) he is interested in as a video hotspot. This segmentation algorithm follows a three step coarse-to-fine scheme. The original image is first divided into blocks and a block-merging process is applied to get a coarse segmentation. Then we represent the pre-segmented image as a graph where the value of edges in this graph are evaluated based on multi features, and by using a minimum spanning tree searching algorithm, we merge the vertices in the graph to generate the segmented regions of the image. Finally, we refine the boundary of segmented regions on the pixel level using an improved K-means clustering algorithm. This segmentation algorithm is fast and efficient and our final segmentation results compare favorably with the results obtained using manual outlining. We also provide a convenient way for the Web page designer to select multiple regions as a video hotspot. Our method allows the designer to click on an image during video playback and to get a segmented image almost instantly. The extracted video hotspots can then be used for video hyperlinks, an extension of the general concept of hyperlink to interactive videos
Keywords :
feature extraction; hypermedia; image retrieval; image segmentation; image sequences; interactive systems; statistical analysis; tree searching; video databases; K-means clustering; Web site creation; area-of-interest extraction; block-merging process; coarse-to-fine scheme; image graph; image segmentation; interactive video hotspot retrieval; minimum spanning tree searching; multi features; multiple regions; video frames; video hyperlinks; video playback; video sequences; Active contours; Decision trees; Design methodology; HTML; Image retrieval; Image segmentation; Shape; Tracking; Web page design; Web pages;
Conference_Titel :
Content-Based Access of Image and Video Libraries, 2001. (CBAIVL 2001). IEEE Workshop on
Conference_Location :
Kauai, HI
Print_ISBN :
0-7695-1354-9
DOI :
10.1109/IVL.2001.990849