DocumentCode :
2955033
Title :
Automatic Query Expansion for News Video Retrieval
Author :
Zhai, Yun ; Liu, Jingen ; Shah, Mubarak
Author_Institution :
Sch. of Electr. Eng. & Comput. Sci., Univ. of Central Florida, Orlando, FL
fYear :
2006
fDate :
9-12 July 2006
Firstpage :
965
Lastpage :
968
Abstract :
In this paper, we present an integrated system for news video retrieval. The proposed system incorporates both speech and visual information in the search mechanisms. The initial search is based on the automatic speech recognition (ASR) transcript of video. Based on the relevant shots selected from the initial search round, keyword histograms are automatically generated for the refinement of the search query, such that the reformulated query fits better to the target topic. We have also developed an image-based refinement module, which uses the region analysis of the video key-frames. SR-tree like indexing structure is constructed for the region features, and the image-to-image similarity is computed using the Earth mover distance. By performing a series of relevance feedback processes, the set of the true relevant shots is expanded significantly. The proposed system has been applied to a large open-benchmark news video dataset, and very satisfactory improvements have been obtained by applying the proposed automatic query expansion and the region-based refinement
Keywords :
content-based retrieval; database indexing; relevance feedback; speech recognition; tree searching; video retrieval; visual databases; ASR video transcription; Earth mover distance; SR-tree like indexing structure; automatic query expansion; automatic speech recognition; image-based refinement module; integrated system; keyword histogram; news video retrieval; region-based refinement; relevance feedback process; search mechanism; visual information; Automatic speech recognition; Computer science; Content based retrieval; Feedback; Histograms; Image analysis; Image retrieval; Indexing; Information retrieval; User interfaces;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Multimedia and Expo, 2006 IEEE International Conference on
Conference_Location :
Toronto, Ont.
Print_ISBN :
1-4244-0366-7
Electronic_ISBN :
1-4244-0367-7
Type :
conf
DOI :
10.1109/ICME.2006.262693
Filename :
4036762
Link To Document :
بازگشت