A Semantic Multimedia Analysis Approach Utilizing a Region Thesaurus and LSA

This paper presents an approach on high-level feature detection within video documents, using a region thesaurus and latent semantic analysis. A video shot is represented by a single keyframe. MPEG-7 features are extracted from coarse regions of it. A clustering algorithm is applied on all extracted regions and a region thesaurus is constructed. Its use is to assist to the mapping of low- to high-level features by a model vector representation. Latent semantic analysis is then applied on the model vectors to exploit the latent relations among region types aiming to improve detection performance. The proposed approach is thoroughly examined using TRECVID 2007 development data.