Title :
Knowledge-assisted cross-media analysis of audio-visual content in the news domain
Author :
Mezaris, Vasileios ; Gidaros, Spyros ; Papadopoulos, Georgios Th ; Kasper, Walter ; Ordelman, Roeland ; De Jong, Franciska ; Kompatsiaris, Ioannis
Author_Institution :
Centre for Res. & Technol. Hellas, Inf. & Telematics Inst., Thessaloniki
Abstract :
In this paper, a complete architecture for knowledge-assisted cross-media analysis of News-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text) separately, and proposes a fusion technique based on the particular characteristics of News-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic video annotations.
Keywords :
knowledge representation; multimedia systems; video signal processing; audio-visual content; fusion technique; knowledge-assisted cross-media analysis; modality analysis; news-related multimedia content; semantic video annotations; Algorithm design and analysis; Data mining; Hidden Markov models; Informatics; Information analysis; Knowledge representation; Machine learning; Multimedia systems; Ontologies; Telematics;
Conference_Titel :
Content-Based Multimedia Indexing, 2008. CBMI 2008. International Workshop on
Conference_Location :
London
Print_ISBN :
978-1-4244-2043-8
Electronic_ISBN :
978-1-4244-2044-5
DOI :
10.1109/CBMI.2008.4564958
