Knowledge-assisted cross-media analysis of audio-visual content in the news domain

Author

Mezaris, Vasileios ; Gidaros, Spyros ; Papadopoulos, Georgios Th ; Kasper, Walter ; Ordelman, Roeland ; De Jong, Franciska ; Kompatsiaris, Ioannis

Author_Institution

Centre for Res. & Technol. Hellas, Inf. & Telematics Inst., Thessaloniki

fYear

2008

fDate

18-20 June 2008

Firstpage

280

Lastpage

287

Abstract

In this paper, a complete architecture for knowledge-assisted cross-media analysis of News-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text) separately, and proposes a fusion technique based on the particular characteristics of News-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic video annotations.

Keywords

knowledge representation; multimedia systems; video signal processing; audio-visual content; fusion technique; knowledge-assisted cross-media analysis; modality analysis; news-related multimedia content; semantic video annotations; Algorithm design and analysis; Data mining; Hidden Markov models; Informatics; Information analysis; Knowledge representation; Machine learning; Multimedia systems; Ontologies; Telematics;

fLanguage

English

Publisher

ieee

Conference_Titel

Content-Based Multimedia Indexing, 2008. CBMI 2008. International Workshop on

Conference_Location

London

Print_ISBN

978-1-4244-2043-8

Electronic_ISBN

978-1-4244-2044-5

Type

conf

DOI

10.1109/CBMI.2008.4564958

Filename

4564958