Multimedia Search Without Visual Analysis: The Value of Linguistic and Contextual Information

Author

De Jong, Franciska M G ; Westerveld, Thijs ; De Vries, Arjen P.

Volume

17

Issue

3

fYear

2007

fDate

3/1/2007 12:00:00 AM

Firstpage

365

Lastpage

371

Abstract

This paper addresses the focus of this special issue by analyzing the potential contribution of linguistic content and other nonimage aspects to the processing of audiovisual data. It summarizes the various ways in which linguistic content analysis contributes to enhancing the semantic annotation of multimedia content, and, as a consequence, to improving the effectiveness of conceptual media access tools. A number of techniques are presented, including the time-alignment of textual resources, audio and speech processing, content reduction and reasoning tools, and the exploitation of surface features

Keywords

audio signal processing; audio-visual systems; content-based retrieval; multimedia systems; speech processing; audiovisual data processing; content reduction; contextual information; linguistic content analysis; multimedia search; semantic annotation; speech processing; surface features; textual resources time-alignment; Computer science; Image analysis; Image storage; Information analysis; Information retrieval; Mathematics; Natural languages; Speech analysis; Speech processing; Videos; Context; language processing; multimedia search; semantic metadata; speech and audio analysis; surface features;

fLanguage

English

Journal_Title

Circuits and Systems for Video Technology, IEEE Transactions on

Publisher

ieee

ISSN

1051-8215

Type

jour

DOI

10.1109/TCSVT.2007.890834

Filename

4118235