A method for extraction of audio-visual leitmotif in movies by cross media analysis

Author

Benois-Pineau, Jenny ; Desainte-Catherine, Myriam ; Louis, Nicolas

Author_Institution

LABRI, Univ. Bordeaux 1, Talence, France

fYear

2002

fDate

3-6 Sept. 2002

Firstpage

1

Lastpage

4

Abstract

The joint analysis of video and audio components in multimedia documents has been widely used since the beginning of activities related to the new multimedia Standard MPEG7. In this context the paper is focused on a method for extraction of an emotional and structuring cue from artistic content we call “audio-visual leitmotif”, which is a first step in characterization of an author style in producing the content. The method is based on joint motion -based video partitioning and on model-based music recognition.

Keywords

audio signal processing; document handling; image motion analysis; multimedia communication; video signal processing; MPEG7 multimedia standard; audio-visual leitmotif extraction; cross media analysis; emotional cue extraction; joint audio component analysis; joint model-based music recognition; joint motion-based video partitioning; joint video component analysis; movies; multimedia documents; structuring cue extraction; Abstracts; Indexing; Integrated optics; Robustness; Semantics; Speech; Streaming media;

fLanguage

English

Publisher

ieee

Conference_Titel

Signal Processing Conference, 2002 11th European

Conference_Location

Toulouse

ISSN

2219-5491

Type

conf

Filename

7072264