Title :
A method for extraction of audio-visual leitmotif in movies by cross media analysis
Author :
Benois-Pineau, Jenny ; Desainte-Catherine, Myriam ; Louis, Nicolas
Author_Institution :
LABRI, Univ. Bordeaux 1, Talence, France
Abstract :
The joint analysis of video and audio components in multimedia documents has been widely used since the beginning of activities related to the new multimedia Standard MPEG7. In this context the paper is focused on a method for extraction of an emotional and structuring cue from artistic content we call “audio-visual leitmotif”, which is a first step in characterization of an author style in producing the content. The method is based on joint motion -based video partitioning and on model-based music recognition.
Keywords :
audio signal processing; document handling; image motion analysis; multimedia communication; video signal processing; MPEG7 multimedia standard; audio-visual leitmotif extraction; cross media analysis; emotional cue extraction; joint audio component analysis; joint model-based music recognition; joint motion-based video partitioning; joint video component analysis; movies; multimedia documents; structuring cue extraction; Abstracts; Indexing; Integrated optics; Robustness; Semantics; Speech; Streaming media;
Conference_Titel :
Signal Processing Conference, 2002 11th European
Conference_Location :
Toulouse