DocumentCode :
857560
Title :
Enhanced Eigen-Audioframes for Audiovisual Scene Change Detection
Author :
Kyperountas, Marios ; Kotropoulos, Constantine ; Pitas, Ioannis
Author_Institution :
Dept. of Informatics, Aristotelian Univ. of Thessaloniki
Volume :
9
Issue :
4
fYear :
2007
fDate :
6/1/2007 12:00:00 AM
Firstpage :
785
Lastpage :
797
Abstract :
In this paper, a novel audio-visual scene change detection algorithm is presented and evaluated experimentally. An enhanced set of eigen-audioframes is created that is related to an audio signal subspace, where audio background changes are easily discovered. An analysis is presented that justifies why this subspace favors scene change detection. Additionally, a novel process is developed in order to detect audio scene change candidates in this subspace. Visual information is used to align audio scene change indications with neighboring video shot changes and, accordingly, to reduce the false alarm rate of the audio-only scene change detection. Moreover, video fade effects are identified and used independently in order to track scene changes. The false alarm rate is reduced further by extracting acoustic features in order to verify that the scene change indications are valid. The detection methodology was tested on newscast videos provided by the TRECVID2003 video test set. The experimental results demonstrate that the proposed method achieves an F-measure exceeding 0.85. Accordingly, it effectively tackles the scene change detection problem
Keywords :
audio signal processing; feature extraction; image segmentation; object detection; video signal processing; acoustic feature extraction; audio signal subspace; audio-visual scene change detection; eigen-audioframe; video segmentation; Audio-visual video segmentation; TRECVID2003; eigen-audioframes; scene change detection;
fLanguage :
English
Journal_Title :
Multimedia, IEEE Transactions on
Publisher :
ieee
ISSN :
1520-9210
Type :
jour
DOI :
10.1109/TMM.2007.893337
Filename :
4202595
Link To Document :
بازگشت