Scene retrieval with sign sequence matching based on video and audio features

Author

Babaguchi, Noboru ; Ishida, Tetsuya ; Morisawa, Keisuke

Author_Institution

Graduate Sch. of Eng., Osaka Univ.

Volume

2

fYear

2004

fDate

30-30 June 2004

Firstpage

1107

Abstract

This paper presents a method of retrieving similar scenes from video streams with sign sequence matching. The visual and auditory streams are partitioned into fixed-length video/audio packets. Based on feature vectors extracted from these packets, sign sequences are formed. The sign sequence can be viewed as abstraction of video and audio features. DP matching between the target and query sign sequences allows us to find scenes similar to the query in the video stream. For the purpose of efficient processing, packets, histogram based features, and sign sequences, which are the key ideas in this method, are introduced. The preliminary experimental results show that this method is promising for quick retrieval for similar scenes

Keywords

content-based retrieval; feature extraction; image matching; image sequences; multimedia databases; video databases; DP matching; audio features; feature vector extraction; fixed-length video/audio packets; histogram based features; scene retrieval; sign sequence matching; similar scenes; video features; video streams; Collaboration; Data mining; Feature extraction; Graphics; Histograms; Image segmentation; Large-scale systems; Layout; Multimedia communication; Streaming media;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference on

Conference_Location

Taipei

Print_ISBN

0-7803-8603-5

Type

conf

DOI

10.1109/ICME.2004.1394404

Filename

1394404