Title :
Multimedia retrieval benchmarks
Author :
Over, Paul ; Leung, Clement ; Ip, Horace ; Grubinger, Michael
Author_Institution :
Nat. Inst. of Stand. & Technol., Boulder, CO, USA
Abstract :
Multimedia retrieval systems´ development has long been challenged by the lack of standard benchmarks for evaluating and comparing the performance of emerging techniques. However, two recent benchmarking efforts, TREC Video Retrieval Evaluation (TRECVID) and the IAPR TC-12 Benchmark for Visual Information Search, show great promise for letting the multimedia retrieval community collaborate on advancing the state of the art.
Keywords :
benchmark testing; content-based retrieval; multimedia computing; standards; IAPR TC-12 Benchmark for Visual Information Search; MPEG-1; TREC Video Retrieval Evaluation; TRECVID; benchmarking; multimedia community; multimedia retrieval benchmarks; retrieval systems; standard benchmarks; standards; Airplanes; Costs; Data mining; Feature extraction; Gunshot detection systems; Humans; Image retrieval; MPEG 7 Standard; NIST; Training data;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2004.1289045