Title :
VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems
Author :
Snoek, Cees G M ; Worring, Marcel ; de Rooij, Ork ; Van de Sande, Koen E A ; Yan, Rong ; Hauptmann, Alexander G.
Author_Institution :
Amsterdam Univ., Amsterdam
Abstract :
The first VideOlympics brings content-based analysis to the archive and allows for many-to- many communication between video search engines and their audience It was a great Success. The VideOlympics provided the excitement of a competition without the associated stress on the participants. For the first time, the audience was able to compare different multimedia retrieval systems on the same tasks and see how they performed with unrehearsed topics. Many audience members felt they understood the technology´s capabilities after seeing it in live action and in several system variations.
Keywords :
content-based retrieval; information retrieval system evaluation; search engines; video retrieval; VideOlympics multimedia retrieval system; content-based analysis; real-time system evaluation; video search engine; Auditory system; Content based retrieval; Information retrieval; Multimedia communication; Multimedia systems; Prototypes; Real time systems; Search engines; Standards publication; Videoconference; VideOlympics; multimedia retrieval systems; video search;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2008.21