Title :
Building Reliable and Reusable Test Collections for Image Retrieval: The Wikipedia Task at ImageCLEF
Author :
Tsikrika, Theodora ; Kludas, Jana ; Popescu, Adrian
Author_Institution :
Univ. of Appl. Sci. Western Switzerland, Sierre, Switzerland
Abstract :
The ImageCLEF Wikipedia image retrieval task aimed to support ad-hoc image retrieval evaluation using large-scale collections of Wikipedia images and their user-generated annotations.
Keywords :
Web sites; image retrieval; ImageCLEF Wikipedia image retrieval task; ad-hoc image retrieval evaluation; large-scale collections; test collections; user-generated annotations; Collaboration; Electronic publishing; Error analysis; Image retrieval; Internet; Large scale systems; Multimedia communication; Performance evaluation; User-generated content; Wikipedia; ImageCLEF; benchmarks; ground truth creation; image retrieval evaluation; incomplete judgments; measurement error; multimedia; ranking stability; test collections; topic development;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2012.17
