Title :
MetaTest: evaluation of metadata from generation to use
Author :
Liddy, Elizabeth D. ; Allen, Eileen E. ; Finneran, Christina M. ; Gay, Geri ; Hembrooke, Helene ; Granka, Laura A.
Author_Institution :
Center for Natural Language Process., Syracuse Univ., NY, USA
Abstract :
We are studying metadata from its initial generation to its use in accessing desired educational resources. With a testbed of lesson plans and activities, we are comparing the manually and automatically generated metadata for their retrieval effectiveness (i.e. ability to retrieve the most relevant resources); conducting a subjective evaluation of manually and automatically generated metadata as representations of the resource as judged by subject matter experts, and; conducting studies of users´ search and navigation behavior when accessing the digital library. These evaluations successfully combine what we believe are necessary foci on how and whether metadata affects the user and system performance.
Keywords :
digital libraries; education; groupware; information resources; information retrieval; meta data; MetaTest; collaborative work; digital library; educational resource; information resource; information retrieval effectiveness; lesson plan; metadata evaluation; subject matter expert; system performance; user performance; Automatic testing; Collaboration; Educational activities; Educational technology; Information retrieval; Mathematics; Natural language processing; Navigation; Software libraries; System performance;
Conference_Titel :
Digital Libraries, 2003. Proceedings. 2003 Joint Conference on
Print_ISBN :
0-7695-1939-3
DOI :
10.1109/JCDL.2003.1204917