A Hierarchy of Search Engines Based on ODP Concepts

This paper reports a query probing strategy which exploits concept hierarchy of open directory project (ODP) to discover knowledge about search engines. In this strategy, keywords are selected on the basis of frequency analysis of words appearing in descriptions of URLs associated with a concept. The selected keywords, their senses and the words adjacent to these keywords are used in construction of query phrases. Each search engine is probed with these query phrases and their first page result is evaluated to identify number of overlaps, unique links, duplicates, dead links and freshness of documents. An application has been designed and implemented to rank search engines based on above query probing strategy and evaluation measures. This application also creates an RDF file to store the results of evaluation. The results obtained with this application are presented and results have been validated with the queries extracted from log files