Query based site selection for distributed search engines

Author

Sato, Nobuyoshi ; Udagawa, M. ; Uehara, M. ; Sakai, Yoshiki ; Mori, F.

Author_Institution

Dept. of Inf. & Comput. Sci., Toyohashi Univ. of Technol., Japan

fYear

2003

fDate

19-22 May 2003

Firstpage

556

Lastpage

561

Abstract

We have developed a distributed search engine, called Cooperative Search Engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a Meta search server integrates these local search engines in order to realize a global search engine. In such a way, the communication delay occurs at retrieval time. So, we have developed several speedup techniques in order to realize fast retrieval. However, these techniques cannot be used for first page retrieval in "Next 10" search if the page has not been searched yet. So, we have proposed Query based Site Selection (QbSS), which is widely available in all cases. In this paper we describe QbSS in detail and discuss its features.

Keywords

Internet; Web sites; computational complexity; distributed processing; file servers; information retrieval; search engines; Web server; cooperative search engine; distributed search engines; information retrieval; meta search server; page retrieval; query based site selection; Delay effects; Distributed computing; Information retrieval; Magnetooptic recording; Metasearch; Network servers; Scalability; Search engines; Web pages; Web server;

fLanguage

English

Publisher

ieee

Conference_Titel

Distributed Computing Systems Workshops, 2003. Proceedings. 23rd International Conference on

Print_ISBN

0-7695-1921-0

Type

conf

DOI

10.1109/ICDCSW.2003.1203612

Filename

1203612