Title :
On updating in very short time by distributed search engines
Author :
Sato, Nobuyoshi ; Uehara, Minoru ; Sakai, Yoshifumi ; Mori, Hideki
Author_Institution :
Dept. of Inf. & Comput. Sci., Toyo Univ., Japan
Abstract :
Conventional search engines employ a centralized architecture. However, such engines are not suitable for fresh information retrieval because they take a long time to collect Web pages using a Web robot (or crawler). There are also distributed search engines such as Harvest etc., but they cannot update in a very short time, e.g. a few minutes. In this paper, we propose a distributed information retrieval system, called a cooperative search engine (CSE), in which multiple distributed local search engines communicate with each other in order to realize a whole global search engine. A local search engine has own index database and can update quickly. In addition, they cooperate with each other in order to reduce their workload. In this paper, we describe the structure and behavior of CSE, and its efficiency
Keywords :
information resources; information retrieval; search engines; cooperative search engine; distributed information retrieval systems; distributed search engines; fast updating; index database; local search engines; Databases; Distributed computing; Information retrieval; Internet; Magnetooptic recording; Robots; Search engines; Web pages; Web server; World Wide Web;
Conference_Titel :
Applications and the Internet, 2002. (SAINT 2002). Proceedings. 2002 Symposium on
Conference_Location :
Nara
Print_ISBN :
0-7695-1447-2
DOI :
10.1109/SAINT.2002.994475