Title :
A Polite Policy for Revisiting Web Pages
Author :
Souza, Camilo ; Laber, E. ; Valentim, C. ; Cardoso, Elsa
Author_Institution :
PUC-Rio, Rio de Janeiro
fDate :
Oct. 31 2007-Nov. 2 2007
Abstract :
We propose and analyze an efficient scheduling policy for revisiting Web pages so as to keep a local repository as up to date as possible. The main contribution of our policy is the fact that it takes into account the politeness constraint in order to compute the revisiting times. Our experiments suggest that the performance of our policy is very close to the optimal one and that it is significantly better than the one obtained using a reasonable variation of the policy proposed in [Wolf et. ah, WWW´2002].
Keywords :
Web sites; scheduling; Web page revisiting; politeness constraint; scheduling policy; Communication channels; Crawlers; Probability distribution; Processor scheduling; Search engines; Service oriented architecture; Web pages; Web server; World Wide Web;
Conference_Titel :
Web Conference, 2007. LA-WEB 2007. Latin American
Conference_Location :
Santiago
Print_ISBN :
978-0-7695-3008-6
DOI :
10.1109/LA-Web.2007.10
