• DocumentCode
    2115391
  • Title

    A Polite Policy for Revisiting Web Pages

  • Author

    Souza, Camilo ; Laber, E. ; Valentim, C. ; Cardoso, Elsa

  • Author_Institution
    PUC-Rio, Rio de Janeiro
  • fYear
    2007
  • fDate
    Oct. 31 2007-Nov. 2 2007
  • Firstpage
    128
  • Lastpage
    135
  • Abstract
    We propose and analyze an efficient scheduling policy for revisiting Web pages so as to keep a local repository as up to date as possible. The main contribution of our policy is the fact that it takes into account the politeness constraint in order to compute the revisiting times. Our experiments suggest that the performance of our policy is very close to the optimal one and that it is significantly better than the one obtained using a reasonable variation of the policy proposed in [Wolf et. ah, WWW´2002].
  • Keywords
    Web sites; scheduling; Web page revisiting; politeness constraint; scheduling policy; Communication channels; Crawlers; Probability distribution; Processor scheduling; Search engines; Service oriented architecture; Web pages; Web server; World Wide Web;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Web Conference, 2007. LA-WEB 2007. Latin American
  • Conference_Location
    Santiago
  • Print_ISBN
    978-0-7695-3008-6
  • Type

    conf

  • DOI
    10.1109/LA-Web.2007.10
  • Filename
    4383167