• DocumentCode
    1734871
  • Title

    Poisson distribution-based page updating prediction strategy

  • Author

    Jiang, Yuanshu ; Tang, Wenzhong

  • Author_Institution
    Beijing Key Lab. of Network Technol., Beihang Univ., Beijing, China
  • Volume
    2
  • fYear
    2011
  • Firstpage
    953
  • Lastpage
    956
  • Abstract
    A kind of method predicting the updating period of page is proposed, using the Poisson distribution-based model suggested by Brewington in studying page updating of search engine. This method calculates the expectation of page updating period with Newton iteration method according to historical statistical data then applies it in the subsequent updating strategy, also revises it in the practice in order to approach the real value; its goal is to get a good balance between freshness and resource utilization. Compared to traditional grouping-by-frequency method, algorithm complexity reduces significantly.
  • Keywords
    Newton method; Poisson distribution; Web sites; computational complexity; resource allocation; search engines; statistical analysis; Newton iteration method; Poisson distribution-based model; algorithm complexity; freshness; grouping-by-frequency method; historical statistical data; page updating period expectation; page updating prediction strategy; resource utilization; search engine; subsequent updating strategy; Algorithm design and analysis; Approximation methods; Crawlers; Educational institutions; Indexes; Mathematical model; Newton iteration method; Poisson distribution; expectations prediction; updating frequency;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computer Science and Network Technology (ICCSNT), 2011 International Conference on
  • Conference_Location
    Harbin
  • Print_ISBN
    978-1-4577-1586-0
  • Type

    conf

  • DOI
    10.1109/ICCSNT.2011.6182119
  • Filename
    6182119