DocumentCode :
1734871
Title :
Poisson distribution-based page updating prediction strategy
Author :
Jiang, Yuanshu ; Tang, Wenzhong
Author_Institution :
Beijing Key Lab. of Network Technol., Beihang Univ., Beijing, China
Volume :
2
fYear :
2011
Firstpage :
953
Lastpage :
956
Abstract :
A kind of method predicting the updating period of page is proposed, using the Poisson distribution-based model suggested by Brewington in studying page updating of search engine. This method calculates the expectation of page updating period with Newton iteration method according to historical statistical data then applies it in the subsequent updating strategy, also revises it in the practice in order to approach the real value; its goal is to get a good balance between freshness and resource utilization. Compared to traditional grouping-by-frequency method, algorithm complexity reduces significantly.
Keywords :
Newton method; Poisson distribution; Web sites; computational complexity; resource allocation; search engines; statistical analysis; Newton iteration method; Poisson distribution-based model; algorithm complexity; freshness; grouping-by-frequency method; historical statistical data; page updating period expectation; page updating prediction strategy; resource utilization; search engine; subsequent updating strategy; Algorithm design and analysis; Approximation methods; Crawlers; Educational institutions; Indexes; Mathematical model; Newton iteration method; Poisson distribution; expectations prediction; updating frequency;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Science and Network Technology (ICCSNT), 2011 International Conference on
Conference_Location :
Harbin
Print_ISBN :
978-1-4577-1586-0
Type :
conf
DOI :
10.1109/ICCSNT.2011.6182119
Filename :
6182119
Link To Document :
بازگشت