Title :
A Parameter-Adjustable Estimating Method for Change Frequency of Web Pages
Author :
Tan, Shuchen ; Zhang, Xuan
Author_Institution :
Inst. of Comput. Sci. & Eng., Xi´´an Univ. of Technol., Xi´´an, China
Abstract :
Refreshing on-line information in time is a main task of incremental crawling, so it is very important to predict the change frequency of web pages. We model the change of page as a Poisson process in this paper. And based on it, we propose a parameter-adjustable algorithm after considering the unbiasedness, efficiency and consistency comprehensively. This algorithm can adjust the parameters in order to estimate the change frequency more effective.
Keywords :
Web sites; information management; stochastic processes; Poisson process; Web page; change frequency; incremental crawling; online information; parameter adjustable estimating method; Biological system modeling; Frequency estimation; History; Mathematical model; Prediction algorithms; Time frequency analysis; Web pages; Poisson process; change frequency; incremental crawling; page change;
Conference_Titel :
E-Business and E-Government (ICEE), 2010 International Conference on
Conference_Location :
Guangzhou
Print_ISBN :
978-0-7695-3997-3
DOI :
10.1109/ICEE.2010.352
