Title :
Crawler intelligence with machine learning and Data Mining integration
Author :
Darshakar, Abhiraj
Author_Institution :
Dept. of Electron. & Telecommun., Pune Inst. of Comput. Technol., Pune, India
Abstract :
This paper presents a study conducted on intelligent crawlers used in search engines, competitive intelligence etc. Data mining algorithms identified by IEEE International Conference on Data Mining (ICDM) were used to aid machine learning and introduce intelligence into the crawler. A statistical analysis of performance of intelligent crawler is presented in this paper. Further in this paper the data mining algorithms are compared on basis of usability in crawlers.
Keywords :
data mining; learning (artificial intelligence); search engines; statistical analysis; competitive intelligence; crawler intelligence; data mining integration; intelligent crawlers; machine learning; search engines; statistical analysis; Algorithm design and analysis; Classification algorithms; Clustering algorithms; Crawlers; Data mining; Support vector machines; Training data; C4.5; Crawler; Data mining; K-mean; Machine Learning; Support Vector Machine; Web Intelligence;
Conference_Titel :
Pervasive Computing (ICPC), 2015 International Conference on
Conference_Location :
Pune
DOI :
10.1109/PERVASIVE.2015.7087203
