DocumentCode :
3501716
Title :
An Alternate Downloading Methodology of Webpages
Author :
Kundu, Anirban ; Pal, Alok Ranjan ; Sarkar, Tanay ; Banerjee, Moutan ; Mandal, Subhendu ; Dattagupta, Rana ; Mukhopadhyay, Debajyoti
Author_Institution :
Netaji Subhash Eng. Coll., West Bengal Univ. of Technol., Kolkata
fYear :
2008
fDate :
27-31 Oct. 2008
Firstpage :
393
Lastpage :
398
Abstract :
We propose an advanced method for downloading Webpages from the Internet. In this technique, the whole system is considered as a bundle of crawlers which have been created dynamically at execution time. Numbers of crawlers are used depending on the requirement of downloading Webpages. The software module which interacts with WWW to search one or more Webpages is known as crawler. The numbers of crawlers are generated using the hierarchy structure of the Web server from which the data would be downloaded. Webpage downloader is an important issue for downloading Web documents from the Internet to facilitate a Web user in terms of knowledge gathering. This type of downloaders are very popular in the ´Information Technology´ field. All kinds of public data, accessible throughout the world without any authentication, can be retrieved any time from any geographic location using the downloading methodology. Typically, a downloading technique has been utilized to accumulate Webpages of different domains within a single computer machine one at a time. So, our aim in this paper is to show an advanced technique for downloading a lot of related Webpages with a minimum effort and time using hierarchical downloader consisting of several dynamic crawlers.
Keywords :
Internet; Web sites; file servers; Internet; Web server; Webpage downloader; downloading methodology; knowledge gathering; Artificial intelligence; Bandwidth; Crawlers; Earth; Educational institutions; Information retrieval; Internet; Uniform resource locators; Web sites; World Wide Web; Hierarchical downloading; Multi-downloading;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Artificial Intelligence, 2008. MICAI '08. Seventh Mexican International Conference on
Conference_Location :
Atizapan de Zaragoza
Print_ISBN :
978-0-7695-3441-1
Type :
conf
DOI :
10.1109/MICAI.2008.13
Filename :
4682494
Link To Document :
بازگشت