• DocumentCode
    3501716
  • Title

    An Alternate Downloading Methodology of Webpages

  • Author

    Kundu, Anirban ; Pal, Alok Ranjan ; Sarkar, Tanay ; Banerjee, Moutan ; Mandal, Subhendu ; Dattagupta, Rana ; Mukhopadhyay, Debajyoti

  • Author_Institution
    Netaji Subhash Eng. Coll., West Bengal Univ. of Technol., Kolkata
  • fYear
    2008
  • fDate
    27-31 Oct. 2008
  • Firstpage
    393
  • Lastpage
    398
  • Abstract
    We propose an advanced method for downloading Webpages from the Internet. In this technique, the whole system is considered as a bundle of crawlers which have been created dynamically at execution time. Numbers of crawlers are used depending on the requirement of downloading Webpages. The software module which interacts with WWW to search one or more Webpages is known as crawler. The numbers of crawlers are generated using the hierarchy structure of the Web server from which the data would be downloaded. Webpage downloader is an important issue for downloading Web documents from the Internet to facilitate a Web user in terms of knowledge gathering. This type of downloaders are very popular in the ´Information Technology´ field. All kinds of public data, accessible throughout the world without any authentication, can be retrieved any time from any geographic location using the downloading methodology. Typically, a downloading technique has been utilized to accumulate Webpages of different domains within a single computer machine one at a time. So, our aim in this paper is to show an advanced technique for downloading a lot of related Webpages with a minimum effort and time using hierarchical downloader consisting of several dynamic crawlers.
  • Keywords
    Internet; Web sites; file servers; Internet; Web server; Webpage downloader; downloading methodology; knowledge gathering; Artificial intelligence; Bandwidth; Crawlers; Earth; Educational institutions; Information retrieval; Internet; Uniform resource locators; Web sites; World Wide Web; Hierarchical downloading; Multi-downloading;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Artificial Intelligence, 2008. MICAI '08. Seventh Mexican International Conference on
  • Conference_Location
    Atizapan de Zaragoza
  • Print_ISBN
    978-0-7695-3441-1
  • Type

    conf

  • DOI
    10.1109/MICAI.2008.13
  • Filename
    4682494