• DocumentCode
    3588716
  • Title

    Smart MapReduce cloud: Applying extra processing to intermediate data on demand

  • Author

    Tzu-Chi Huang ; Kuo-Chih Chu ; Ming-Fong Tsai

  • Author_Institution
    Dept. of Electron. Eng., Lunghwa Univ. of Sci. & Technol., Taoyuan, Taiwan
  • fYear
    2014
  • Firstpage
    799
  • Lastpage
    804
  • Abstract
    Cloud computing is the emerging and attractive technology and provides users with various services in a pay-as-you-go manner. Cloud computing nowadays does not limit resources of the services in a cloud to the computers that are far away from users and connected to each other in a data center with high speed networks at the same geographic location. Cloud computing may present a cloud to users by connecting resources at multiple geographic locations. By connecting resources at multiple geographic locations to organize a cloud, cloud computing may meet problems of communication interception, congestion, and interruption. Cloud computing should have a way to supply extra processing on demand for certain links between computers separated geographically. Since a MapReduce cloud is the key to the success of the large-scale computation, cloud computing can use the Smart MapReduce Cloud (SMRC) proposed in this paper to apply extra processing to intermediate data on demand while intermediate data is delivered among computers in the MapReduce cloud. In experiments, cloud computing is tested with several popular MapReduce applications to observe performances of data encryption and compression via XOR and GZIP functions in SMRC.
  • Keywords
    cloud computing; data handling; parallel processing; GZIP function; XOR function; cloud computing; communication congestion; communication interception; communication interruption; data center; data compression; data encryption; geographic location; high speed networks; intermediate data; large-scale computation; pay-as-you-go manner; smart MapReduce cloud; Cloud computing; Computers; Databases; Encryption; Interrupters; Joining processes; Runtime; Cloud Computing; GZIP; Intermediate Data; MapReduce; SMRC; XOR;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Parallel and Distributed Systems (ICPADS), 2014 20th IEEE International Conference on
  • Type

    conf

  • DOI
    10.1109/PADSW.2014.7097885
  • Filename
    7097885