Title :
Smart MapReduce cloud: Applying extra processing to intermediate data on demand
Author :
Tzu-Chi Huang ; Kuo-Chih Chu ; Ming-Fong Tsai
Author_Institution :
Dept. of Electron. Eng., Lunghwa Univ. of Sci. & Technol., Taoyuan, Taiwan
Abstract :
Cloud computing is the emerging and attractive technology and provides users with various services in a pay-as-you-go manner. Cloud computing nowadays does not limit resources of the services in a cloud to the computers that are far away from users and connected to each other in a data center with high speed networks at the same geographic location. Cloud computing may present a cloud to users by connecting resources at multiple geographic locations. By connecting resources at multiple geographic locations to organize a cloud, cloud computing may meet problems of communication interception, congestion, and interruption. Cloud computing should have a way to supply extra processing on demand for certain links between computers separated geographically. Since a MapReduce cloud is the key to the success of the large-scale computation, cloud computing can use the Smart MapReduce Cloud (SMRC) proposed in this paper to apply extra processing to intermediate data on demand while intermediate data is delivered among computers in the MapReduce cloud. In experiments, cloud computing is tested with several popular MapReduce applications to observe performances of data encryption and compression via XOR and GZIP functions in SMRC.
Keywords :
cloud computing; data handling; parallel processing; GZIP function; XOR function; cloud computing; communication congestion; communication interception; communication interruption; data center; data compression; data encryption; geographic location; high speed networks; intermediate data; large-scale computation; pay-as-you-go manner; smart MapReduce cloud; Cloud computing; Computers; Databases; Encryption; Interrupters; Joining processes; Runtime; Cloud Computing; GZIP; Intermediate Data; MapReduce; SMRC; XOR;
Conference_Titel :
Parallel and Distributed Systems (ICPADS), 2014 20th IEEE International Conference on
DOI :
10.1109/PADSW.2014.7097885