Title :
Implementing Hadoop Platform on Eucalyptus Cloud Infrastructure
Author :
Amiry, Vahid ; Rad, Shayan Zamani ; Akbari, Mohammad Kazem ; Javan, Morteza Sarglozai
Author_Institution :
Comput. Eng. & IT Dept., Qom Univ., Qom, Iran
Abstract :
Today, cloud computing is used as a model in most scientific, commercial, military, etc. In this model, the main body of the system is virtual servers, which currently provide services to customers around the world. Eucalyptus is an open source implementation of Cloud computing infrastructure that has a particular architecture. By using Eucalyptus, we can make public and private Clouds. Hadoop also is an open platform that is used for distributing data and jobs in large clusters. This platform can be used for processing and storing huge volumes of data and executing parallel jobs (e.g. analyzing system logs, weather data, and customer relationship behavior and so on.). In this article, we using integrating Hadoop platform on Eucalyptus infrastructure, facilitate and accelerate the deployment of a Hadoop cluster and moreover represent one of the uses of Eucalyptus system in serving services to the Cloud customers. It is worth mentioning that we have successfully implemented our method on the supercomputer of Amirkabir University and according to executed program on our cluster, efficiency has increased to about 80 percent in 32 cores compared to 4 cores clusters.
Keywords :
cloud computing; customer services; public domain software; software architecture; virtual machines; virtual storage; Eucalyptus cloud infrastructure; Hadoop cluster; cloud computing; cloud customer service; data processing; data storing; distributing data; open source architecture; parallel job execution; virtual server; Cloud computing; Computational modeling; Computer architecture; Computers; Educational institutions; File systems; Virtual machining; Cloud Computing; Eucalyptus; Hadoop; Virtual Machine;
Conference_Titel :
P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2012 Seventh International Conference on
Conference_Location :
Victoria, BC
Print_ISBN :
978-1-4673-2991-0
DOI :
10.1109/3PGCIC.2012.37