Simulation and analysis applied on virtualization to build Hadoop clusters

Author

Spadon de Souza, Gabriel ; Messias Correia, Ronaldo Celso ; Garcia, Rogerio Eduardo ; Olivete, Celso

Author_Institution

Fac. de Cienc. e Tecnol., Dept. de Mat. e Comput. (DMC), UNESP, Presidente Prudente, Brazil

fYear

2015

fDate

17-20 June 2015

Firstpage

1

Lastpage

7

Abstract

The data growth enhances the need of a method and paradigms responsible to deal with high scalability, reliability and fault tolerance in large amounts of data. Big Data is a framework capable of dealing with this need. This research makes usage of Apache Hadoop, and a Virtual Private Server (VPS) to analyze the performance through benchmark tests executed on locally, geographically distributed, and centralized Hadoop computational layout. The result from the simulations metrics, and performance analyses are compared to real servers and introduce an alternative model implemented with a tunnel protocol that enhance the processing power of the cluster.

Keywords

Big Data; parallel processing; pattern clustering; protocols; virtualisation; Apache Hadoop; Big Data; Hadoop cluster; VPS; benchmark test; centralized Hadoop computational layout; data growth; fault tolerance; performance analysis; reliability; simulations metric; tunnel protocol; virtual private server; virtualization; Benchmark testing; Big data; Computational modeling; Data models; Hardware; Heating; Servers; Benchmark; Big Data; Cluster; Hadoop; Scalability; Tunnel Protocol;

fLanguage

English

Publisher

ieee

Conference_Titel

Information Systems and Technologies (CISTI), 2015 10th Iberian Conference on

Conference_Location

Aveiro

Type

conf

DOI

10.1109/CISTI.2015.7170466

Filename

7170466