DocumentCode
3089366
Title
Performance Analysis of Hadoop for Query Processing
Author
Wlodarczyk, Tomasz Wiktor ; Han, Yi ; Rong, Chunming
Author_Institution
Dept. of Comput. Sci. & Electr. Eng., Univ. of Stavanger, Stavanger, Norway
fYear
2011
fDate
22-25 March 2011
Firstpage
507
Lastpage
513
Abstract
Query processing using mostly various NoSQL languages becomes a significant application area for Hadoop. Despite significant work on performance improvement of these languages the performance dependence on basic configuration parameters seems not to be fully considered. In this paper we present a relatively comprehensive study into influence the basic configuration parameters have on performance of typical types of queries. We choose three queries from Lehigh University Benchmark that can represent the most typical challenges and we analyze their dependence on parameters such as: dataset size, number of nodes, number of reducers and loading overhead. The results indicate strong dependence on the amount of reducers and IO performance of the cluster, which proves the common opinion that MapReduce is IO bound. These results can help to compare performance behavior of different languages and serve as a basis for understanding the influence of configuration parameters on the final performance.
Keywords
database management systems; query processing; Hadoop performance analysis; IO bound; Lehigh university benchmark; MapReduce; NoSQL languages; query processing; Benchmark testing; Database languages; Loading; Performance analysis; Query processing; Resource description framework; Web services; Amazon Web Services; Hadoop; LUBM; analysis; performance; query;
fLanguage
English
Publisher
ieee
Conference_Titel
Advanced Information Networking and Applications (WAINA), 2011 IEEE Workshops of International Conference on
Conference_Location
Biopolis
Print_ISBN
978-1-61284-829-7
Electronic_ISBN
978-0-7695-4338-3
Type
conf
DOI
10.1109/WAINA.2011.130
Filename
5763552
Link To Document