• DocumentCode
    3089366
  • Title

    Performance Analysis of Hadoop for Query Processing

  • Author

    Wlodarczyk, Tomasz Wiktor ; Han, Yi ; Rong, Chunming

  • Author_Institution
    Dept. of Comput. Sci. & Electr. Eng., Univ. of Stavanger, Stavanger, Norway
  • fYear
    2011
  • fDate
    22-25 March 2011
  • Firstpage
    507
  • Lastpage
    513
  • Abstract
    Query processing using mostly various NoSQL languages becomes a significant application area for Hadoop. Despite significant work on performance improvement of these languages the performance dependence on basic configuration parameters seems not to be fully considered. In this paper we present a relatively comprehensive study into influence the basic configuration parameters have on performance of typical types of queries. We choose three queries from Lehigh University Benchmark that can represent the most typical challenges and we analyze their dependence on parameters such as: dataset size, number of nodes, number of reducers and loading overhead. The results indicate strong dependence on the amount of reducers and IO performance of the cluster, which proves the common opinion that MapReduce is IO bound. These results can help to compare performance behavior of different languages and serve as a basis for understanding the influence of configuration parameters on the final performance.
  • Keywords
    database management systems; query processing; Hadoop performance analysis; IO bound; Lehigh university benchmark; MapReduce; NoSQL languages; query processing; Benchmark testing; Database languages; Loading; Performance analysis; Query processing; Resource description framework; Web services; Amazon Web Services; Hadoop; LUBM; analysis; performance; query;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Advanced Information Networking and Applications (WAINA), 2011 IEEE Workshops of International Conference on
  • Conference_Location
    Biopolis
  • Print_ISBN
    978-1-61284-829-7
  • Electronic_ISBN
    978-0-7695-4338-3
  • Type

    conf

  • DOI
    10.1109/WAINA.2011.130
  • Filename
    5763552