• DocumentCode
    662851
  • Title

    HDFSbench: Understanding the Efficiency and Bottlenecks of Cloud File Systems

  • Author

    Jinquan Dai ; Tao Xie ; Shengsheng Huang ; Jie Huang

  • fYear
    2012
  • fDate
    19-20 June 2012
  • Firstpage
    6
  • Lastpage
    10
  • Abstract
    We have conducted intensive experiments on an in-house Hadoop cluster using HDFSbench (a file system benchmark tool we build for HDFS). Our experimental results provide valuable insights into the performance characteristics (e.g., general efficiency and potential bottlenecks) of cloud file systems for different application usages (e.g., MapReduce and Bigtable access patterns), and on how these traits change with new storage technologies (e.g., SSD vs. HDD).
  • Keywords
    benchmark testing; cloud computing; file organisation; storage media; HDFSbench; Hadoop Distributed File System; Hadoop cluster; benchmark tool; cloud file systems; storage technologies; Aggregates; Bandwidth; Benchmark testing; Clouds; Data models; Distributed databases; File systems; Big Data; HDFS; Hadoop;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Open Cirrus Summit (OCS), 2012 Seventh
  • Conference_Location
    Beijing
  • Type

    conf

  • DOI
    10.1109/OCS.2012.31
  • Filename
    6695831
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=662851