• DocumentCode
    3585107
  • Title

    PSA: A Performance and Space-Aware Data Layout Scheme for Hybrid Parallel File Systems

  • Author

    Shuibing He ; Yan Liu ; Xian-He Sun

  • Author_Institution
    Sch. of Comput., Wuhan Univ., Wuhan, China
  • fYear
    2014
  • Firstpage
    41
  • Lastpage
    48
  • Abstract
    The underlying storage of hybrid parallel file systems (PFS) is composed of both SSD-based file servers (SServer) and HDD-based file servers (HServer). Unlike a traditional HServer, an SServer consistently provides improved storage performance but lacks storage space. However, most current data layout schemes do not consider the differences in performance and space between heterogeneous servers, and may significantly degrade the performance of the hybrid PFSs. In this paper, we propose PSA, a novel data layout scheme, which maximizes the hybrid PFSs performance by applying adaptive varied-size file stripes. PSA dispatches data on heterogeneous file servers not only based on storage performance but also storage space. We have implemented PSA within OrangeFS, a popular parallel file system in the HPC domain. Our extensive experiments using a representative benchmark show that PSA provides superior I/O throughput than the default and performance-aware file data layout schemes.
  • Keywords
    disc drives; file servers; flash memories; hard discs; input-output programs; parallel processing; storage management; HDD-based file servers; HPC domain; HServer; OrangeFS parallel file system; PSA data layout scheme; SSD-based file servers; SServer; adaptive varied-size file stripes; heterogeneous file servers; hybrid PFS; hybrid parallel file systems; performance and space-aware data layout scheme; superior I/O throughput; Benchmark testing; Layout; Media; Optimization; Performance evaluation; Servers; Throughput; Parallel I/O System; Parallel File system; Data Layout; Solid State Drive;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Intensive Scalable Computing Systems (DISCS), 2014 International Workshop on
  • Type

    conf

  • DOI
    10.1109/DISCS.2014.10
  • Filename
    7079025