• DocumentCode
    3120701
  • Title

    Fast log-based concurrent writing of checkpoints

  • Author

    Polte, Milo ; Simsa, Liri ; Tantisiriroj, Wittawat ; Gibson, Garth ; Dayal, Shobhit ; Chainani, Mikhail ; Uppugandla, Dilip Kumar

  • Author_Institution
    Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
  • fYear
    2008
  • fDate
    17-17 Nov. 2008
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    This report describes how a file system level log-based technique can improve the write performance of many-to-one write checkpoint workload typical for high performance computations. It is shown that a simple log-based organization can provide for substantial improvements in the write performance while retaining the convenience of a single flat file abstraction. The improvement of the write performance comes at the cost of degraded read performance however. Techniques to alleviate the read performance penalty, such as file reconstruction on the first read, are discussed.
  • Keywords
    checkpointing; file organisation; parallel processing; file system level log-based technique; many-to-one write checkpoint workload; parallel file system; Application software; Computer science; Concurrent computing; Costs; Degradation; Delay; File systems; High performance computing; Image reconstruction; Writing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Petascale Data Storage Workshop, 2008. PDSW '08. 3rd
  • Conference_Location
    Austin, TX
  • Print_ISBN
    978-1-4244-4208-9
  • Type

    conf

  • DOI
    10.1109/PDSW.2008.4811882
  • Filename
    4811882