Title :
Fast log-based concurrent writing of checkpoints
Author :
Polte, Milo ; Simsa, Liri ; Tantisiriroj, Wittawat ; Gibson, Garth ; Dayal, Shobhit ; Chainani, Mikhail ; Uppugandla, Dilip Kumar
Author_Institution :
Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
Abstract :
This report describes how a file system level log-based technique can improve the write performance of many-to-one write checkpoint workload typical for high performance computations. It is shown that a simple log-based organization can provide for substantial improvements in the write performance while retaining the convenience of a single flat file abstraction. The improvement of the write performance comes at the cost of degraded read performance however. Techniques to alleviate the read performance penalty, such as file reconstruction on the first read, are discussed.
Keywords :
checkpointing; file organisation; parallel processing; file system level log-based technique; many-to-one write checkpoint workload; parallel file system; Application software; Computer science; Concurrent computing; Costs; Degradation; Delay; File systems; High performance computing; Image reconstruction; Writing;
Conference_Titel :
Petascale Data Storage Workshop, 2008. PDSW '08. 3rd
Conference_Location :
Austin, TX
Print_ISBN :
978-1-4244-4208-9
DOI :
10.1109/PDSW.2008.4811882