A high performance redundancy scheme for cluster file systems

A known issue in the design of striped file systems is their vulnerability to disk failures. In this paper we address the challenges of augmenting an existing striped file system with traditional RAID redundancy, and proposed a novel redundancy scheme designed to maximize disk throughput seen by applications. We implement our new scheme in CSAR, a proof-of-concept redundant file system based on PVFS, along with two other well known schemes. Our tests using both microbenchmarks and representative scientific applications show that our scheme consistently performs as well as the best of the other two schemes. The application-dependent, potentially larger storage occupation of our scheme is justified by current technological trends that put I/O bandwidth at a premium over disk space.