A File Level RAID in Blue Whale File System

Author

Liu, ZhenHan ; Meng, Xiaoxuan ; Xu, Lu

Author_Institution

Inst. of Comput. Technol., Grad. Univ. of the Chinese Acad. of Sci., Beijing, China

fYear

2011

fDate

2-4 Sept. 2011

Firstpage

563

Lastpage

568

Abstract

Blue Whale File System (BWFS) is a distributed file system with proven high performance and high scalability. In order to provide high reliability for BWFS, we designed and implemented a new architecture named BW-FILERAID, which combines distributed file system well with the RAID technology. BW-FILERAID uses client-driven file-level RAID to satisfy the requirement of reliability and optimizes the RAID performance by utilizing the file system information. The schemes of Dynamic Stripe Allocation (DSA) and Asynchronous Parity Calculating (APC) are proposed to reduce the impact of small write performance problem which is incurred by classic RAID5 implementation. This paper introduces and evaluates BW-FILERAID. As compared with the Linux software RAID5 systems, BW-FILERAID can achieve significantly higher WRITE performance which increases by 8.2~25.9% while with the same READ performance as RAID0. At last, BW-FILERAID also has very good system scalability.

Keywords

distributed processing; file organisation; Linux software; RAID5 implementation; asynchronous parity calculating; blue whale file system; distributed file system; dynamic stripe allocation; file level RAID technology; file system information; redundant array of independent disks; File systems; Linux; Reliability; Scalability; Whales; Writing; RAID; filesystem; high reliability;

fLanguage

English

Publisher

ieee

Conference_Titel

High Performance Computing and Communications (HPCC), 2011 IEEE 13th International Conference on

Conference_Location

Banff, AB

Print_ISBN

978-1-4577-1564-8

Electronic_ISBN

978-0-7695-4538-7

Type

conf

DOI

10.1109/HPCC.2011.79

Filename

6063040