Title :
A File Level RAID in Blue Whale File System
Author :
Liu, ZhenHan ; Meng, Xiaoxuan ; Xu, Lu
Author_Institution :
Inst. of Comput. Technol., Grad. Univ. of the Chinese Acad. of Sci., Beijing, China
Abstract :
Blue Whale File System (BWFS) is a distributed file system with proven high performance and high scalability. In order to provide high reliability for BWFS, we designed and implemented a new architecture named BW-FILERAID, which combines distributed file system well with the RAID technology. BW-FILERAID uses client-driven file-level RAID to satisfy the requirement of reliability and optimizes the RAID performance by utilizing the file system information. The schemes of Dynamic Stripe Allocation (DSA) and Asynchronous Parity Calculating (APC) are proposed to reduce the impact of small write performance problem which is incurred by classic RAID5 implementation. This paper introduces and evaluates BW-FILERAID. As compared with the Linux software RAID5 systems, BW-FILERAID can achieve significantly higher WRITE performance which increases by 8.2~25.9% while with the same READ performance as RAID0. At last, BW-FILERAID also has very good system scalability.
Keywords :
distributed processing; file organisation; Linux software; RAID5 implementation; asynchronous parity calculating; blue whale file system; distributed file system; dynamic stripe allocation; file level RAID technology; file system information; redundant array of independent disks; File systems; Linux; Reliability; Scalability; Whales; Writing; RAID; filesystem; high reliability;
Conference_Titel :
High Performance Computing and Communications (HPCC), 2011 IEEE 13th International Conference on
Conference_Location :
Banff, AB
Print_ISBN :
978-1-4577-1564-8
Electronic_ISBN :
978-0-7695-4538-7
DOI :
10.1109/HPCC.2011.79
