Title :
TH-CluFS: an open platform cluster file system
Author :
Huang, Qifeng ; Zheng, Weimin ; Shen, Meiming
Author_Institution :
Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Abstract :
In this paper, we present the design and implementation of a new cluster file system, TH-CluFS, which is based on the standard NFS protocol and is implemented in the user level space completely. This open platform file system is important as the clusters become larger and heterogeneous. To take advantages of the accumulated resources and high-speed network in clusters, TH-CluFS follows a serverless architecture, hybrid distributed metadata management, and file granular data distribution, and it uses distributed metadata cache and unique cache to optimize performance. For the flexibility of TH-CluFS, we plan to employ file migration to balance I/O load across nodes dynamically. According to the experiment results, we conclude that TH-CluFS can meet the requirements of consistent file system view, performance and scalability gracefully.
Keywords :
cache storage; file organisation; memory protocols; meta data; NFS protocol; TH-CluFS; balance I/O load; cluster file system; distributed metadata cache; file granular data distribution; file migration; hybrid distributed metadata management; open platform file system; serverless architecture; unique cache; Computer networks; Computer science; Concurrent computing; File systems; High performance computing; High-speed networks; Kernel; Load management; Scalability; Space technology;
Conference_Titel :
Algorithms and Architectures for Parallel Processing, 2002. Proceedings. Fifth International Conference on
Conference_Location :
Beijing, China
Print_ISBN :
0-7695-1512-6
DOI :
10.1109/ICAPP.2002.1173551