An effective file migration algorithm in cluster file systems

Author

Liu, Wei ; Zheng, Weimin ; Shen, Meiming ; Ou, Xinming ; Wu, Min

Author_Institution

Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China

fYear

2000

fDate

2000

Firstpage

329

Lastpage

335

Abstract

I/O balancing is an attractive problem in distributed systems. With the fast growth of high-speed network technology, file migration is becoming an effective way to solve the problem. We present an effective file migration algorithm in our cluster file system - TH-CluFS. Our algorithm moves files from congested nodes to relatively uncongested nodes according to the information of current system states. The algorithm makes each file migration beneficial to the mean response time of file requests. Moreover we use simulation to demonstrate that file migration can improve system overall performance greatly in cluster file systems. Our results indicate that the cluster system with file migration algorithm not only achieves higher scalability and more powerful processing capability, but also makes the effect of network traffic reduced about 12%

Keywords

client-server systems; input-output programs; network operating systems; resource allocation; storage allocation; workstation clusters; I/O balancing; TH-CluFS; cluster file systems; congested nodes; distributed systems; file migration algorithm; file requests; high-speed network technology; mean response time; network traffic; simulation; Clustering algorithms; Degradation; Delay; Ethernet networks; File systems; High-speed networks; Internet; System performance; Telecommunication traffic; Web server;

fLanguage

English

Publisher

ieee

Conference_Titel

Parallel Processing, 2000. Proceedings. 2000 International Workshops on

Conference_Location

Toronto, Ont.

ISSN

1530-2016

Print_ISBN

0-7695-0771-9

Type

conf

DOI

10.1109/ICPPW.2000.869119

Filename

869119