Title :
Load Rebalancing in Large-Scale Distributed File System
Author :
Zeng, Wenqiu ; Li, Ying ; Wu, Jian ; Zhong, Qingqing ; Zhang, Qi
Author_Institution :
Coll. of Comput. Sci. & Technol., Zhejiang Univ., Hangzhou, China
Abstract :
With the development of internet technology, the entire amount of data on the internet has shown the explosive growth. Some researchers have paid their attention to find an effective way to store and manage these data. In this paper, we introduce a load rebalancing algorithm to solve the load balancing problem among all chunk servers(compute nodes) in the distributed file system; it also ensures that one chunk(file block) of a file and its two copies are stored in three different chunk servers at the same time. This algorithm achieves the load balancing while ensuring the reliability of the system.
Keywords :
Internet; file organisation; resource allocation; Internet technology; chunk servers; large-scale distributed file system; load rebalancing; system reliability; Bandwidth; Data engineering; File servers; File systems; Information science; Internet; Large-scale systems; Load management; Network servers; Telecommunication traffic;
Conference_Titel :
Information Science and Engineering (ICISE), 2009 1st International Conference on
Conference_Location :
Nanjing
Print_ISBN :
978-1-4244-4909-5
DOI :
10.1109/ICISE.2009.719