Title :
A model of Erasure-Coding-Based Distributed File System
Author :
Yuanbo Han ; Hui Li ; Hanxu Hou
Author_Institution :
Shenzhen Grad. Sch., Adv. Network Technol. Lab., Peking Univ., Shenzhen, China
Abstract :
Today´s exponential growth in network bandwidth and storage capacity has inspired different classes of distributed storage infrastructures. However replication has become the actual way for storing data across data centers, no matter the system is centralized framework or peer-to-peer infrastructure. Erasure code, which is well researched and more space efficient than replication, has multiple tradeoffs that need to be seriously considered. In this paper, we present an erasure-coding-based model coupled with hadoop library, and we call it the Erasure-Coding-Based Distributed File System. We discuss the detailed design of our model and provide some recommendations on other coding strategy for distributed file systems.
Keywords :
computer centres; distributed databases; encoding; network operating systems; software libraries; centralized framework; coding strategy; data centers; data storage; distributed file systems; distributed storage infrastructures; erasure code; erasure-coding-based distributed file system; erasure-coding-based model; hadoop library; network bandwidth; peer-to-peer infrastructure; storage capacity; Distributed File System; Erasure Code; Hadoop;
Conference_Titel :
Cloud Computing Congress (APCloudCC), 2012 IEEE Asia Pacific
Conference_Location :
Shenzhen
Print_ISBN :
978-1-4673-2903-3
Electronic_ISBN :
978-1-4673-2902-6
DOI :
10.1109/APCloudCC.2012.6486519
