Title :
Optimal locally repairable codes and connections to matroid theory
Author :
Tamo, Itzhak ; Papailiopoulos, Dimitris S. ; Dimakis, Alexandros G.
Author_Institution :
Dept. of ECE, Inst. for Syst. Res., Univ. of Maryland, College Park, MD, USA
Abstract :
Petabyte-scale distributed storage systems are currently transitioning to erasure codes to achieve higher storage efficiency. Classical codes like Reed-Solomon are highly suboptimal for distributed environments due to their high overhead in single-failure events. Locally Repairable Codes (LRCs) form a new family of codes that are repair efficient. In particular, LRCs minimize the number of nodes participating in single node repairs during which they generate small network traffic. Two large-scale distributed storage systems have already implemented different types of LRCs: Windows Azure Storage and the Hadoop Distributed File System RAID used by Facebook. The fundamental bounds for LRCs, namely the best possible distance for a given code locality, were recently discovered, but few explicit constructions exist. In this work, we present an explicit and simple to implement construction of optimal LRCs, for code parameters previously established by existence results. For the analysis of the optimality of our code, we derive a new result on the matroid represented by the code´s generator matrix.
Keywords :
Reed-Solomon codes; combinatorial mathematics; matrix algebra; telecommunication traffic; Facebook; LRC; Reed-Solomon code; code generator matrix; erasure code; hadoop distributed file system RAID; large-scale distributed storage system; matroid theory; network traffic; optimal locally repairable code; petabyte-scale distributed storage system; single-failure event; windows azure storage; Encoding; Generators; Maintenance engineering; Peer-to-peer computing; Polynomials; Reed-Solomon codes;
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
DOI :
10.1109/ISIT.2013.6620540