DocumentCode :
2944631
Title :
Quasi-cyclic Minimum Storage Regenerating Codes for Distributed Data Compression
Author :
Gastón, Bernat ; Pujol, Jaume ; Villanueva, Mercè
Author_Institution :
Dept. of Inf. & Commun. Eng., Autonomous Univ. of Barcelona, Cerdanyola del Valles, Spain
fYear :
2011
fDate :
29-31 March 2011
Firstpage :
33
Lastpage :
42
Abstract :
Nowadays, it is possible to optimize the storage size of large files in distributed environments, maintaining the same availability level in the system. Although replication (backups) is the most used option, it is possible to make use of erasure coding in order to significantly compress the storage size [1]. However, using erasure coding, more information needs to be transmitted than when using replication, in order to replace a node which has failed. This is called the code repair problem. The amount of transmitted information can be an important issue when the file size is very large. If network coding is used in conjunction with erasure codes, the transmitted information can be reduced by compressing the sent data in the regeneration phase. This solution minimizes the code repair problem and consists of the use of regenerating codes introduced by Dimakis et al. [2]. Nevertheless, using network coding, computational resources for any node in the system are required, since linear operations must be carried out and systems of equations must be solved in the nodes. This requirement is too strong for many simple storage devices [3]. In this paper a new family of Minimum Storage Regenerating codes is proposed. These codes not only compress the storage size using erasure coding and achieve optimality for the amount of transmitted information when d = k + 1, but also demand few computational requirements. Therefore, they could be used for simple hard discs without computational resources.
Keywords :
computational complexity; cyclic codes; data compression; distributed databases; fault tolerance; forward error correction; optimisation; code repair problem; distributed data compression; erasure coding; quasi-cyclic minimum storage regenerating code; Bandwidth; Distributed databases; Encoding; Equations; Maintenance engineering; Network coding; Redundancy; Regenerating codes; distributed data compression; distributed storage; error-correcting;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Data Compression Conference (DCC), 2011
Conference_Location :
Snowbird, UT
ISSN :
1068-0314
Print_ISBN :
978-1-61284-279-0
Type :
conf
DOI :
10.1109/DCC.2011.11
Filename :
5749461
Link To Document :
بازگشت