Title :
Pre-calculated equation-based decoding in failure-tolerant distributed storage
Author_Institution :
Inst. of Comput. Eng., Univ. of Luebeck, Lubeck, Germany
Abstract :
Data distribution together with erasure-tolerant codes allow to store data reliably, even with failed or temporarily disconnected storage resources. The encoding algorithm, i.e. the calculation of the codewords is expressed by XOR equations. Even decoding is the execution of a failure-specific set of equations that are build code-specifically and with knowledge of the failure situation. A new concept for a storage system is to provide encoding equations and decoding equations in advance, as a full description of the code which eliminates the calculations to obtain the recovery strategy. This concept includes that also decoding equations have to be provided in advance, for many different failure situations. This results in a large number of equations and may require a considerable amount of memory, but still a moderate amount - which can be traded for the gained flexibility and simplicity. In this paper we analyze the storage consumption of such a preprocessed decoding equation set. Furthermore, a data structure to access the required equations is proposed. It is shown that codes can be translated into equation sets that are used as parameter set by a storage system.
Keywords :
data structures; decoding; encoding; fault tolerance; storage management; XOR equations; data distribution; decoding equations; encoding equations; erasure-tolerant codes; failure-tolerant distributed storage; pre-calculated equation-based decoding; Data engineering; Data structures; Differential equations; Distributed computing; Encoding; Iterative decoding; Redundancy; Reliability engineering; Solid state circuits;
Conference_Titel :
Parallel & Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on
Conference_Location :
Rome
Print_ISBN :
978-1-4244-3751-1
Electronic_ISBN :
1530-2075
DOI :
10.1109/IPDPS.2009.5160904