Title :
HTSC and FH_HTSC: XOR-based codes to reduce access latency in distributed storage systems
Author :
Qiqi Shuai ; Li, Victor O. K.
Author_Institution :
Dept. of Electr. & Electron. Eng., Univ. of Hong Kong, Hong Kong, China
Abstract :
A massive distributed storage system is the foundation for big data operations. Access latency performance is a key metric in distributed storage systems since it greatly impacts user experience while existing codes mainly focus on improving performance such as storage overhead and repair cost. By generating parity nodes from parity nodes, in this paper we design new XOR-based erasure codes hierarchical tree structure code (HTSC) and high failure tolerant HTSC (FH_HTSC) to reduce access latency in distributed storage systems. By comparing with other popular and representative codes, we show that, under the same repair cost, HTSC and FH.HTSC codes can reduce access latency while maintaining favorable performance in other metrics. In particular, under the same repair cost, FH.HTSC can achieve lower access latency, higher or equal failure tolerance and lower computation cost compared with the representative codes while enjoying similar storage overhead. Accordingly, FH.HTSC is a superior choice for applications requiring low access latency and outstanding failure tolerance capability at the same time.
Keywords :
codes; tree data structures; FH HTSC codes; XOR-based erasure codes; access latency performance; computation cost; distributed storage systems; failure tolerance capability; hierarchical tree structure code; high failure tolerant HTSC; representative codes; Bandwidth; Encoding; Google; Maintenance engineering; Measurement; Reliability; Vegetation; Access latency; computation cost; erasure codes; failure tolerance; repair cost; storage overhead;
Journal_Title :
Communications and Networks, Journal of
DOI :
10.1109/JCN.2015.000105