Title :
Why Reading Patterns Matter in Storage Coding & Scheduling Design
Author :
Ferner, Ulric J. ; Soljanin, Emina ; Medard, Muriel
Author_Institution :
Massachusetts Inst. of Technol., Cambridge, MA, USA
Abstract :
Coding techniques for storage systems are gaining traction in data center (DC) applications, owing to their data survivability performance, and more recently, to their ability to mitigate traffic congestion. This paper considers stochastic allocation schedules in networks that admit bulk file requests, across three drive blocking models. We consider a block-based code and a stochastic scheduling algorithm which is beneficial in the case of continuous chunk read patterns. In particular, we demonstrate that in systems with continuous chunk reading patterns, when drive blocking is either independent or from traffic congestion, block coded storage can reduce average download time by 10 -- 66%, given modern system parameters. However, a distinction should be made between systems with continuous and those with interrupted chunk read patterns. For interrupted chunk read systems, given our allocation algorithm that performs well for continuous reads, block coded storage performance can be worse than replication, numerical illustrations show relative losses over 66%. These illustrations demonstrate that to harness the full benefits of coded storage and to avoid pitfalls, careful attention must be paid to continuous vs. Interrupted chunk reading patterns, codes other than block codes should be considered, as could joint code-scheduling design.
Keywords :
block codes; cloud computing; computer centres; resource allocation; scheduling; stochastic processes; storage management; block coded storage performance; continuous chunk read patterns; data center; data survivability performance; drive blocking models; interrupted chunk read patterns; joint code-scheduling design; stochastic allocation scheduling algorithm; storage coding techniques; traffic congestion mitigation; Algorithm design and analysis; Analytical models; Block codes; Drives; Resource management; Scheduling; Blocking probability; bulk requests; cloud computing architectures; coded storage; design patterns; download time; file chunks; reading patterns; storage;
Conference_Titel :
Cloud Computing (CLOUD), 2015 IEEE 8th International Conference on
Conference_Location :
New York City, NY
Print_ISBN :
978-1-4673-7286-2
DOI :
10.1109/CLOUD.2015.55