• DocumentCode
    625947
  • Title

    Storage codes: Managing big data with small overheads

  • Author

    Datta, Amitava ; Oggier, Frederique

  • Author_Institution
    Nanyang Technol. Univ., Singapore, Singapore
  • fYear
    2013
  • fDate
    7-9 June 2013
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    Erasure coding provides a mechanism to store data redundantly for fault-tolerance in a cost-effective manner. Recently, there has been a renewed interest in designing new erasure coding techniques with different desirable properties, including good repairability and degraded read performance, or efficient redundancy generation processes. Very often, these novel techniques exploit the computational resources available `in the network´, i.e., leverage on storage units which are not passive entities supporting only read/write of data, but also can carry out some computations. This article accompanies an identically titled tutorial at the IEEE International Symposium on Network Coding (NetCod 2013), and portrays a big picture of some of the important processes within distributed storage systems, where erasure codes designed by explicitly taking into account the nuances of distributed storage systems can provide significant performance boosts.
  • Keywords
    network coding; IEEE International Symposium; big data management; computational resources; cost-effective manner; degraded read performance; distributed storage systems; erasure coding techniques; fault-tolerance; network coding; redundancy generation processes; storage codes; Bandwidth; Encoding; Fault tolerant systems; Maintenance engineering; Peer-to-peer computing; Redundancy; Data-insertion; Degraded reads; Erasure codes; Fault-tolerance; Repairability; Storage systems;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Network Coding (NetCod), 2013 International Symposium on
  • Conference_Location
    Calgary, AB
  • Print_ISBN
    978-1-4799-0821-9
  • Type

    conf

  • DOI
    10.1109/NetCod.2013.6570839
  • Filename
    6570839