• DocumentCode
    1981786
  • Title

    DBLK: Deduplication for primary block storage

  • Author

    Tsuchiya, Yoshihiro ; Watanabe, Takashi

  • Author_Institution
    Fujitsu Ltd., Atsugi, Japan
  • fYear
    2011
  • fDate
    23-27 May 2011
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    The deduplication block-device (DBLK) is a deduplication and compression system with a block device interface. It is used as a primary storage and block-wise deduplication is done inline. Since deduplication for primary storage requires low latency and detecting block-wise deduplication creates a large amount of metadata, it is necessary to efficiently use the memory of the system. We solved this problem by developing a multilayer Bloom filter (MBF) to reduce the size of the data structure in the memory for indexing duplicate data.
  • Keywords
    data compression; data structures; indexing; storage management; DBLK; block device interface; compression system; data structure; deduplication block-device; deduplication system; duplicate data indexing; multilayer Bloom filter; primary block storage; Data structures; File systems; Indexes; Information filters; Memory management; Redundancy; deduplication; storage system;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on
  • Conference_Location
    Denver, CO
  • ISSN
    2160-195X
  • Print_ISBN
    978-1-4577-0427-7
  • Electronic_ISBN
    2160-195X
  • Type

    conf

  • DOI
    10.1109/MSST.2011.5937237
  • Filename
    5937237