DocumentCode
1981786
Title
DBLK: Deduplication for primary block storage
Author
Tsuchiya, Yoshihiro ; Watanabe, Takashi
Author_Institution
Fujitsu Ltd., Atsugi, Japan
fYear
2011
fDate
23-27 May 2011
Firstpage
1
Lastpage
5
Abstract
The deduplication block-device (DBLK) is a deduplication and compression system with a block device interface. It is used as a primary storage and block-wise deduplication is done inline. Since deduplication for primary storage requires low latency and detecting block-wise deduplication creates a large amount of metadata, it is necessary to efficiently use the memory of the system. We solved this problem by developing a multilayer Bloom filter (MBF) to reduce the size of the data structure in the memory for indexing duplicate data.
Keywords
data compression; data structures; indexing; storage management; DBLK; block device interface; compression system; data structure; deduplication block-device; deduplication system; duplicate data indexing; multilayer Bloom filter; primary block storage; Data structures; File systems; Indexes; Information filters; Memory management; Redundancy; deduplication; storage system;
fLanguage
English
Publisher
ieee
Conference_Titel
Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on
Conference_Location
Denver, CO
ISSN
2160-195X
Print_ISBN
978-1-4577-0427-7
Electronic_ISBN
2160-195X
Type
conf
DOI
10.1109/MSST.2011.5937237
Filename
5937237
Link To Document