Title :
DBLK: Deduplication for primary block storage
Author :
Tsuchiya, Yoshihiro ; Watanabe, Takashi
Author_Institution :
Fujitsu Ltd., Atsugi, Japan
Abstract :
The deduplication block-device (DBLK) is a deduplication and compression system with a block device interface. It is used as a primary storage and block-wise deduplication is done inline. Since deduplication for primary storage requires low latency and detecting block-wise deduplication creates a large amount of metadata, it is necessary to efficiently use the memory of the system. We solved this problem by developing a multilayer Bloom filter (MBF) to reduce the size of the data structure in the memory for indexing duplicate data.
Keywords :
data compression; data structures; indexing; storage management; DBLK; block device interface; compression system; data structure; deduplication block-device; deduplication system; duplicate data indexing; multilayer Bloom filter; primary block storage; Data structures; File systems; Indexes; Information filters; Memory management; Redundancy; deduplication; storage system;
Conference_Titel :
Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on
Conference_Location :
Denver, CO
Print_ISBN :
978-1-4577-0427-7
Electronic_ISBN :
2160-195X
DOI :
10.1109/MSST.2011.5937237