• DocumentCode
    60064
  • Title

    Fast Bloom Filters and Their Generalization

  • Author

    Yan Qiao ; Tao Li ; Shigang Chen

  • Author_Institution
    Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
  • Volume
    25
  • Issue
    1
  • fYear
    2014
  • fDate
    Jan. 2014
  • Firstpage
    93
  • Lastpage
    103
  • Abstract
    Bloom filters have been extensively applied in many network functions. Their performance is judged by three criteria: query overhead, space requirement, and false positive ratio. Due to wide applicability, any improvement to the performance of Bloom filters can potentially have a broad impact in many areas of networking research. In this paper, we study Bloom-1, a data structure that performs membership check in one memory access, which compares favorably with the k memory accesses of a standard Bloom filter. We also generalize Bloom-1 to Bloom-g and Bloom-Q, allowing performance tradeoff between membership query overhead and false positive ratio. We thoroughly examine the variants in this family of filters, and show that they can be configured to outperform the Bloom filters with a smaller number of memory accesses, a smaller or equal number of hash bits, and a smaller or comparable false positive ratio in practical scenarios. We also perform experiments based on a real traffic trace to support our filter design.
  • Keywords
    data structures; Bloom-1 data structure; Bloom-Q; Bloom-g; false positive ratio; fast Bloom filters; filter design; generalization; membership check; memory access; network functions; networking research; query overhead; space requirement; traffic trace; Arrays; Hardware; Information filtering; Memory management; Random access memory; Throughput; Bloom filter; false positive; hash requirement; memory access;
  • fLanguage
    English
  • Journal_Title
    Parallel and Distributed Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9219
  • Type

    jour

  • DOI
    10.1109/TPDS.2013.46
  • Filename
    6464259