Title :
Optimizing Bloom Filter Settings in Peer-to-Peer Multikeyword Searching
Author :
Chen, Hanhua ; Jin, Hai ; Chen, Lei ; Liu, Yunhao ; Ni, Lionel M.
Author_Institution :
Services Comput. Technol. & Syst. Lab., Huazhong Univ. of Sci. & Technol., Wuhan, China
fDate :
4/1/2012 12:00:00 AM
Abstract :
Peer-to-Peer multikeyword searching requires distributed intersection/union operations across wide area networks, raising a large amount of traffic cost. Existing schemes commonly utilize Bloom Filters (BFs) encoding to effectively reduce the traffic cost during the intersection/union operations. In this paper, we address the problem of optimizing the settings of a BF. We show, through mathematical proof, that the optimal setting of BF in terms of traffic cost is determined by the statistical information of the involved inverted lists, not the minimized false positive rate as claimed by previous studies. Through numerical analysis, we demonstrate how to obtain optimal settings. To better evaluate the performance of this design, we conduct comprehensive simulations on TREC WT10G test collection and query logs of a major commercial web search engine. Results show that our design significantly reduces the search traffic and latency of the existing approaches.
Keywords :
information filtering; numerical analysis; peer-to-peer computing; query processing; search engines; wide area networks; BF encoding; TREC WT10G test collection; Web search engine; bloom filter settings; bloom filters; distributed intersection; mathematical proof; numerical analysis; peer-to-peer multikeyword searching; query logs; statistical information; traffic cost reduction; union operations; wide area networks; Engines; Indexing; Metasearch; Peer to peer computing; Servers; Wide area networks; Bloom filter; DHT; P2P.; multikeyword search;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2011.14