DocumentCode :
1419033
Title :
Optimizing Bloom Filter Settings in Peer-to-Peer Multikeyword Searching
Author :
Chen, Hanhua ; Jin, Hai ; Chen, Lei ; Liu, Yunhao ; Ni, Lionel M.
Author_Institution :
Services Comput. Technol. & Syst. Lab., Huazhong Univ. of Sci. & Technol., Wuhan, China
Volume :
24
Issue :
4
fYear :
2012
fDate :
4/1/2012 12:00:00 AM
Firstpage :
692
Lastpage :
706
Abstract :
Peer-to-Peer multikeyword searching requires distributed intersection/union operations across wide area networks, raising a large amount of traffic cost. Existing schemes commonly utilize Bloom Filters (BFs) encoding to effectively reduce the traffic cost during the intersection/union operations. In this paper, we address the problem of optimizing the settings of a BF. We show, through mathematical proof, that the optimal setting of BF in terms of traffic cost is determined by the statistical information of the involved inverted lists, not the minimized false positive rate as claimed by previous studies. Through numerical analysis, we demonstrate how to obtain optimal settings. To better evaluate the performance of this design, we conduct comprehensive simulations on TREC WT10G test collection and query logs of a major commercial web search engine. Results show that our design significantly reduces the search traffic and latency of the existing approaches.
Keywords :
information filtering; numerical analysis; peer-to-peer computing; query processing; search engines; wide area networks; BF encoding; TREC WT10G test collection; Web search engine; bloom filter settings; bloom filters; distributed intersection; mathematical proof; numerical analysis; peer-to-peer multikeyword searching; query logs; statistical information; traffic cost reduction; union operations; wide area networks; Engines; Indexing; Metasearch; Peer to peer computing; Servers; Wide area networks; Bloom filter; DHT; P2P.; multikeyword search;
fLanguage :
English
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
Publisher :
ieee
ISSN :
1041-4347
Type :
jour
DOI :
10.1109/TKDE.2011.14
Filename :
5680903
Link To Document :
بازگشت