Title :
Improving distributed join efficiency with extended bloom filter operations
Author :
Michael, Loizos ; Nejdl, Wolfgang ; Papapetrou, Odysseas ; Siberski, Wolf
Author_Institution :
Div. of Eng. & Appl. Sci., Harvard Univ., Cambridge, MA
Abstract :
Bloom filter based algorithms have proven successful as very efficient technique to reduce communication costs of database joins in a distributed setting. However, the full potential of bloom filters has not yet been exploited. Especially in the case of multi-joins, where the data is distributed among several sites, additional optimization opportunities arise, which require new bloom filter operations and computations. In this paper, we present these extensions and point out how they improve the performance of such distributed joins. While the paper focuses on efficient join computation, the described extensions are applicable to a wide range of usages, where bloom filters are facilitated for compressed set representation.
Keywords :
distributed databases; compressed set representation; distributed database; distributed join efficiency; distributed setting; extended bloom filter operations; Costs; Counting circuits; Data engineering; Data structures; Distributed computing; Distributed databases; Information filtering; Information filters; Routing; Testing;
Conference_Titel :
Advanced Information Networking and Applications, 2007. AINA '07. 21st International Conference on
Conference_Location :
Niagara Falls, ON
Print_ISBN :
0-7695-2846-5
DOI :
10.1109/AINA.2007.80