A Large-scale and Decentralized Infrastructure for Content-based Publish/Subscribe Services

Publish/subscribe model has become a prevalent paradigm for building distributed event delivering systems. Content-based publish/subscribe allows high expresses in subscriptions and thus is more appropriate for content dissemination. However, the scalability has remained a challenge in the design of distributed content-based publish/subscribe systems due to the expensive matching and delivering cost of content-based events. In this paper we propose HyperSub, an infrastructure built on top of distributed hash table (DHT) for efficient content-based data distribution. Based on efficient subscription installation, event publication and event delivery mechanisms, Hyper- Sub can provide a scalable platform to simultaneously support any numbers of pub/sub schemes with different number of attributes. There are three key features in the design of HyperSub: (1) a locality-preserving hashing mechanism which partitions the content space into content zones. Subscriptions and events are mapped to the content zones for efficiently matching; (2) an efficient event delivery algorithm which exploits the embedded trees in the underlying DHT to deliver events to the corresponding subscribers; (3) light-weighted load balancing mechanisms to adjust the load among peers and ensure that no peer is unduly loaded.