Title :
GDCluster: A General Decentralized Clustering Algorithm
Author :
Mashayekhi, Hoda ; Habibi, Jafar ; Khalafbeigi, Tania ; Voulgaris, Spyros ; van Steen, Maarten
Author_Institution :
Dept. of Comput. Eng., Sharif Univ. of Technol., Tehran, Iran
Abstract :
In many popular applications like peer-to-peer systems, large amounts of data are distributed among multiple sources. Analysis of this data and identifying clusters is challenging due to processing, storage, and transmission costs. In this paper, we propose GDCluster, a general fully decentralized clustering method, which is capable of clustering dynamic and distributed data sets. Nodes continuously cooperate through decentralized gossip-based communication to maintain summarized views of the data set. We customize GDCluster for execution of the partition-based and density-based clustering methods on the summarized views, and also offer enhancements to the basic algorithm. Coping with dynamic data is made possible by gradually adapting the clustering model. Our experimental evaluations show that GDCluster can discover the clusters efficiently with scalable transmission cost, and also expose its supremacy in comparison to the popular method LSP2P.
Keywords :
costing; data analysis; distributed processing; pattern clustering; GDCluster; LSP2P; cluster identification; data analysis; decentralized gossip-based communication; density-based clustering method; distributed data set clustering; dynamic data set clustering; general decentralized clustering algorithm; partition-based clustering method; processing cost; storage cost; transmission cost; Approximation algorithms; Clustering algorithms; Data models; Distributed databases; Partitioning algorithms; Peer-to-peer computing; Vectors; Clustering; Density-based Clustering; Distributed Systems; Distributed systems; Dynamic System; Partition-based Clustering; clustering; density-based clustering; dynamic system; partition-based clustering;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2015.2391123
