Title :
Dimensionality reduction particle swarm algorithm for high dimensional clustering
Author :
Cui, Xiaohui ; Beaver, Justin M. ; Charles, Jesse St ; Potok, Thomas E.
Author_Institution :
Comput. Sci. & Eng. Div., Oak Ridge Nat. Lab., Oak Ridge, TN
Abstract :
The Particle Swarm Optimization (PSO) clustering algorithm can generate more compact clustering results than the traditional K-means clustering algorithm. However, when clustering high dimensional datasets, the PSO clustering algorithm is notoriously slow because its computation cost increases exponentially with the size of the dataset dimension. Dimensionality reduction techniques offer solutions that both significantly improve the computation time, and yield reasonably accurate clustering results in high dimensional data analysis. In this paper, we introduce research that combines different dimensionality reduction techniques with the PSO clustering algorithm in order to reduce the complexity of high dimensional datasets and speed up the PSO clustering process. We report significant improvements in total runtime. Moreover, the clustering accuracy of the dimensionality reduction PSO clustering algorithm is comparable to the one that uses full dimension space.
Keywords :
data analysis; data reduction; particle swarm optimisation; pattern clustering; K-means clustering; PSO clustering; data analysis; dimensionality reduction; high dimensional clustering; particle swarm optimization; Approximation algorithms; Clustering algorithms; Computational efficiency; Data analysis; Data preprocessing; Frequency; Laboratories; Particle swarm optimization; Runtime; USA Councils;
Conference_Titel :
Swarm Intelligence Symposium, 2008. SIS 2008. IEEE
Conference_Location :
St. Louis, MO
Print_ISBN :
978-1-4244-2704-8
Electronic_ISBN :
978-1-4244-2705-5
DOI :
10.1109/SIS.2008.4668309