Title :
Feature weighing for efficient clustering
Author :
Ahmad, Waseem ; Narayanan, Ajit
Author_Institution :
Sch. of Comput. & Math. Sci., Auckland Univ. of Technol. (AUT), Auckland, New Zealand
fDate :
Nov. 30 2010-Dec. 2 2010
Abstract :
In cluster analysis, current algorithms assume that all features in the data contribute uniformly in assigning samples to clusters. This assumption can lead to poor clustering results, due to the existence of noisy and less important features. Feature weighting overcomes this issue by assigning different weights to features based on some notion of importance. According to feature weighting, more important features are assigned higher weights and less important features lower weight. When weights are applied to the data, the normal feature space becomes a transformed feature space. This paper proposes that the degree of transformation is as important as the weights themselves to find better clustering outcomes. A fixed feature weighting technique is used where the magnitude of weights is increased or decreased based on Cauchy sequence. The proposed methodology is tested on simulated and real world datasets using k-means and hierarchical clustering algorithms, and results are compared against clustering without weights.
Keywords :
feature extraction; pattern clustering; Cauchy sequence; cluster analysis; feature weighting; hierarchical clustering algorithms; k-means clustering; Algorithm design and analysis; Clustering algorithms; Correlation; Data models; Indexes; Iris; Noise measurement; Cauchy sequence; Cluster validation; Feature weighting; Unsupervised clustering;
Conference_Titel :
Advanced Information Management and Service (IMS), 2010 6th International Conference on
Conference_Location :
Seoul
Print_ISBN :
978-1-4244-8599-4
Electronic_ISBN :
978-89-88678-32-9