Title :
Hybrid Feature Selection and Weighting Method Based on Binary Particle Swarm Optimization
Author :
Severo, Diogo S. ; Verissimo, E. ; Cavalcanti, G.D.C. ; Tsang Ing Ren
Author_Institution :
Centro de Inf., Univ. Fed. de Pernambuco, Recife, Brazil
Abstract :
This work proposes an optimization technique based on binary particle swarm optimization that performs feature selection and feature weighting simultaneously. In the optimization process, each member of the population is described as a vector having three parts: i) one weight per feature (feature weighting), ii) one binary value per feature indicating the presence or the absence of the feature (feature selection), and, iii) the number of neighbors of the kNN classifier. After optimization, this vector is used as a mask to generate a new subset of features that is evaluated using the kNN classifier. The experimental study was performed on public datasets and showed that the proposed technique obtains better accuracy and reduction rates than state-of-the-art techniques.
Keywords :
feature selection; particle swarm optimisation; pattern classification; binary particle swarm optimization; feature selection; feature weighting method; kNN classifier; Accuracy; Glass; Optimization; Particle swarm optimization; Sociology; Sonar; Statistics; Feature selection; feature weighting; kNN classifier; particle swam optimization;
Conference_Titel :
Tools with Artificial Intelligence (ICTAI), 2013 IEEE 25th International Conference on
Conference_Location :
Herndon, VA
Print_ISBN :
978-1-4799-2971-9
DOI :
10.1109/ICTAI.2013.71