Title :
Simultaneous feature selection and feature weighting with K selection for KNN classification using BBO algorithm
Author :
Kardan, Ahmad ; Kavian, Atena ; Esmaeili, Ahmad
Author_Institution :
Dept. of Comput. Eng. & Inf. Technol., Amirkabir Univ. of Technol., Tehran, Iran
Abstract :
K nearest neighbor algorithm (K-NN) is considered as one of the machine learning algorithms for data classification. This algorithm suffers of some disadvantages such as sensitivity to the distance function, K value selection and high computational complexity (time and spatial). In this paper, a novel hybrid approach is proposed for simultaneous feature selection and feature weighting with k value selection of K-NN rule based on Biogeography based optimization (BBO). The 6 evolutionary algorithms and 14 non-evolutionary algorithms are used to compare and evaluate with the novel proposed algorithm (BBO-KNN). The experimental results signify that the BBO-KNN has higher efficiency compared to other methods and is led to higher classification rate as well as effective data dimension reduction.
Keywords :
computational complexity; data reduction; evolutionary computation; optimisation; pattern classification; BBO algorithm; BBO-KNN; K value selection; K-NN rule; KNN classification; biogeography based optimization; computational complexity; data dimension reduction; evolutionary algorithms; feature weighting; nonevolutionary algorithms; simultaneous feature selection; Accuracy; Algorithm design and analysis; Biological cells; Classification algorithms; Data models; Machine learning algorithms; Sensitivity; Biogeography Based Optimization(BBO); Feature selection; Feature weighting; K nearest neighbor(K-NN); K value;
Conference_Titel :
Information and Knowledge Technology (IKT), 2013 5th Conference on
Conference_Location :
Shiraz
Print_ISBN :
978-1-4673-6489-8
DOI :
10.1109/IKT.2013.6620092