Title :
A New PCA/ICA Based Feature Selection Method
Author :
Genc, Hakki M. ; Cataltepe, Zehra ; Pearson, Thomas
Author_Institution :
Bilisim Teknolojileri Enstitusu, Marmara Arastirma Merkezi, Kocaeli, Turkey
Abstract :
Dimensionality reduction algorithms help reduce the classification time and sometimes the classification error of a classifier (Yang, et al., 1997). For time critical applications, in order to have reduction in the feature acquisition phase, feature selection methods are more preferable to dimensionality reduction methods, which require measurement of all inputs. Traditional feature selection methods, such as forward or backward feature selection, are costly to implement. In this study, we introduce a new feature selection method that decides on which features to retain, based on how PCA (principal component analysis) or ICA (independent component analysis) (Hyvarinen and Oja, 1999) values those features. We compare the accuracy of our method to backward and forward feature selection with the same number of features selected and PCA and ICA using the same number of principal and independent components. For our experiments, we use spectral measurement data taken from corn kernels infested and not infested by fungi.
Keywords :
feature extraction; independent component analysis; principal component analysis; ICA; PCA; backward feature selection method; dimensionality reduction algorithms; feature acquisition phase; forward feature selection method; independent component analysis; principal component analysis; Entropy; Fungi; Independent component analysis; Kernel; Phase measurement; Principal component analysis; Redundancy; Testing; Time measurement; US Department of Agriculture;
Conference_Titel :
Signal Processing and Communications Applications, 2007. SIU 2007. IEEE 15th
Conference_Location :
Eskisehir
Print_ISBN :
1-4244-0719-2
Electronic_ISBN :
1-4244-0720-6
DOI :
10.1109/SIU.2007.4298772