DocumentCode :
1399070
Title :
Tree-Structured Feature Extraction Using Mutual Information
Author :
Oveisi, F. ; Oveisi, S. ; Erfanian, A. ; Patras, Ioannis
Author_Institution :
Sch. of Electron. Eng. & Comput. Sci., Queen Mary Univ. of London, London, UK
Volume :
23
Issue :
1
fYear :
2012
Firstpage :
127
Lastpage :
137
Abstract :
One of the most informative measures for feature extraction (FE) is mutual information (MI). In terms of MI, the optimal FE creates new features that jointly have the largest dependency on the target class. However, obtaining an accurate estimate of a high-dimensional MI as well as optimizing with respect to it is not always easy, especially when only small training sets are available. In this paper, we propose an efficient tree-based method for FE in which at each step a new feature is created by selecting and linearly combining two features such that the MI between the new feature and the class is maximized. Both the selection of the features to be combined and the estimation of the coefficients of the linear transform rely on estimating 2-D MIs. The estimation of the latter is computationally very efficient and robust. The effectiveness of our method is evaluated on several real-world data sets. The results show that the classification accuracy obtained by the proposed method is higher than that achieved by other FE methods.
Keywords :
feature extraction; statistical analysis; transforms; linear transform; mutual information; tree-structured feature extraction; Approximation methods; Entropy; Estimation; Feature extraction; Frequency modulation; Iron; Mutual information; Classification; dimensionality reduction; feature extraction; mutual information;
fLanguage :
English
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
Publisher :
ieee
ISSN :
2162-237X
Type :
jour
DOI :
10.1109/TNNLS.2011.2178447
Filename :
6104224
Link To Document :
بازگشت