Title :
A nonlinear discriminant algorithm for feature extraction and data classification
Author :
Cruz, Carlos Santa ; Dorronsoro, José R.
Author_Institution :
Dept. of Comput. Eng., Univ. Autonoma de Madrid, Spain
fDate :
11/1/1998 12:00:00 AM
Abstract :
Presents a nonlinear supervised feature extraction algorithm that combines Fisher´s criterion function with a preliminary perceptron-like nonlinear projection of vectors in pattern space. Its main motivation is to combine the approximation properties of multilayer perceptrons (MLPs) with the target free nature of Fisher´s classical discriminant analysis. In fact, although MLPs provide good classifiers for many problems, there may be some situations, such as unequal class sizes with a high degree of pattern mixing among them, that may make difficult the construction of good MLP classifiers. In these instances, the features extracted by our procedure could be more effective. After the description of its construction and the analysis of its complexity, we illustrate its use over a synthetic problem with the above characteristics
Keywords :
computational complexity; feature extraction; learning (artificial intelligence); multilayer perceptrons; pattern classification; Fisher´s criterion function; approximation properties; classical discriminant analysis; data classification; nonlinear discriminant algorithm; nonlinear supervised feature extraction algorithm; pattern mixing; synthetic problem; Concrete; Covariance matrix; Data mining; Error analysis; Error probability; Feature extraction; Multilayer perceptrons; Pattern classification; Pattern recognition; Scattering;
Journal_Title :
Neural Networks, IEEE Transactions on