Title :
Linear classifiers in perceptron design
Author_Institution :
Inst. of Math. & Inf., Vilnius, Lithuania
Abstract :
It is shown adaptive training of the nonlinear single layer perceptron can lead to seven different statistical classifiers: (1) Euclidean distance classifier; (2) standard Fisher linear discriminant function; (3) Fisher linear discriminant function, with pseudoinverse of the covariance matrix; (4) regularised discriminant analysis; (5) generalised Fisher discriminant function; (6) minimum empirical error classifier; and (7) maximum margin classifier and to intermediate ones. Which particular type of the classifier will be obtained depends on: 1) initialisation interval and its relation to the training data; 2) an initial value of the learning step; and 3) its change during the iteration process, the stopping criteria
Keywords :
adaptive systems; iterative methods; learning (artificial intelligence); optimisation; pattern classification; perceptrons; statistical analysis; Euclidean distance classifier; Fisher linear discriminant function; adaptive training; complexity; covariance matrix; initialisation; initialisation interval; iteration process; learning set size; linear pattern classifiers; margin; maximum margin classifier; minimum empirical error classifier; nonlinear single layer perceptron; regularised discriminant analysis; statistical classifiers; stopping criteria; Cost function; Covariance matrix; Electronic mail; Euclidean distance; Informatics; Mathematics; Matrix decomposition; Maximum likelihood estimation; Training data; Vectors;
Conference_Titel :
Pattern Recognition, 1996., Proceedings of the 13th International Conference on
Conference_Location :
Vienna
Print_ISBN :
0-8186-7282-X
DOI :
10.1109/ICPR.1996.547666