Title :
A heteroscedastic extension of LDA based on multi-class matusita affinity
Author :
Mahanta, Mohammad Shahin ; Plataniotis, Konstantinos N.
Author_Institution :
Edward S. Rogers Sr. Dept. of Electr. & Comput. Eng., Univ. of Toronto, Toronto, ON, Canada
Abstract :
Linear discriminant analysis (LDA), a conventional feature extraction technique, is a homoscedastic solution and ignores the second order information of the data. A heteroscedastic extension of LDA has been previously proposed which relies on the average pairwise Chernoff distances of the classes. However, in a multi-class scenario with number of classesC >; 2, the average of pairwise distances is not directly related to the classification error rate. Furthermore, the corresponding method imposes a high computational complexity of order O(C(C - 1)). This paper proposes an inherently multi-class heteroscedastic extension of LDA based on Matusita´s separability measure, a multi-class generalization of the Chernoff distance which is related to multi-class error bounds. The proposed feature extractor can be trained non-iteratively with computational complexity of O(C). Experimental comparisons with the Chernoffmethod demonstrate both a performance improvement when estimated parameters are used, and a reduction of factor C - 1 in the computational load as predicted.
Keywords :
feature extraction; image classification; Chernoff distances; LDA; classification error rate; computational complexity; conventional feature extraction technique; heteroscedastic extension; linear discriminant analysis; multiclass matusita affinity; second order information; Computational complexity; Error analysis; Feature extraction; Measurement uncertainty; Pattern recognition; Silicon; Training; Chernoff distance; Gaussian quadratic classifier; Heteroscedastic feature extraction; Matusita affinity; multi-class separability measure;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on
Conference_Location :
Kyoto
Print_ISBN :
978-1-4673-0045-2
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2012.6288280