Title :
Linear Discriminant Analysis Based on L1-Norm Maximization
Author :
Fujin Zhong ; Jiashu Zhang
Author_Institution :
Sichuan Province Key Lab. of Signal & Inf. Process., Southwest Jiaotong Univ., Chengdu, China
Abstract :
Linear discriminant analysis (LDA) is a well-known dimensionality reduction technique, which is widely used for many purposes. However, conventional LDA is sensitive to outliers because its objective function is based on the distance criterion using L2-norm. This paper proposes a simple but effective robust LDA version based on L1-norm maximization, which learns a set of local optimal projection vectors by maximizing the ratio of the L1-norm-based between-class dispersion and the L1-norm-based within-class dispersion. The proposed method is theoretically proved to be feasible and robust to outliers while overcoming the singular problem of the within-class scatter matrix for conventional LDA. Experiments on artificial datasets, standard classification datasets and three popular image databases demonstrate the efficacy of the proposed method.
Keywords :
image processing; optimisation; principal component analysis; L1-norm maximization; L2-norm maimisation; LDA; PCA; linear discriminant analysis; local optimal projection vectors; objective function; principal component analysis; Linear programming; Nickel; Optimization; Principal component analysis; Robustness; Training; Vectors; L1-norm; L2-norm; Linear discriminant analysis (LDA); optimization; outliers; Algorithms; Computer Simulation; Discriminant Analysis; Image Enhancement; Image Interpretation, Computer-Assisted; Linear Models; Pattern Recognition, Automated; Reproducibility of Results; Sensitivity and Specificity;
Journal_Title :
Image Processing, IEEE Transactions on
DOI :
10.1109/TIP.2013.2253476