Title :
Choosing Parameters of Kernel Subspace LDA for Recognition of Face Images Under Pose and Illumination Variations
Author :
Huang, Jian ; Yuen, Pong C. ; Chen, Wen-Sheng ; Lai, Jian Huang
Author_Institution :
Hong Kong Baptist Univ., Kowloon
Abstract :
This paper addresses the problem of automatically tuning multiple kernel parameters for the kernel-based linear discriminant analysis (LDA) method. The kernel approach has been proposed to solve face recognition problems under complex distribution by mapping the input space to a high-dimensional feature space. Some recognition algorithms such as the kernel principal components analysis, kernel Fisher discriminant, generalized discriminant analysis, and kernel direct LDA have been developed in the last five years. The experimental results show that the kernel-based method is a good and feasible approach to tackle the pose and illumination variations. One of the crucial factors in the kernel approach is the selection of kernel parameters, which highly affects the generalization capability and stability of the kernel-based learning methods. In view of this, we propose an eigenvalue-stability-bounded margin maximization (ESBMM) algorithm to automatically tune the multiple parameters of the Gaussian radial basis function kernel for the kernel subspace LDA (KSLDA) method, which is developed based on our previously developed subspace LDA method. The ESBMM algorithm improves the generalization capability of the kernel-based LDA method by maximizing the margin maximization criterion while maintaining the eigenvalue stability of the kernel-based LDA method. An in-depth investigation on the generalization performance on pose and illumination dimensions is performed using the YaleB and CMU PIE databases. The FERET database is also used for benchmark evaluation. Compared with the existing PCA-based and LDA-based methods, our proposed KSLDA method, with the ESBMM kernel parameter estimation algorithm, gives superior performance.
Keywords :
eigenvalues and eigenfunctions; face recognition; parameter estimation; principal component analysis; CMU PIE databases; FERET database; Gaussian radial basis function kernel; YaleB; eigenvalue stability; eigenvalue-stability-bounded margin maximization; face image recognition; generalization capability; generalized discriminant analysis; high-dimensional feature space; illumination variations; kernel Fisher discriminant; kernel parameter estimation; kernel principal component analysis; kernel subspace LDA; kernel-based LDA method; kernel-based learning methods; kernel-based linear discriminant analysis; margin maximization criterion; multiple kernel parameter tuning; pose variations; Algorithm design and analysis; Databases; Face recognition; Image recognition; Kernel; Learning systems; Lighting; Linear discriminant analysis; Principal component analysis; Stability; Gaussian radial basis function (RBF) kernel; generalization capability; kernel Fisher discriminant (KFD); kernel parameter; model selection; Algorithms; Artificial Intelligence; Biometry; Computer Simulation; Discriminant Analysis; Face; Humans; Image Interpretation, Computer-Assisted; Lighting; Pattern Recognition, Automated; Posture;
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/TSMCB.2007.895328