Title :
Accurate Estimation of ICA Weight Matrix by Implicit Constraint Imposition Using Lie Group
Author :
Selvan, S.E. ; Mustatea, A. ; Xavier, C.C. ; Sequeira, J.
Author_Institution :
Dept. of Electron. & Commun. Eng., Karunya Univ., Coimbatore, India
Abstract :
This paper presents a new stochastic algorithm to optimize the independence criterion-mutual information-among multivariate data using local, global, and hybrid optimizers, in conjunction with techniques involving a Lie group and its corresponding Lie algebra, for implicit imposition of the orthonormality constraint among the estimated sources. The major advantage of the proposed algorithm is the increased accuracy with which the weight matrix in the independent component analysis (ICA) model is estimated, compared to conventional schemes. When the local optimizer with Lie group techniques and the fast fixed-point (fastICA) algorithm were experimented by inputting the same set of random vectors, the former method superseded the conventional one by producing accurate weight matrix estimates in a majority of the test cases. Importantly, in our approach, the use of a Lie group to ldquolockrdquo the weight matrix estimates onto the constraint surface enabled easy realization of the hybrid optimizers to yield near-global-optimum solutions consistently in most of the test cases, compared to well-known global optimizers. The inherent computational overhead in the hybrid optimizers was lowered by preprocessing the input data and periodically integrating the local optimizers with the global one. The proposed algorithms were applied to six-dimensional multispectral satellite image data to emphasize their usefulness in terms of accurate ICA weight matrix estimation.
Keywords :
Lie algebras; Lie groups; Newton method; entropy; geophysical signal processing; image processing; independent component analysis; matrix algebra; particle swarm optimisation; simulated annealing; source separation; spectral analysis; stochastic processes; vectors; Lie algebra; Lie group; PSO; accurate ICA weight matrix estimation; cross-entropy method; fast fixed-point algorithm; global optimizer; hybrid optimizer; implicit constraint imposition; independence criterion optimization; independent component analysis; local optimizer; multivariate data; mutual information; orthonormality constraint; quasiNewton method; random vector; simulated annealing; six-dimensional multispectral satellite image data; source separation; stochastic algorithm; Algebra; Constraint optimization; Data preprocessing; Independent component analysis; Mutual information; Optimization methods; Satellites; Stochastic processes; Testing; Yield estimation; Cross-entropy optimizer; Lie algebra; Lie group; mutual information; particle swarm optimizer; quasi-Newton; simulated annealing; spectral screening; Algorithms; Data Interpretation, Statistical; Image Interpretation, Computer-Assisted; Principal Component Analysis;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2009.2027017