DocumentCode
1329638
Title
Algorithms for Complex ML ICA and Their Stability Analysis Using Wirtinger Calculus
Author
Li, Hualiang ; Adali, Tülay
Author_Institution
Univ. of Maryland Baltimore County, Catonsville, MD, USA
Volume
58
Issue
12
fYear
2010
Firstpage
6156
Lastpage
6167
Abstract
We derive a class of algorithms for independent component analysis (ICA) based on maximum likelihood (ML) estimation and perform stability analysis of natural gradient ML ICA with and without the constraint for unitary demixing matrix. In the process, we demonstrate how Wirtinger calculus facilitates derivations, and most importantly, performing second-order analysis in the complex domain and eliminates the need for making simplifying assumptions. We derive natural gradient complex ML ICA update rule and its variant with a unitary constraint, as well as a Newton algorithm for better convergence behavior. The conditions for local stability are derived and studied using a generalized Gaussian density (GGD) source model. When the sources are circular and non-Gaussian, we show analytically that both the ML and ML-unitary ICA update rules converge to the inverse of mixing matrix subject to a phase shift. When the sources are noncircular and non-Gaussian, we show that the nonunitary ML ICA update rule is more stable than the ML-unitary ICA update rule. When the sources are noncircular Gaussians, both update rules are stable only when the sources have distinct noncircularity indices. Simulation results are given to support these results.
Keywords
Gaussian processes; Newton method; blind source separation; calculus; gradient methods; independent component analysis; maximum likelihood estimation; Newton algorithm; Wirtinger calculus; generalized Gaussian density; independent component analysis; local stability; maximum likelihood estimation; stability analysis; unitary demixing matrix; Algorithm design and analysis; Calculus; Independent component analysis; Maximum likelihood estimation; Signal processing algorithms; Stability criteria; Complex analysis; Wirtinger calculus; independent component analysis (ICA); local stability; maximum likelihood (ML);
fLanguage
English
Journal_Title
Signal Processing, IEEE Transactions on
Publisher
ieee
ISSN
1053-587X
Type
jour
DOI
10.1109/TSP.2010.2077630
Filename
5580110
Link To Document