Title :
On gradient adaptation with unit-norm constraints
Author :
Douglas, Scott C. ; Amari, Shun-Ichi ; Kung, S.Y.
Author_Institution :
Dept. of Electr. Eng., Southern Methodist Univ., Dallas, TX, USA
fDate :
6/1/2000 12:00:00 AM
Abstract :
In this correspondence, we describe gradient-based adaptive algorithms within parameter spaces that are specified by ||w||=1, where ||·|| is any vector norm. We provide several algorithm forms and relate them to true gradient procedures via their geometric structures. We also give algorithms that mitigate an inherent numerical instability for L2-norm-constrained optimization tasks. Simulations showing the performance of the techniques for independent component analysis are provided
Keywords :
adaptive signal processing; constraint theory; gradient methods; numerical stability; optimisation; L2-norm-constrained optimization tasks; geometric structures; gradient-based adaptive algorithms; independent component analysis; inherent numerical instability; iterative algorithm; parameter spaces; unit-norm constraints; Arithmetic; Computer architecture; Flow graphs; Geometry; Multiprocessor interconnection networks; Network topology; Parallel processing; Signal processing; Signal processing algorithms; Throughput;
Journal_Title :
Signal Processing, IEEE Transactions on
