Title :
Adaptive Learning in Complex Reproducing Kernel Hilbert Spaces Employing Wirtinger´s Subgradients
Author :
Bouboulis, P. ; Slavakis, K. ; Theodoridis, S.
Author_Institution :
Dept. of Inf. & Telecommun., Univ. of Athens, Athens, Greece
fDate :
3/1/2012 12:00:00 AM
Abstract :
This paper presents a wide framework for non-linear online supervised learning tasks in the context of complex valued signal processing. The (complex) input data are mapped into a complex reproducing kernel Hilbert space (RKHS), where the learning phase is taking place. Both pure complex kernels and real kernels (via the complexification trick) can be employed. Moreover, any convex, continuous and not necessarily differentiable function can be used to measure the loss between the output of the specific system and the desired response. The only requirement is the subgradient of the adopted loss function to be available in an analytic form. In order to derive analytically the subgradients, the principles of the (recently developed) Wirtinger´s calculus in complex RKHS are exploited. Furthermore, both linear and widely linear (in RKHS) estimation filters are considered. To cope with the problem of increasing memory requirements, which is present in almost all online schemes in RKHS, the sparsification scheme, based on projection onto closed balls, has been adopted. We demonstrate the effectiveness of the proposed framework in a non-linear channel identification task, a non-linear channel equalization problem and a quadrature phase shift keying equalization scheme, using both circular and non circular synthetic signal sources.
Keywords :
Hilbert spaces; equalisers; filtering theory; gradient methods; learning (artificial intelligence); quadrature phase shift keying; signal processing; Wirtinger calculus; Wirtinger subgradients; adaptive learning; circular synthetic signal sources; complex reproducing kernel Hilbert spaces; complex valued signal processing; complexification trick; learning phase; loss function; noncircular synthetic signal sources; nonlinear channel equalization problem; nonlinear channel identification task; nonlinear online supervised learning tasks; quadrature phase shift keying equalization scheme; sparsification scheme; wide;y linear estimation filters; Calculus; Context; Hilbert space; Kernel; Loss measurement; Machine learning; Signal processing; Adaptive kernel learning; Wirtinger´s calculus; complex kernels; projection; subgradient; widely linear estimation;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2011.2179810