Title :
A complex Echo State Network for nonlinear adaptive filtering
Author :
Xia, Yili ; Mandic, Danilo P. ; Hulle, M. ; Principe, Jose C.
Author_Institution :
Dept. of Electr. & Electron. Eng., Imperial Coll. London, London
Abstract :
The operation of echo state networks (ESNs) is extended to the complex domain, in order to perform nonlinear complex valued adaptive filtering of nonlinear and nonstationary signals. This is achieved by introducing a nonlinear output layer into an ESN, whereby full adaptivity is provided by introducing an adaptive amplitude into the nonlinear activation function within the output layer of ESN. This allows us to control and track the degree of nonlinearity, which facilitates real-world adaptive filtering applications. Learning algorithms for such ESN are derived, and the benefits of the combination of sparse connections and nonlinear adaptive output layer are illustrated by simulations of both benchmark and real world signals.
Keywords :
adaptive filters; complex networks; echo; nonlinear filters; complex domain; complex echo state network; learning algorithms; nonlinear activation function; nonlinear adaptive filtering; nonlinear signal; nonstationary signal; sparse connections; Adaptive filters; Computational complexity; Computer architecture; Educational institutions; Laboratories; Neurons; Nonlinear dynamical systems; Recurrent neural networks; Reservoirs; System identification;
Conference_Titel :
Machine Learning for Signal Processing, 2008. MLSP 2008. IEEE Workshop on
Conference_Location :
Cancun
Print_ISBN :
978-1-4244-2375-0
Electronic_ISBN :
1551-2541
DOI :
10.1109/MLSP.2008.4685514