DocumentCode :
671559
Title :
The spectral radius remains a valid indicator of the Echo state property for large reservoirs
Author :
Caluwaerts, Ken ; Wyffels, Francis ; Dieleman, Sander ; Schrauwen, Benjamin
Author_Institution :
Electron. & Inf. Syst. Dept., Ghent Univ., Ghent, Belgium
fYear :
2013
fDate :
4-9 Aug. 2013
Firstpage :
1
Lastpage :
6
Abstract :
In the field of Reservoir Computing, scaling the spectral radius of the weight matrix of a random recurrent neural network to below unity is a commonly used method to ensure the Echo State Property. Recently it has been shown that this condition is too weak. To overcome this problem, other - more involved - sufficient conditions for the Echo State Property have been proposed. In this paper we provide a large-scale experimental verification of the Echo State Property for large recurrent neural networks with zero input and zero bias. Our main conclusion is that the spectral radius method remains a valid indicator of the Echo State Property; the probability that the Echo State Property does not hold, drops for larger networks with spectral radius below unity, which are the ones of practical interest.
Keywords :
learning (artificial intelligence); recurrent neural nets; echo state property; random recurrent neural network; reservoir computing; spectral radius method; weight matrix; zero bias; zero input; Bifurcation; Mathematical model; Neurons; Recurrent neural networks; Reservoirs; Training;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks (IJCNN), The 2013 International Joint Conference on
Conference_Location :
Dallas, TX
ISSN :
2161-4393
Print_ISBN :
978-1-4673-6128-6
Type :
conf
DOI :
10.1109/IJCNN.2013.6706899
Filename :
6706899
Link To Document :
بازگشت