DocumentCode :
445990
Title :
Introduction of a Hebbian unsupervised learning algorithm to boost the encoding capacity of Hopfield networks
Author :
Molter, Colin ; Salihoglu, Utku ; Bersini, Hugues
Author_Institution :
Univ. Libre de Bruxelles, Belgium
Volume :
3
fYear :
2005
fDate :
31 July-4 Aug. 2005
Firstpage :
1552
Abstract :
The learning impact, of an iterative supervised Hebbian learning algorithm, on a recurrent neural network\´s underlying dynamics has been discussed in a previous paper. It was argued that these results are in line with the observations made by Freeman in the olfactory bulb of the rabbit: cycles are used to store information and the chaotic dynamics appears as the background regime composed of those cyclic "memory bags". However, to get closer to a biological point of view, this paper introduces an unsupervised version of this Hebbian algorithm. As a direct result, both the storing capacity and the content addressability of the learned networks are greatly enhanced. Furthermore, stunning dynamical results are observed: if the learning process increases the dimension of the potential attractors, however, less chaoticity is found than in a supervised learning process. Moreover, chaos obtained looks more structured, made from brief itinerancy among learned cycles.
Keywords :
Hebbian learning; Hopfield neural nets; unsupervised learning; Hebbian unsupervised learning; Hopfield network encoding; chaotic dynamics; cyclic memory bag; structured chaos; Biological information theory; Chaos; Encoding; Hebbian theory; Iterative algorithms; Olfactory; Rabbits; Recurrent neural networks; Supervised learning; Unsupervised learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on
Print_ISBN :
0-7803-9048-2
Type :
conf
DOI :
10.1109/IJCNN.2005.1556109
Filename :
1556109
Link To Document :
بازگشت