• DocumentCode
    445990
  • Title

    Introduction of a Hebbian unsupervised learning algorithm to boost the encoding capacity of Hopfield networks

  • Author

    Molter, Colin ; Salihoglu, Utku ; Bersini, Hugues

  • Author_Institution
    Univ. Libre de Bruxelles, Belgium
  • Volume
    3
  • fYear
    2005
  • fDate
    31 July-4 Aug. 2005
  • Firstpage
    1552
  • Abstract
    The learning impact, of an iterative supervised Hebbian learning algorithm, on a recurrent neural network\´s underlying dynamics has been discussed in a previous paper. It was argued that these results are in line with the observations made by Freeman in the olfactory bulb of the rabbit: cycles are used to store information and the chaotic dynamics appears as the background regime composed of those cyclic "memory bags". However, to get closer to a biological point of view, this paper introduces an unsupervised version of this Hebbian algorithm. As a direct result, both the storing capacity and the content addressability of the learned networks are greatly enhanced. Furthermore, stunning dynamical results are observed: if the learning process increases the dimension of the potential attractors, however, less chaoticity is found than in a supervised learning process. Moreover, chaos obtained looks more structured, made from brief itinerancy among learned cycles.
  • Keywords
    Hebbian learning; Hopfield neural nets; unsupervised learning; Hebbian unsupervised learning; Hopfield network encoding; chaotic dynamics; cyclic memory bag; structured chaos; Biological information theory; Chaos; Encoding; Hebbian theory; Iterative algorithms; Olfactory; Rabbits; Recurrent neural networks; Supervised learning; Unsupervised learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on
  • Print_ISBN
    0-7803-9048-2
  • Type

    conf

  • DOI
    10.1109/IJCNN.2005.1556109
  • Filename
    1556109