• DocumentCode
    1368332
  • Title

    A modified Hopfield auto-associative memory with improved capacity

  • Author

    Giménez-Martínez, V.

  • Author_Institution
    Fac. de Inf., Univ. Politecnica de Madrid, Spain
  • Volume
    11
  • Issue
    4
  • fYear
    2000
  • fDate
    7/1/2000 12:00:00 AM
  • Firstpage
    867
  • Lastpage
    878
  • Abstract
    This paper describes a new procedure to implement a recurrent neural network (RNN), based on a new approach to the well-known Hopfield autoassociative memory. In our approach a RNN is seen as a complete graph G and the learning mechanism is also based on Hebb´s law, but with a very significant difference: the weights, which control the dynamics of the net, are obtained by coloring the graph G. Once the training is complete, the synaptic matrix of the net will be the weight matrix of the graph. Any one of these matrices will fulfil some spatial properties, for this reason they will be referred to as tetrahedral matrices. The geometrical properties of these tetrahedral matrices may be used for classifying the n-dimensional state-vector space in n classes. In the recall stage, a parameter vector is introduced, which is related with the capacity of the network. It may be shown that the bigger the value of the ith component of the parameter vector is, the lower the capacity of the [i] class of the state-vector space becomes. Once the capacity has been controlled, a new set of parameters that uses the statistical deviation of the prototypes to compare them with those that appear as fixed points is introduced, eliminating thus a great number of parasitic fixed points
  • Keywords
    Hebbian learning; Hopfield neural nets; content-addressable storage; matrix algebra; statistical analysis; Hebb law; RNN; graph weight matrix; learning mechanism; memory capacity; modified Hopfield auto-associative memory; multidimensional state-vector space classification; parameter vector; recurrent neural network; statistical deviation; synaptic matrix; tetrahedral matrices; Equations; Learning systems; Neural networks; Neurons; Optimization methods; Prototypes; Recurrent neural networks; Weight control;
  • fLanguage
    English
  • Journal_Title
    Neural Networks, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9227
  • Type

    jour

  • DOI
    10.1109/72.857768
  • Filename
    857768