Title :
Stochastic dynamics and high capacity associative memories
Author :
Davey, N. ; Adams, R.G.
Author_Institution :
Dept. of Comput. Sci., Hertfordshire Univ., Hatfield, UK
Abstract :
The addition of noise to the deterministic Hopfield network, trained with one shot Hebbian learning, is known to bring benefits in the elimination of spurious attractors. This paper extends the analysis to learning rules that have a much higher capacity. The relative energy of desired and spurious attractors is reported and the affect of adding noise to the dynamics is empirically investigated. It is found that the addition of noise brings even more benefit in the case of the higher capacity rules.
Keywords :
Hebbian learning; Hopfield neural nets; associative processing; content-addressable storage; deterministic Hopfield network; high capacity associative memories; learning rules; noise; one shot Hebbian learning; performance measures; spurious attractors; stochastic dynamics; Associative memory; Computer science; Educational institutions; Gold; Hopfield neural networks; State-space methods; Stochastic processes; Stochastic resonance; Temperature distribution; Temperature sensors;
Conference_Titel :
Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
Print_ISBN :
981-04-7524-1
DOI :
10.1109/ICONIP.2002.1198958