Title :
Improved one-shot learning for feedforward associative memories with application to composite pattern association
Author :
Wu, Yingquan ; Batalama, Stella N.
Author_Institution :
Dept. of Electr. Eng., State Univ. of New York, Buffalo, NY, USA
fDate :
2/1/2001 12:00:00 AM
Abstract :
The local identical index (LII) associative memory (AM) proposed by the authors in a previous paper is a one-shot feedforward structure designed to exhibit no spurious attractors. In this paper we relax the latter design constraint in exchange for enlarged basins of attraction and we develop a family of modified LII AM networks that exhibit improved performance, particularly in memorizing highly correlated patterns. The new algorithm meets the requirement of no spurious attractors only in a local sense. Finally, we show that the modified LII family of networks can accommodate composite patterns of any size by storing (memorizing) only the basic (prime) prototype patterns. The latter property translates to low learning complexity and a simple network structure with significant memory savings. Simulation studies and comparisons illustrate and support the the optical developments
Keywords :
content-addressable storage; feedforward neural nets; learning (artificial intelligence); LII AM networks; composite pattern association; feedforward associative memories; feedforward structure; highly correlated patterns; learning complexity; local identical index; one-shot learning; Artificial neural networks; Associative memory; Feedforward neural networks; Hamming distance; Hopfield neural networks; Neural networks; Pattern classification; Pattern recognition; Propulsion; Prototypes;
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/3477.907570