Title :
A biologically based competition model for self-organizing neural networks
Author :
Athinarayanan, R.
Author_Institution :
Dept. of Technol., Northern Illinois Univ., DeKalb, IL, USA
Abstract :
This work presents the design of an unsupervised neural network system, CSNN (competitive self-organizing neural network), for pattern recognition and classification. The CSNN model is based on a system of ordinary differential equations, motivated by Volterra and Lotka´s models of interacting species in biology. The CSNN features a continuous time system dynamics that is free of auxiliary control mechanisms, complex hard threshold switching functions, or LUT based approaches found in conventional pattern processing. These characteristics are essential for establishing self-organizing properties in unsupervised nets. Due to inherent complexities, attempts to analyze properties and capabilities of this system for pattern processing still remains a challenging task. Research rarely extends beyond the study of system stability, and other issues are essential for characterizing system properties and solution curves of their dynamics. The paper develops a self-organizing scheme for unsupervised neural networks, whose self-organizing properties are implicitly coded within a trajectory structure defined only by ordinary differential equations. The dynamic behavior is well understood and characterized using only the conventional analytical tools in mathematics. The constructed dynamics realizes a fixed finite set of equilibria in any fixed finite dimensional space. The ω-limit set of all trajectories initiated in its state space is the union of the stored pattern categories, represented as asymptotically stable limit points
Keywords :
differential equations; pattern classification; self-organising feature maps; unsupervised learning; ω-limit set; CSNN; LUT based approaches; asymptotically stable limit points; biologically based competition model; competitive self-organizing neural network; complex hard threshold switching functions; continuous time system dynamics; finite dimensional space; interacting species; ordinary differential equations; pattern classification; pattern processing; pattern recognition; self-organizing properties; self-organizing scheme; state space; unsupervised nets; unsupervised neural network system; unsupervised neural networks; Biological information theory; Biological system modeling; Computational biology; Continuous time systems; Control systems; Differential equations; Neural networks; Pattern analysis; Pattern recognition; Table lookup;
Conference_Titel :
Systems, Man, and Cybernetics, 1998. 1998 IEEE International Conference on
Conference_Location :
San Diego, CA
Print_ISBN :
0-7803-4778-1
DOI :
10.1109/ICSMC.1998.728157