Title :
Hairy neuron convergence theorems without the precision of timing
Abstract :
The author assumes arbitrary timing and individual time scales for each McCulloch-Pitts neurons, and proved the convergences of computational energies for a hard-wired Hopfield-like E(Vi), a soft-wired Rumelhart-like E(Wij) and a brittal-wired Hairy-Neuron E(Vi, Tij) neurocomputers. All assume the characteristic of an inhomogeneous architecture and imprecise timing. An important question for practical applications is how to speed up the training process and to ensure a fast convergence of weight adjustment? The authors have suggested a general procedure of Taylor series expansion of the clustering-declustering mini-max cost energy to estimate the synaptic weights (IJCNN-89 vol.1, p.485). They augment the Taylor expansion procedure by a self-consistently variational technique, so that a fast training is mathematically equivalent to make the truncated higher order terms of the Taylor series negligable. A typical mini-max cost function consists of (1) the sample variance of each class in the numerator, and (2) separation of the center of each class in the denominator. Thus, when the total cost energy is minimized, the conflicting goals of intraclass clustering and interclass segregation are achieved simultaneously. This Taylor expansion variable is a neuronic vector representation which traces along a Peano´s curve
Keywords :
learning systems; neural nets; McCulloch-Pitts neurons; Peano´s curve; Taylor series expansion; activation energy; brittal-wired Hairy-Neuron; clustering-declustering mini-max cost energy; computational energies; convergences; hairy neuron convergence theorems; hard-wired Hopfield; imprecise timing; interclass segregation; intraclass clustering; mini-max cost function; neurocomputers; neuronic vector representation; soft-wired Rumelhart; synaptic weights; total cost energy; training; weight adjustment;
Conference_Titel :
Neural Networks, 1990., 1990 IJCNN International Joint Conference on
Conference_Location :
San Diego, CA, USA
DOI :
10.1109/IJCNN.1990.137884