Title :
Removal of degeneracy in adaptive Volterra networks by dynamic structuring
Author :
Lynch, M.R. ; Rayner, P.J. ; Holden, S.B.
Author_Institution :
Dept. of Eng., Cambridge Univ., UK
Abstract :
The authors describe the development of a new form of connectionist model or neural network which, although having a unimodal error surface, will optimize its structure adaptively. The network is derived from the Volterra connectionist model. The adaptive noninformative extension nonlinearities removal method is used. The method requires only a slight computational expenditure in order to perform the self-structuring operation and may be operated with a bias to network contraction or reduction of error. Also, it does not require exact redundancies in order to operate. In addition, the inherent null-space nonlinearities removal method demonstrates a much more fundamental basis for removal of redundancy. This approach provides a deeper understanding of the problem and may in its current form be used as a block method with training set data
Keywords :
adaptive filters; filtering and prediction theory; neural nets; adaptive Volterra networks; adaptive filters; block method; connectionist model; degeneracy removal; dynamic structuring; inherent null-space nonlinearities removal; network contraction; neural network; noninformative extension nonlinearities removal; redundancy removal; self-structuring operation; signal processing; training set data; unimodal error surface; Adaptive systems; Computer networks; Intelligent networks; Neural networks; Optical propagation; Polynomials; Redundancy; Simulated annealing; Transfer functions; Vectors;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 1991. ICASSP-91., 1991 International Conference on
Conference_Location :
Toronto, Ont.
Print_ISBN :
0-7803-0003-3
DOI :
10.1109/ICASSP.1991.150812