Title :
Adaptive neural activation functions in multiresolution learning
Author_Institution :
Alcatel USA, Raleigh, NC, USA
Abstract :
The author extends original work on multiresolution learning (Y. Liang and E.W. Page, 1997; Y. Liang, 1997), and presents a new concept and method of adaptive neural activation functions in multiresolution learning, to maximize the learning efficacy of multiresolution learning paradigm for neural networks. Real-world sunspot series (yearly sunspot data from 1700 to 1999) prediction has been used to evaluate the method. The article demonstrates that multiresolution learning with adaptive activation can further significantly improve the constructed neural network´s generalization ability and robustness. Therefore, the work demonstrates the synergy effect on network learning efficacy through multiresolution learning with neural adaptive activation functions
Keywords :
adaptive systems; generalisation (artificial intelligence); learning (artificial intelligence); neural nets; transfer functions; adaptive activation; adaptive neural activation functions; generalization ability; learning efficacy; multiresolution learning; multiresolution learning paradigm; network learning efficacy; neural adaptive activation functions; neural networks; real-world sunspot series; robustness; synergy effect; yearly sunspot data; Intelligent networks; Multiresolution analysis; Neural networks; Neurons; Robustness; Signal processing; Signal representations; Signal resolution; Training data; Wavelet analysis;
Conference_Titel :
Systems, Man, and Cybernetics, 2000 IEEE International Conference on
Conference_Location :
Nashville, TN
Print_ISBN :
0-7803-6583-6
DOI :
10.1109/ICSMC.2000.884386