Title :
Homotopic BP algorithm adopted staged principle
Author :
Xiaorong, Gao ; Fushen, Yang ; Yiming, Diao
Author_Institution :
Dept. of Electr. Eng., Tsinghua Univ., Beijing, China
Abstract :
The BP algorithm has solved the learning problem of multilayer feedforward networks successfully. But a lot of its applications indicated that it has the drawbacks of narrow convergence area, large learning cost, etc. The main motivation of neural network study is to learn from or simulate the architecture and the information processing mechanism of the human brain. Thus except for the adopted qualities of parallel processing, distributed storage and plasticity function, the efficient learning mechanism of the human brain should be considered in the ANN, too. On the other hand, how to use the priori knowledge or expert´s knowledge during network learning to achieve the transition form simplicity to complexity, hasn´t been solved well Since this algorithm adopts the topological homotopic theory, a feasible theoretical analysis tool for the feedforward network can be provided. Primary experiments show its good performance.
Keywords :
backpropagation; feedforward neural nets; multilayer perceptrons; homotopic BP algorithm; human brain; large learning cost; learning problem; multilayer feedforward network; narrow convergence; staged principle; Artificial neural networks; Biological neural networks; Brain modeling; Convergence; Costs; Humans; Information processing; Learning systems; Multi-layer neural network; Parallel processing;
Conference_Titel :
Neural Networks, 1993. IJCNN '93-Nagoya. Proceedings of 1993 International Joint Conference on
Print_ISBN :
0-7803-1421-2
DOI :
10.1109/IJCNN.1993.716751