Title :
A parallel design and implementation for backpropagation neural network using MIMD architecture
Author :
Fathy, Sherif Kassem ; Syiam, Mostafa Mahmoud
Author_Institution :
Dept. of Comput. Sci., MTC, Cairo, Egypt
Abstract :
The backpropagation (BP) neural network is characterized by a slow rate of convergence learning speed especially in case of large architecture and large training data sets. So, this paper illustrates a parallel BP neural network depends upon MIMD system architecture using transputers. A parallel design version of BP neural network offers an attractive alternative for improving the learning speed. The paper introduces a mechanism to decrease the communication overhead between different related processor elements to reduce the communication time of parallel processors. The developed parallel design of BP neural network is experimented with the problem of printed Arabic character recognition. The experimental results revealed that the speed up approaches the maximum value of 15.2 when a large number of training patterns is used and the size of the network is large too
Keywords :
backpropagation; neural net architecture; parallel processing; transputer systems; MIMD architecture; backpropagation; communication overhead; communication time; convergence learning speed; parallel BP neural network; printed Arabic character recognition; transputers; Backpropagation; Clustering algorithms; Computer architecture; Computer networks; Iterative algorithms; Multi-layer neural network; Neural networks; Neurons; Parallel algorithms; Training data;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.549097