Title :
A sparse matrix approach to neural network training
Author :
Wang, Fang ; Zhang, Q.J.
Author_Institution :
Dept. of Electron., Carleton Univ., Ottawa, Ont., Canada
Abstract :
A new training technique, based on sparse matrix concept is developed for the training of multilayer perceptron. The proposed approach exploits the patterns of neuron activations in neural networks and substantially reduces the amount of computations in backpropagation. The proposed training algorithm is applied to word recognition with TI20 real speech data. Compared to techniques without using the sparse concept, same or better recognition accuracy is achieved and training speed is substantially improved
Keywords :
backpropagation; multilayer perceptrons; sparse matrices; TI20 real speech data; backpropagation; multilayer perceptron; neural network training; sparse matrix approach; word recognition; Backpropagation algorithms; Computer networks; Feedforward neural networks; Multi-layer neural network; Multilayer perceptrons; Neural networks; Neurons; Sparse matrices; Speech recognition; Standards development;
Conference_Titel :
Neural Networks, 1995. Proceedings., IEEE International Conference on
Conference_Location :
Perth, WA
Print_ISBN :
0-7803-2768-3
DOI :
10.1109/ICNN.1995.488164
