Title :
Neural network performance analysis using hanning window function as dynamic learning rate
Author :
Hasan, Md Maodudul ; Rahaman, Arifur ; Talukder, Munmun ; Islam, Mohammad ; Maswood, Mirza Md Shahriar ; Rahman, Md Mamunur
Author_Institution :
Dept. of Electron. & Commun. Eng., Khulna Univ. of Eng. & Technol., Khulna, Bangladesh
Abstract :
In human brain the neurons are excited in a dynamic way. The response of different neurons varies widely because of the variation of electrical signal in every neuron. Backpropagation(BP) is a training algorithm where the learning of the Neural Network (NN) is done by a constant learning rate (LR). But to replicate the human brain function, the learning rate should be changed as the excitation of different neurons. In this paper a new learning algorithm is proposed called Hanning Window Neural Network (HWNN) to train the network. Here the window function is used to make the learning rate dynamic called Hanning learning rate (HLR) and for this dynamic learning rate the neural network outperforms than the existing BP algorithm. HWNN is extensively tested on five real world benchmark classification problems such as ionosphere, australian credit card, time series, wine and soybean identification. The proposed HWNN outperforms the existing BP in terms of generalization ability and also convergence rate.
Keywords :
backpropagation; neural nets; pattern classification; Australian credit card; BP; HLR; HWNN; Hanning learning rate; Hanning window function; Hanning window neural network; backpropagation; benchmark classification problems; dynamic learning rate; electrical signal; human brain; human brain function; neural network performance analysis; neurons; soybean identification; time series; training algorithm; wine identification; Artificial neural networks; Benchmark testing; Biological neural networks; Convergence; Heuristic algorithms; Neurons; Training; Hanning window function; backpropagation; convergence rate; generalization ability; learning rate; neural network;
Conference_Titel :
Informatics, Electronics & Vision (ICIEV), 2013 International Conference on
Conference_Location :
Dhaka
Print_ISBN :
978-1-4799-0397-9
DOI :
10.1109/ICIEV.2013.6572609