Title :
Ensemble approach for improving generalization ability of neural networks
Author :
Ahmed, Shehab ; Razib, Md Razibul Islam ; Alam, Md Shamsul ; Alam, Md Shamsul ; Huda, Mohammad Nurul
Author_Institution :
United Int. Univ., Dhaka, Bangladesh
Abstract :
This paper presents a study on improving generalization ability of neural networks (NNs) by using ensemble approach. In already existing literature, both theoretical and experimental studies have revealed that the performance, i.e., generalization ability of NN ensemble is greatly dependent on both accuracy and diversity among individual NNs in the ensemble. In this study and implementation of NN ensemble, Back Propagation (BP) learning algorithm is used to train individual NNs independently for a fixed number of training epoches. We have considered 12 different benchmark problems in our study. Few papers have considered such a large number of problems. The experimental results show that the performance of NN ensemble is often better than individual NNs, and both accuracy and diversity among participating networks are important for the generalization ability of the ensemble.
Keywords :
backpropagation; generalisation (artificial intelligence); neural nets; BP learning algorithm; NN ensemble approach; back propagation learning algorithm; generalization ability; neural networks; training epoches; Accuracy; Artificial neural networks; Boosting; Error analysis; Training; Accuracy; Diversity; Ensemble; Independent Training; Majority Voting; Neural Network; Simple Averaging;
Conference_Titel :
Informatics, Electronics & Vision (ICIEV), 2013 International Conference on
Conference_Location :
Dhaka
Print_ISBN :
978-1-4799-0397-9
DOI :
10.1109/ICIEV.2013.6572579