Title :
A method to resolve the overfitting problem in recurrent neural networks for prediction of complex systems’ behavior
Author :
Mahdaviani, Kaveh ; Mazyar, Helga ; Majidi, Saeed ; Saraee, Mohammad H.
Author_Institution :
Isfahan Univ. of Technol., Isfahan
Abstract :
In this paper a new method to resolve the overfitting problem for predicting complex systemspsila behavior has been proposed. This problem occurs when a neural network loses its generalization. The method is based on the training of recurrent neural networks and using simulated annealing for the optimization of their generalization. The major work is done based on the idea of ensemble neural networks. Finally the results of using this method on two sample datasets are presented and the effectiveness of this method is illustrated.
Keywords :
recurrent neural nets; simulated annealing; complex systems behavior; overfitting problem; recurrent neural networks; simulated annealing; Computer networks; Economic forecasting; Mathematical model; Neural networks; Optimization methods; Predictive models; Rain; Recurrent neural networks; Simulated annealing; Weather forecasting;
Conference_Titel :
Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on
Conference_Location :
Hong Kong
Print_ISBN :
978-1-4244-1820-6
Electronic_ISBN :
1098-7576
DOI :
10.1109/IJCNN.2008.4634332