Title :
Augmentation of Elman Recurrent Network Learning with Particle Swarm Optimization
Author :
Aziz, Mohamad Firdaus Ab ; Hamed, Haza Nuzly Abdull ; Shamsuddin, Siti Mariyam Hj
Author_Institution :
Fac. of Comput. Sci. & Inf. Syst., Skudai Univ. Teknol., Skudai
Abstract :
Despite a variety of artificial neural network (ANN) categories, backpropagation network (BP) and Elman recurrent network (ERN) are the widespread modus operandi in real applications. However, there are many drawbacks in BP network, for instance, confinement in finding local minimum and may get stuck at regions of a search space or trap in local minima. To solve these problems, various optimization techniques such as particle swarm optimization (PSO) and genetic algorithm (GA) have been executed to improve ANN performance. In this study, we exploit errors optimization of Elman recurrent network with backpropagation (ERNBP) and Elman recurrent network with particle swarm optimization (ERNPSO) to probe the performance of both networks. The comparisons are done with PSO that is integrated with neural network (PSONN) and GA with neural network (GANN). The results show that ERNPSO furnishes promising outcomes in terms of classification accuracy and convergence rate compared to ERNBP, PSONN and GANN.
Keywords :
backpropagation; genetic algorithms; particle swarm optimisation; recurrent neural nets; search problems; Elman recurrent network learning augmentation; backpropagation network; genetic algorithm; local minima; particle swarm optimization; search space; Artificial neural networks; Backpropagation; Computational modeling; Computer networks; Convergence; Feeds; Network topology; Particle swarm optimization; Pattern recognition; Recurrent neural networks; Artificial Neural Network; Backpropagation network; Elman Recurrent Network; Particle Swarm Optimization; Recurrent Network;
Conference_Titel :
Modeling & Simulation, 2008. AICMS 08. Second Asia International Conference on
Conference_Location :
Kuala Lumpur
Print_ISBN :
978-0-7695-3136-6
Electronic_ISBN :
978-0-7695-3136-6
DOI :
10.1109/AMS.2008.50