Title :
A Learning Algorithm Based on PSO and L-M for Parity Problem
Author :
Guangyou, Yang ; Daode, Zhang
Author_Institution :
Hubei Univ. of Technol., Wuhan
Abstract :
Despite of the many successful applications of backpropagation (BP), it has many drawbacks. For complex problems, it may require a long time to train the networks, and it may run into local minima, and it may not train at all. Particle swarm optimization (PSO) algorithm is a global and stochastic algorithm based on population evolution which mode is simple, it is effective method for optimization of complex modeling. The paper uses PSO algorithm as learning algorithm of neural network used to solve parity problem. The PSO combined with Levenberg-Marquardt algorithm (modified BP algorithm) improve its performance. The simulation results show that this method not only increases the convergence rate of learning but it increases the likelihood of escaping from the local minima.
Keywords :
backpropagation; convergence; neural nets; parity; particle swarm optimisation; stochastic programming; Levenberg-Marquardt algorithm; backpropagation; convergence rate; learning algorithm; neural network; parity problem; particle swarm optimization; population evolution; stochastic algorithm; Backpropagation algorithms; Convergence; Mechanical engineering; Neural networks; Optimization methods; Particle swarm optimization; Stochastic processes; BP Networks; Levenberg-Marquardt Algorithm; PSO; Parity Problem;
Conference_Titel :
Control Conference, 2007. CCC 2007. Chinese
Conference_Location :
Hunan
Print_ISBN :
978-7-81124-055-9
Electronic_ISBN :
978-7-900719-22-5
DOI :
10.1109/CHICC.2006.4347369