DocumentCode :
2771244
Title :
The Adaptive Critic Learning Agent (ACLA) algorithm: Towards problem independent neural network based optimizers
Author :
Ravishankar, Udhay ; Manic, Milos
Author_Institution :
Electr. & Comput. Eng. Dept., Univ. of Idaho, Idaho Falls, ID, USA
fYear :
2012
fDate :
10-15 June 2012
Firstpage :
1
Lastpage :
7
Abstract :
This paper presents the development of a new neural network based optimizer called the Adaptive Critic Learning Agent (ACLA) algorithm. The ACLA algorithm is based on the traditional Adaptive Critic Design (ACD) algorithm and hence its name. Conventional neural network based optimizers use the principle of Hopfield/Tank Neural Networks (HTNN) to solve unimodal optimization problems. These neural networks require tailored structures for the specific optimization problem. The ACLA algorithm presented in this paper uses a general randomly initialized neural network to solve any unimodal optimization problem. This is achieved by extending the principles of the traditional ACD algorithm for the ACLA algorithm. Other attributes of the ACLA algorithm are related to the issues with swarm based optimizers such as Particle Swarm Optimization (PSO) and Genetic Algorithms (GA). These issues are: (1) large memory requirements and (2) multiple parameters required to tune the algorithm´s convergence performance. The ACLA algorithm resolves these issues by: (1) using only one neuron to reduce memory requirements and (2) using only a single learning coefficient parameter to tune the algorithm´s convergence performance. The ACLA algorithm was tested and compared with three swarm based optimizers on two unimodal benchmark problems typically used for PSO and GA algorithms. Test results proved the ACLA algorithm to converge to solutions 7 orders greater than the swarm based algorithms. The ACLA algorithm was further tested on two multimodal benchmark problems to demonstrate its capability to converge to nearest local minima.
Keywords :
convergence; genetic algorithms; learning (artificial intelligence); mathematics computing; neural nets; particle swarm optimisation; ACD algorithm; ACLA algorithm; GA; HTNN; Hopfield/Tank neural networks; PSO; adaptive critic design algorithm; adaptive critic learning agent algorithm; algorithm convergence performance tuning; genetic algorithms; learning coefficient parameter; local minima; memory requirement reduction; neurons; particle swarm optimization; problem independent neural network-based optimizers; swarm-based optimizers; unimodal benchmark problems; unimodal optimization problems; Algorithm design and analysis; Benchmark testing; Biological neural networks; Equations; Mathematical model; Optimization; Adaptive Critic Design; Neural Networks; Swarm Intelligence;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location :
Brisbane, QLD
ISSN :
2161-4393
Print_ISBN :
978-1-4673-1488-6
Electronic_ISBN :
2161-4393
Type :
conf
DOI :
10.1109/IJCNN.2012.6252475
Filename :
6252475
Link To Document :
بازگشت