DocumentCode :
2053589
Title :
Increasing the flexibility and speed of convergence of a learning agent
Author :
Santibanez, Miguel A Soto ; Marefat, Michael M.
Author_Institution :
Dept. of Electr. & Comput. Eng., Arizona Univ., Tucson, AZ, USA
Volume :
3
fYear :
2001
fDate :
2001
Firstpage :
1748
Abstract :
A review of the basic methods used to model a learning agent, such as instance-based learning, artificial neural networks and reinforcement learning, suggests that they either lack flexibility (can only be used to solve a small number of problems) or they tend to converge very slowly to the optimal policy. This paper describes and illustrates a set of processes that address these two shortcomings. The resulting learning agent is able to "adapt fairly well" to a much larger set of environments and is capable of doing this in a reasonable amount of time. In order to address the lack of flexibility and slow convergence to the optimal policy, the new learning agent becomes a hybrid between a learning agent based on instance-based learning and one based on reinforcement learning. To accelerate its convergence to its optimal policy, this new learning agent incorporates the use of a new concept we call propagation of good findings. Furthermore, to make a better use of the learning agent\´s memory resources,, and therefore increase its flexibility, we make use of another new concept we call moving prototypes
Keywords :
learning (artificial intelligence); neural nets; software agents; artificial neural networks; instance-based learning; learning agent; moving prototypes; reinforcement learning; slow convergence; speed of convergence; Accelerated aging; Artificial neural networks; Computer networks; Convergence; Learning; Leg; Neural networks; Prototypes; Robustness; Training data;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Systems, Man, and Cybernetics, 2001 IEEE International Conference on
Conference_Location :
Tucson, AZ
ISSN :
1062-922X
Print_ISBN :
0-7803-7087-2
Type :
conf
DOI :
10.1109/ICSMC.2001.973538
Filename :
973538
Link To Document :
بازگشت