DocumentCode :
496119
Title :
Application of Fuzzy Inference System to Average Reward Reinforcement Learning
Author :
Chen, Wei ; Zhai, Zhenkun ; Li, Xiong ; Guo, Jing
Author_Institution :
Fac. o Autom., Guangdong Univ. of Technol., Guangzhou, China
Volume :
1
fYear :
2009
fDate :
25-26 July 2009
Firstpage :
374
Lastpage :
377
Abstract :
To enhance the generalization ability of average reward reinforcement in continuous state space, this paper proposes an improved algorithm based on fuzzy inference system. In reinforcement learning, agent accesses to knowledge through the interaction with the environment. The reward signal from the environment carries out comprehensive appraisal of the effect of the action, which is operated by the agent. However, when the learning environment is complex and continuous, it will increase the difficulty of learning process and reduce the learning efficiency, even can not accomplish. In response to these disadvantages, we use fuzzy inference system as the approximator to generalize the continuous state space. Duo to this solution, the application scope of reinforcement learning can be effectively expanded. To verify the reasonableness of algorithm, we apply new version to Robocup simulation soccer. Through the analysis of experimental data, the results show that the performance of the improved algorithm is better than the original algorithm.
Keywords :
function approximation; fuzzy reasoning; fuzzy systems; generalisation (artificial intelligence); learning (artificial intelligence); mobile robots; multi-robot systems; state-space methods; Robocup simulation soccer; agent interaction; average reward reinforcement learning algorithm; continuous state space function approximator; fuzzy inference system; generalization ability; Computer science; Fuzzy systems; Information technology; Learning; R-learning; fuzzy inference system; generalization; reinforcement learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Technology and Computer Science, 2009. ITCS 2009. International Conference on
Conference_Location :
Kiev
Print_ISBN :
978-0-7695-3688-0
Type :
conf
DOI :
10.1109/ITCS.2009.80
Filename :
5190090
Link To Document :
بازگشت