DocumentCode
496119
Title
Application of Fuzzy Inference System to Average Reward Reinforcement Learning
Author
Chen, Wei ; Zhai, Zhenkun ; Li, Xiong ; Guo, Jing
Author_Institution
Fac. o Autom., Guangdong Univ. of Technol., Guangzhou, China
Volume
1
fYear
2009
fDate
25-26 July 2009
Firstpage
374
Lastpage
377
Abstract
To enhance the generalization ability of average reward reinforcement in continuous state space, this paper proposes an improved algorithm based on fuzzy inference system. In reinforcement learning, agent accesses to knowledge through the interaction with the environment. The reward signal from the environment carries out comprehensive appraisal of the effect of the action, which is operated by the agent. However, when the learning environment is complex and continuous, it will increase the difficulty of learning process and reduce the learning efficiency, even can not accomplish. In response to these disadvantages, we use fuzzy inference system as the approximator to generalize the continuous state space. Duo to this solution, the application scope of reinforcement learning can be effectively expanded. To verify the reasonableness of algorithm, we apply new version to Robocup simulation soccer. Through the analysis of experimental data, the results show that the performance of the improved algorithm is better than the original algorithm.
Keywords
function approximation; fuzzy reasoning; fuzzy systems; generalisation (artificial intelligence); learning (artificial intelligence); mobile robots; multi-robot systems; state-space methods; Robocup simulation soccer; agent interaction; average reward reinforcement learning algorithm; continuous state space function approximator; fuzzy inference system; generalization ability; Computer science; Fuzzy systems; Information technology; Learning; R-learning; fuzzy inference system; generalization; reinforcement learning;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Technology and Computer Science, 2009. ITCS 2009. International Conference on
Conference_Location
Kiev
Print_ISBN
978-0-7695-3688-0
Type
conf
DOI
10.1109/ITCS.2009.80
Filename
5190090
Link To Document