• DocumentCode
    496119
  • Title

    Application of Fuzzy Inference System to Average Reward Reinforcement Learning

  • Author

    Chen, Wei ; Zhai, Zhenkun ; Li, Xiong ; Guo, Jing

  • Author_Institution
    Fac. o Autom., Guangdong Univ. of Technol., Guangzhou, China
  • Volume
    1
  • fYear
    2009
  • fDate
    25-26 July 2009
  • Firstpage
    374
  • Lastpage
    377
  • Abstract
    To enhance the generalization ability of average reward reinforcement in continuous state space, this paper proposes an improved algorithm based on fuzzy inference system. In reinforcement learning, agent accesses to knowledge through the interaction with the environment. The reward signal from the environment carries out comprehensive appraisal of the effect of the action, which is operated by the agent. However, when the learning environment is complex and continuous, it will increase the difficulty of learning process and reduce the learning efficiency, even can not accomplish. In response to these disadvantages, we use fuzzy inference system as the approximator to generalize the continuous state space. Duo to this solution, the application scope of reinforcement learning can be effectively expanded. To verify the reasonableness of algorithm, we apply new version to Robocup simulation soccer. Through the analysis of experimental data, the results show that the performance of the improved algorithm is better than the original algorithm.
  • Keywords
    function approximation; fuzzy reasoning; fuzzy systems; generalisation (artificial intelligence); learning (artificial intelligence); mobile robots; multi-robot systems; state-space methods; Robocup simulation soccer; agent interaction; average reward reinforcement learning algorithm; continuous state space function approximator; fuzzy inference system; generalization ability; Computer science; Fuzzy systems; Information technology; Learning; R-learning; fuzzy inference system; generalization; reinforcement learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Technology and Computer Science, 2009. ITCS 2009. International Conference on
  • Conference_Location
    Kiev
  • Print_ISBN
    978-0-7695-3688-0
  • Type

    conf

  • DOI
    10.1109/ITCS.2009.80
  • Filename
    5190090