• DocumentCode
    2653984
  • Title

    A Gaussian Processes Reinforcement Learning Method in Large Discrete State Spaces

  • Author

    Wen-yun Zhou ; Quan Liu

  • Author_Institution
    Inst. of Comput. Sci. & Technol., Soochow Univ., Soochow
  • fYear
    2009
  • fDate
    22-24 Jan. 2009
  • Firstpage
    589
  • Lastpage
    593
  • Abstract
    In order to solve the problem of "curse of dimensionality", which means that the state spaces will grow exponentially in the number of features, in large discrete state spaces in reinforcement learning, a reinforcement learning method based on Gaussian processes is proposed. The Gaussian processes model can represent the distributions of functions, and it can be used to get a distribution of the expectation instead of its value. The experiment result shows that the performance such as speed of convergence and final effect can be improved obviously. The "curse of dimensionality" in large discrete state spaces could be solved to ascertain extent with the GP regression model.
  • Keywords
    Gaussian processes; learning (artificial intelligence); regression analysis; Gaussian processes reinforcement learning method; curse of dimensionality problem; large discrete state spaces; regression model; Bayesian methods; Computer science; Convergence; Gaussian processes; Laboratories; Learning systems; Performance analysis; Process control; Space technology; State-space methods; Gaussian processes; Reinforcement learning; curse of dimensionality;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Advanced Computer Control, 2009. ICACC '09. International Conference on
  • Conference_Location
    Singapore
  • Print_ISBN
    978-1-4244-3330-8
  • Type

    conf

  • DOI
    10.1109/ICACC.2009.19
  • Filename
    4777410