DocumentCode
2653984
Title
A Gaussian Processes Reinforcement Learning Method in Large Discrete State Spaces
Author
Wen-yun Zhou ; Quan Liu
Author_Institution
Inst. of Comput. Sci. & Technol., Soochow Univ., Soochow
fYear
2009
fDate
22-24 Jan. 2009
Firstpage
589
Lastpage
593
Abstract
In order to solve the problem of "curse of dimensionality", which means that the state spaces will grow exponentially in the number of features, in large discrete state spaces in reinforcement learning, a reinforcement learning method based on Gaussian processes is proposed. The Gaussian processes model can represent the distributions of functions, and it can be used to get a distribution of the expectation instead of its value. The experiment result shows that the performance such as speed of convergence and final effect can be improved obviously. The "curse of dimensionality" in large discrete state spaces could be solved to ascertain extent with the GP regression model.
Keywords
Gaussian processes; learning (artificial intelligence); regression analysis; Gaussian processes reinforcement learning method; curse of dimensionality problem; large discrete state spaces; regression model; Bayesian methods; Computer science; Convergence; Gaussian processes; Laboratories; Learning systems; Performance analysis; Process control; Space technology; State-space methods; Gaussian processes; Reinforcement learning; curse of dimensionality;
fLanguage
English
Publisher
ieee
Conference_Titel
Advanced Computer Control, 2009. ICACC '09. International Conference on
Conference_Location
Singapore
Print_ISBN
978-1-4244-3330-8
Type
conf
DOI
10.1109/ICACC.2009.19
Filename
4777410
Link To Document