Title :
A Gaussian Processes Reinforcement Learning Method in Large Discrete State Spaces
Author :
Wen-yun Zhou ; Quan Liu
Author_Institution :
Inst. of Comput. Sci. & Technol., Soochow Univ., Soochow
Abstract :
In order to solve the problem of "curse of dimensionality", which means that the state spaces will grow exponentially in the number of features, in large discrete state spaces in reinforcement learning, a reinforcement learning method based on Gaussian processes is proposed. The Gaussian processes model can represent the distributions of functions, and it can be used to get a distribution of the expectation instead of its value. The experiment result shows that the performance such as speed of convergence and final effect can be improved obviously. The "curse of dimensionality" in large discrete state spaces could be solved to ascertain extent with the GP regression model.
Keywords :
Gaussian processes; learning (artificial intelligence); regression analysis; Gaussian processes reinforcement learning method; curse of dimensionality problem; large discrete state spaces; regression model; Bayesian methods; Computer science; Convergence; Gaussian processes; Laboratories; Learning systems; Performance analysis; Process control; Space technology; State-space methods; Gaussian processes; Reinforcement learning; curse of dimensionality;
Conference_Titel :
Advanced Computer Control, 2009. ICACC '09. International Conference on
Conference_Location :
Singapore
Print_ISBN :
978-1-4244-3330-8
DOI :
10.1109/ICACC.2009.19