DocumentCode :
646195
Title :
Approximate dynamic programming for stochastic reachability
Author :
Kariotoglou, Nikolaos ; Summers, Sean ; Summers, Tyler ; Kamgarpour, Maryam ; Lygeros, John
Author_Institution :
ETH Zurich, Zurich, Switzerland
fYear :
2013
fDate :
17-19 July 2013
Firstpage :
584
Lastpage :
589
Abstract :
In this work we illustrate how approximate dynamic programing can be utilized to address problems of stochastic reachability in infinite state and control spaces. In particular we focus on the reach-avoid problem and approximate the value function on a linear combination of radial basis functions. In this way we get significant computational advantages with which we obtain tractable solutions to problems that cannot be solved via generic space gridding due to the curse of dimensionality. Numerical simulations indicate that control policies coming as a result of approximating the value function of stochastic reachability problems achieve close to optimal performance.
Keywords :
function approximation; neurocontrollers; optimal control; radial basis function networks; reachability analysis; stochastic systems; approximate dynamic programming; control space; curse-of-dimensionality; generic space gridding; infinite state space; numerical simulations; radial basis functions; reach-avoid problem; stochastic reachability problems; value function approximation; Aerospace electronics; Dynamic programming; Function approximation; Optimal control; Optimization; Stochastic processes;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Control Conference (ECC), 2013 European
Conference_Location :
Zurich
Type :
conf
Filename :
6669603
Link To Document :
بازگشت