DocumentCode
646195
Title
Approximate dynamic programming for stochastic reachability
Author
Kariotoglou, Nikolaos ; Summers, Sean ; Summers, Tyler ; Kamgarpour, Maryam ; Lygeros, John
Author_Institution
ETH Zurich, Zurich, Switzerland
fYear
2013
fDate
17-19 July 2013
Firstpage
584
Lastpage
589
Abstract
In this work we illustrate how approximate dynamic programing can be utilized to address problems of stochastic reachability in infinite state and control spaces. In particular we focus on the reach-avoid problem and approximate the value function on a linear combination of radial basis functions. In this way we get significant computational advantages with which we obtain tractable solutions to problems that cannot be solved via generic space gridding due to the curse of dimensionality. Numerical simulations indicate that control policies coming as a result of approximating the value function of stochastic reachability problems achieve close to optimal performance.
Keywords
function approximation; neurocontrollers; optimal control; radial basis function networks; reachability analysis; stochastic systems; approximate dynamic programming; control space; curse-of-dimensionality; generic space gridding; infinite state space; numerical simulations; radial basis functions; reach-avoid problem; stochastic reachability problems; value function approximation; Aerospace electronics; Dynamic programming; Function approximation; Optimal control; Optimization; Stochastic processes;
fLanguage
English
Publisher
ieee
Conference_Titel
Control Conference (ECC), 2013 European
Conference_Location
Zurich
Type
conf
Filename
6669603
Link To Document