• DocumentCode
    646195
  • Title

    Approximate dynamic programming for stochastic reachability

  • Author

    Kariotoglou, Nikolaos ; Summers, Sean ; Summers, Tyler ; Kamgarpour, Maryam ; Lygeros, John

  • Author_Institution
    ETH Zurich, Zurich, Switzerland
  • fYear
    2013
  • fDate
    17-19 July 2013
  • Firstpage
    584
  • Lastpage
    589
  • Abstract
    In this work we illustrate how approximate dynamic programing can be utilized to address problems of stochastic reachability in infinite state and control spaces. In particular we focus on the reach-avoid problem and approximate the value function on a linear combination of radial basis functions. In this way we get significant computational advantages with which we obtain tractable solutions to problems that cannot be solved via generic space gridding due to the curse of dimensionality. Numerical simulations indicate that control policies coming as a result of approximating the value function of stochastic reachability problems achieve close to optimal performance.
  • Keywords
    function approximation; neurocontrollers; optimal control; radial basis function networks; reachability analysis; stochastic systems; approximate dynamic programming; control space; curse-of-dimensionality; generic space gridding; infinite state space; numerical simulations; radial basis functions; reach-avoid problem; stochastic reachability problems; value function approximation; Aerospace electronics; Dynamic programming; Function approximation; Optimal control; Optimization; Stochastic processes;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Control Conference (ECC), 2013 European
  • Conference_Location
    Zurich
  • Type

    conf

  • Filename
    6669603