• DocumentCode
    2717444
  • Title

    A Dynamic Programming Approach to Viability Problems

  • Author

    Coquelin, Pierre-Arnaud ; Martin, Sophie ; Munos, Rémi

  • Author_Institution
    Centre de Mathematiques Appliquees, Ecole Polytechnique, Palaiseau
  • fYear
    2007
  • fDate
    1-5 April 2007
  • Firstpage
    178
  • Lastpage
    184
  • Abstract
    Viability theory considers the problem of maintaining a system under a set of viability constraints. The main tool for solving viability problems lies in the construction of the viability kernel, defined as the set of initial states from which there exists a trajectory that remains in the set of constraints indefinitely. The theory is very elegant and appears naturally in many applications. Unfortunately, the current numerical approaches suffer from low computational efficiency, which limits the potential range of applications of this domain. In this paper we show that the viability kernel is the zero-level set of a related dynamic programming problem, which opens promising research directions for numerical approximation of the viability kernel using tools from approximate dynamic programming. We illustrate the approach using k-nearest neighbors on a toy problem in two dimensions and on a complex dynamical model for anaerobic digestion process in four dimensions
  • Keywords
    approximation theory; dynamic programming; dynamics; optimal control; pattern recognition; anaerobic digestion process; complex dynamical model; dynamic programming; k-nearest neighbors; numerical approximation; toy problem; viability kernel; Computational efficiency; Constraint theory; Control systems; Dynamic programming; Evolution (biology); Grid computing; Kernel; Learning; Time factors; Uncertain systems;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Approximate Dynamic Programming and Reinforcement Learning, 2007. ADPRL 2007. IEEE International Symposium on
  • Conference_Location
    Honolulu, HI
  • Print_ISBN
    1-4244-0706-0
  • Type

    conf

  • DOI
    10.1109/ADPRL.2007.368186
  • Filename
    4220831