DocumentCode :
2717444
Title :
A Dynamic Programming Approach to Viability Problems
Author :
Coquelin, Pierre-Arnaud ; Martin, Sophie ; Munos, Rémi
Author_Institution :
Centre de Mathematiques Appliquees, Ecole Polytechnique, Palaiseau
fYear :
2007
fDate :
1-5 April 2007
Firstpage :
178
Lastpage :
184
Abstract :
Viability theory considers the problem of maintaining a system under a set of viability constraints. The main tool for solving viability problems lies in the construction of the viability kernel, defined as the set of initial states from which there exists a trajectory that remains in the set of constraints indefinitely. The theory is very elegant and appears naturally in many applications. Unfortunately, the current numerical approaches suffer from low computational efficiency, which limits the potential range of applications of this domain. In this paper we show that the viability kernel is the zero-level set of a related dynamic programming problem, which opens promising research directions for numerical approximation of the viability kernel using tools from approximate dynamic programming. We illustrate the approach using k-nearest neighbors on a toy problem in two dimensions and on a complex dynamical model for anaerobic digestion process in four dimensions
Keywords :
approximation theory; dynamic programming; dynamics; optimal control; pattern recognition; anaerobic digestion process; complex dynamical model; dynamic programming; k-nearest neighbors; numerical approximation; toy problem; viability kernel; Computational efficiency; Constraint theory; Control systems; Dynamic programming; Evolution (biology); Grid computing; Kernel; Learning; Time factors; Uncertain systems;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Approximate Dynamic Programming and Reinforcement Learning, 2007. ADPRL 2007. IEEE International Symposium on
Conference_Location :
Honolulu, HI
Print_ISBN :
1-4244-0706-0
Type :
conf
DOI :
10.1109/ADPRL.2007.368186
Filename :
4220831
Link To Document :
بازگشت