Title :
New stochastic verification theorems
Author_Institution :
Dept. of Syst. Eng. & Eng. Manage., Chinese Univ. of Hong Kong, Shatin, Hong Kong
Abstract :
This paper studies controlled systems governed by Ito´s stochastic differential equations in which control variables are allowed to enter both drift and diffusion terms. It turns out that verification theorems still hold if the derivatives of the value functions are replaced by any point in the super-/sub-differentials. These new verification theorems are shown to have wider applicability than the restrictive classical verification theorems which require the associated dynamic programming equations to have smooth solutions. Based on the new verification result, optimal stochastic feedback controls are obtained by maximizing the generalized Hamiltonians over both the control regions and the super-differentials of the value functions
Keywords :
differential equations; diffusion; dynamic programming; feedback; optimal control; stochastic systems; Ito´s stochastic differential equations; diffusion; dynamic programming; feedback; generalized Hamiltonians; stochastic optimal control; stochastic systems; stochastic verification theorems; super-differentials; viscosity; Control systems; Costs; Differential equations; Dynamic programming; Extraterrestrial measurements; Optimal control; Research and development management; Stochastic processes; Systems engineering and theory; Viscosity;
Conference_Titel :
Decision and Control, 1995., Proceedings of the 34th IEEE Conference on
Conference_Location :
New Orleans, LA
Print_ISBN :
0-7803-2685-7
DOI :
10.1109/CDC.1995.478553