DocumentCode
114527
Title
Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions
Author
Arapostathis, Ari ; Borkar, Vivek S. ; Kumar, K. Suresh
Author_Institution
Electr. & Comput. Eng, Univ. of Texas at Austin, Austin, TX, USA
fYear
2014
fDate
15-17 Dec. 2014
Firstpage
1103
Lastpage
1110
Abstract
We study the relative value iteration for the ergodic control problem under a near-monotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy initial value problem in ℝd. We show that this Cauchy problem stabilizes, or in other words, that the solution of the quasilinear parabolic equation converges for every bounded initial condition in C2(ℝd) to the solution of the Hamilton-Jacobi-Bellman (HJB) equation associated with the ergodic control problem.
Keywords
diffusion; iterative methods; stability; Cauchy initial value problem; HJB equation; Hamilton-Jacobi-Bellman equation; bounded initial condition; ergodic control problem; near-monotone running cost structure; nondegenerate diffusion; quasilinear parabolic equation; relative value iteration; stabilization; Aerospace electronics; Convergence; Equations; Markov processes; Mathematical model; Process control; Standards;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
Conference_Location
Los Angeles, CA
Print_ISBN
978-1-4799-7746-8
Type
conf
DOI
10.1109/CDC.2014.7039529
Filename
7039529
Link To Document