Title :
Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions
Author :
Arapostathis, Ari ; Borkar, Vivek S. ; Kumar, K. Suresh
Author_Institution :
Electr. & Comput. Eng, Univ. of Texas at Austin, Austin, TX, USA
Abstract :
We study the relative value iteration for the ergodic control problem under a near-monotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy initial value problem in ℝd. We show that this Cauchy problem stabilizes, or in other words, that the solution of the quasilinear parabolic equation converges for every bounded initial condition in C2(ℝd) to the solution of the Hamilton-Jacobi-Bellman (HJB) equation associated with the ergodic control problem.
Keywords :
diffusion; iterative methods; stability; Cauchy initial value problem; HJB equation; Hamilton-Jacobi-Bellman equation; bounded initial condition; ergodic control problem; near-monotone running cost structure; nondegenerate diffusion; quasilinear parabolic equation; relative value iteration; stabilization; Aerospace electronics; Convergence; Equations; Markov processes; Mathematical model; Process control; Standards;
Conference_Titel :
Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
Conference_Location :
Los Angeles, CA
Print_ISBN :
978-1-4799-7746-8
DOI :
10.1109/CDC.2014.7039529