• DocumentCode
    114527
  • Title

    Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions

  • Author

    Arapostathis, Ari ; Borkar, Vivek S. ; Kumar, K. Suresh

  • Author_Institution
    Electr. & Comput. Eng, Univ. of Texas at Austin, Austin, TX, USA
  • fYear
    2014
  • fDate
    15-17 Dec. 2014
  • Firstpage
    1103
  • Lastpage
    1110
  • Abstract
    We study the relative value iteration for the ergodic control problem under a near-monotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy initial value problem in ℝd. We show that this Cauchy problem stabilizes, or in other words, that the solution of the quasilinear parabolic equation converges for every bounded initial condition in C2(ℝd) to the solution of the Hamilton-Jacobi-Bellman (HJB) equation associated with the ergodic control problem.
  • Keywords
    diffusion; iterative methods; stability; Cauchy initial value problem; HJB equation; Hamilton-Jacobi-Bellman equation; bounded initial condition; ergodic control problem; near-monotone running cost structure; nondegenerate diffusion; quasilinear parabolic equation; relative value iteration; stabilization; Aerospace electronics; Convergence; Equations; Markov processes; Mathematical model; Process control; Standards;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
  • Conference_Location
    Los Angeles, CA
  • Print_ISBN
    978-1-4799-7746-8
  • Type

    conf

  • DOI
    10.1109/CDC.2014.7039529
  • Filename
    7039529