Title :
Direct-comparison approach to continuous time Linear Quadratic Gaussian control problem
Author :
Wang, De-Xin ; Lu, Tao ; Cao, Xi-Ren
Author_Institution :
Dept. of Electron. & Comput. Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
Abstract :
Recently, a direct-comparison approach has been developed to control and optimize the performance of a stochastic Markov system, see for discrete time case, and for continuous time case. Compared with dynamic programming, the standard approach for stochastic control problem, this alternative approach is simple and intuitive. It is based on the direct comparison of the system performance under two policies, and discounting is not needed when dealing with long-run average criterion. By directly applying this approach, we studied the continuous time linear quadratic Gaussian (LQG) control problem, obtained the optimal policy for the long run average criterion without introducing discounting. The well known algebraic Riccati equation for the optimal policy can be easily obtained by this direct-comparison approach. This paper servers as an example to show the effectiveness of direct-comparison approach for the continuous time case.
Keywords :
Markov processes; linear quadratic Gaussian control; stochastic systems; algebraic Riccati equation; continuous time case; continuous time linear quadratic Gaussian control problem; direct-comparison approach; discrete time case; dynamic programming; stochastic Markov system; Automatic control; Automation; Control systems; Dynamic programming; Optimal control; Riccati equations; Stochastic processes; Stochastic systems; Symmetric matrices; System performance;
Conference_Titel :
Control and Automation, 2009. ICCA 2009. IEEE International Conference on
Conference_Location :
Christchurch
Print_ISBN :
978-1-4244-4706-0
Electronic_ISBN :
978-1-4244-4707-7
DOI :
10.1109/ICCA.2009.5410326