Title :
Maximum principle for optimal control problems of backward regime-switching systems involving impulse controls
Author :
Wang Shujun ; Wu Zhen
Author_Institution :
Sch. of Math., Shandong Univ., Jinan, China
Abstract :
In this paper, we derive the stochastic maximum principle for optimal control problems of the backward Markovian regime-switching systems involving impulse controls. The control system is described by a backward stochastic differential equation involving impulse controls and modulated by continuous-time, finite-state Markov chains. Besides the Markov chains, the most distinguishing features of our problem are that the control variables consist of two parts: regular and impulsive control, and that the domain of regular control is not necessarily convex. We obtain the necessary and sufficient conditions for optimal controls. Thereafter, we apply the theoretical results to a linear-quadratic problem with impulsive control and Markovian regime-switching.
Keywords :
Markov processes; continuous time systems; differential equations; maximum principle; stochastic systems; backward Markovian regime switching system; backward stochastic differential equation; continuous time system; control variables; finite state Markov chains; impulse contol; linear quadratic problem; necessary and sufficient conditions; optimal control problem; regular control; stochastic maximum principle; Differential equations; Equations; Markov processes; Optimal control; Trajectory; Backward stochastic differential equations; Impulse controls; Linear-quadratic problem; Markov chains; Maximum principle; Regime-switching systems;
Conference_Titel :
Control Conference (CCC), 2014 33rd Chinese
Conference_Location :
Nanjing
DOI :
10.1109/ChiCC.2014.6896520