Constrained model predictive control of jump linear systems with noise and non-observed Markov state

This paper presents a variational method to the solution of the model predictive control (MPC) of discrete-time Markov jump linear systems (MJLS) subject to noisy inputs and a quadratic performance index. Constraints appear on system state and input control variables in terms of the first two moments of the processes. The information available to the controller does not involve observations of the Markov chain state and, to solve the problem a sequence of linear feedback gains that is independent of the Markov state is adopted. The necessary conditions of optimality are provided by an equivalent deterministic form of expressing the stochastic MPC control problem subject to the constraints. A numerical solution that attains the necessary conditions for optimality and provides the feedback gain sequence is proposed. The solution is sought by an iterative method performing a variational search using a LMI formulation that takes the state and input constraints into account