Feedback under Control-Dependent Markov Disturbances: A Discrete Maximum Principle

A necessary condition of a stochastic maximum principle type is given for an optimal solution of discrete-time feedback control problems under Markov disturbances depending on control parameters. Q 1996 Academic Press, Inc.