Title :
Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback
Author :
Charalambous, Charalambos D. ; Kourtellaris, Christos K. ; Hadjicostis, Christoforos
Author_Institution :
Dept. of Electr. Eng., Univ. of Cyprus, Nicosia, Cyprus
Abstract :
This paper is concerned with the joint design of encoder/control strategies which minimize a control payoff subject to a rate constraint on the feedback information provided by the system. The control system is described by a conditional distribution, while the rate is described by the directed information of a noisy communication channel. By generalizing the Posterior Matching Scheme (PMS), a scheme that achieves operational capacity, to channels with memory and feedback, the joint optimality of encoder/control strategies is analyzed. A principle of optimality is derived and a dynamic programming equation is obtained, which together describe how the optimal encoder/control strategies should be selected. It is shown that joint optimality separates into an optimal encoder strategy based on the PMS, and a control strategy obtained via the dynamic programming equation.
Keywords :
channel coding; dynamic programming; feedback; minimisation; optimal control; stochastic systems; telecommunication channels; telecommunication control; PMS; conditional distribution; control system design; dynamic programming equation; feedback information; joint optimal encoder-control strategy; memory; noisy communication channel; operational capacity; posterior matching scheme; stochastic control; Aerospace electronics; Control systems; Decoding; Dynamic programming; Joints; Kernel; Zinc;
Conference_Titel :
Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
978-1-61284-800-6
Electronic_ISBN :
0743-1546
DOI :
10.1109/CDC.2011.6161324