Title :
An optimizer´s approach to stochastic control problems with nonclassical information structures
Author :
Kulkarni, Ankur A. ; Coleman, Todd P.
Author_Institution :
Coordinated Sci. Lab., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
Abstract :
We present an optimization-based approach to stochastic control problems with nonclassical information structures. We cast these problems equivalently as optimization problems on joint distributions. The resulting problems are necessarily nonconvex. Our approach to solving them is through convex relaxation. We solve the instance solved by Bansal and Başar [1] with a particular application of this approach that uses the data processing inequality for constructing the convex relaxation. Insights are obtained on the relation between the structure of cost functions and of convex relaxations for inverse optimal control.
Keywords :
optimal control; optimisation; stochastic systems; convex relaxation; cost functions; data processing inequality; inverse optimal control; nonclassical information structures; optimization-based approach; optimizer approach; stochastic control problems; Communication systems; Cost function; Decoding; Joints; Random variables; Standards;
Conference_Titel :
Decision and Control (CDC), 2012 IEEE 51st Annual Conference on
Conference_Location :
Maui, HI
Print_ISBN :
978-1-4673-2065-8
Electronic_ISBN :
0743-1546
DOI :
10.1109/CDC.2012.6426030