Title :
On subspace decompositions of finite horizon DP problems with switched linear dynamics
Author :
Tsakiris, Manolis C. ; Tarraf, Danielle C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Johns Hopkins Univ., Baltimore, MD, USA
Abstract :
We consider finite horizon dynamic programming problems for switched linear dynamics over a finite dimensional but otherwise arbitrary state-space, where the cost function depends only on the state. We start from a decomposition of the underlying state-space as the sum of invariant subspaces under all linear transformations induced by the input, and pose the following question: Assuming the cost function has an additive structure compatible with the state-space decomposition, under what conditions does the cost-to-go function also exhibit an additive structure? We begin by deriving a necessary and sufficient condition for the existence of this additive structure. We then propose a sufficient condition, expressed in terms of the cardinality of the input set: While not necessary, this condition has the advantage of being readily verifiable. Finally, we characterize the resulting reduction in complexity for the case of systems with finite state-spaces, and we conclude with a simple illustrative example.
Keywords :
dynamic programming; multidimensional systems; state-space methods; time-varying systems; additive structure; cost function; cost-to-go function; finite dimensional system; finite horizon DP problems; finite horizon dynamic programming problems; invariant subspaces; linear transformations; state-space decomposition; subspace decompositions; switched linear dynamics; Additives; Complexity theory; Cost function; Dynamic programming; Equations; Gold; Switches;
Conference_Titel :
Decision and Control (CDC), 2013 IEEE 52nd Annual Conference on
Conference_Location :
Firenze
Print_ISBN :
978-1-4673-5714-2
DOI :
10.1109/CDC.2013.6760725