Discontinuous control problems with state constraints: Linear formulations and dynamic programming principles

This paper aims at studying a class of discontinuous deterministic control problems under state constraints using a linear programming approach. As for classical control problems (Gaitsgory and Quincampoix (2009) [16], Goreac and Serea (2011) [19]), the primal linear problem is stated on some appropriate space of probability measures. Naturally, the support of these measures is contained in the set of constraints. This linearized value function and its dual can, alternatively, be seen as the limit of standard penalized problems. Second, we provide a semigroup property for this set of probability measures leading to dynamic programming principles for control problems under state constraints. An abstract principle is provided for general bounded costs. Linearized versions are obtained under further (semi)continuity assumptions.