Optimal control problems with a continuous inequality constraint on the state and the control

We consider an optimal control problem with a nonlinear continuous inequality constraint. Both the state and the control are allowed to appear explicitly in this constraint. By discretizing the control space and applying a novel transformation, a corresponding class of semi-infinite programming problems is derived. A solution of each problem in this class furnishes a suboptimal control for the original problem. Furthermore, we show that such a solution can be computed efficiently using a penalty function method. On the basis of these two ideas, an algorithm that computes a sequence of suboptimal controls for the original problem is proposed. Our main result shows that the cost of these suboptimal controls converges to the minimum cost. For illustration, an example problem is solved.