Optimal linear regulators: The discrete-time case

In this paper the optimal discrete-time linear-quadratic regulator problem is carefully presented and the basic results are reviewed. Dynamic programming is used to determine the optimization equations. Special attention is given to problems unique to the discrete-time case; this includes, for example, the possibility of a singular system matrix and a singular control-effort weighting matrix. Some problems associated with sampled-data systems are also summarized, e.g., sensitivity to sampling time, and loss of controllability due to sampling. Computational methods for the solution of the optimization equations are outlined and a simple example is included to illustrate the various computational approaches.