Stage-lookahead dynamic programming algorithms for stochastic problems with time-lagged control dynamics

We investigate three stochastic problems (linear dynamics quadratic criterion, minimum-cost path, equipment replacement) with time-delayed control dynamics. We show how the concept of ¿stage lookahead¿ helps to reduce the number of arguments in the optimal value function of dynamic programming in order to alleviate the so-called curse of dimensionality.