Instantaneous Cost Functions in Optimally Controlled Stochastic Systems

The utility function describing the performance of a stochastic system is often a random variable. Exclusive concern with the mean value of this function obscures the intrinsically probabilistic nature of realized response. As the process evolves in time the perceived performance of the system is a stochastic process. Easily computed bounds on the maximum value of this process are presented here.