Optimal decision-making in discrete stochastic systems

Sequential search strategies for the determination of a minimum cost control alternative from a finite set in a stochastic environment are considered. The problem is equivalent to search of a "hill of uncertainty" in a decision space; any strategy defines a particular path descending the hill. Optimal decision strategies are identified for the two distinct cases of on-line or adaptive control, and off-line search.