Value iteration methods in risk minimizing stopping problems

We consider an optimal stopping problem with a discrete time Markov process where the criterion function is a threshold probability. We give the fundamental properties of optimal values and optimal stopping times, but the optimal value and the optimal stopping time depend upon the threshold value. We also obtain the properties of optimal values with respect to the threshold value, and a value iteration method is given.