Minimum delay routing in stochastic network

The authors consider the problem of traveling with least expected delay in networks whose link delays change probabilistically according to Markov chains. This is a typical routing problem in dynamic computer communication networks. Several optimization problems, posed on infinite and finite horizons, are formulated, and they are considered with and without using memory in the decision-making process. It is proved that all these problems are, in general, intractable. However, for networks with nodal stochastic delays, a simple polynomial optimal solution is presented. This is typical of high-speed networks, in which the dominant delays are incurred by the nodes. For more general networks, a tractable ∈-optimal solution is presented