Title :
Optimal node visitation in acyclic stochastic digraphs
Author :
Bountourelis, Theologos ; Reveliotis, Spyros
Author_Institution :
Sch. of Ind. & Syst. Eng., Georgia Inst. of Technol., Atlanta, GA
Abstract :
Given a stochastic, acyclic, connected digraph with a single source node and a control agent that repetitively traverses this graph, each time starting from the source node, we want to define a control policy that will enable this agent to visit each of the graph terminal nodes a prespecified number of times, while minimizing the expected number of the graph traversals. We first formulate this problem as a specially structured discrete time Markov decision process, and we subsequently develop an asymptotically optimal randomized policy of polynomial complexity with respect to the problem size
Keywords :
Markov processes; computational complexity; graph theory; minimisation; acyclic stochastic digraphs; control agent; control policy; discrete time Markov decision process; graph traversals minimization; optimal node visitation; optimal randomized policy; polynomial complexity; Computational complexity; Control systems; Electrical equipment industry; Industrial control; Optimal control; Performance evaluation; Polynomials; Stochastic processes; Stochastic systems; Systems engineering and theory;
Conference_Titel :
Discrete Event Systems, 2006 8th International Workshop on
Conference_Location :
Ann Arbor, MI
Print_ISBN :
1-4244-0053-8
DOI :
10.1109/WODES.2006.382394