Approximation of Expected Reward Value in MMDP

Among researchers in multi-agent systems, there has been growing interest in a coordination problem, particularly when agents´ behaviors are stochastic. A multiagent Markov Decision Process MMDP is an efficient way to obtain an optimal suite of decisions that all agents have to take. But, a hard computation is required to solve it. Proposed methods to solve an MMDP depend on the fact that each agent has precise knowledge about the behaviors of the others. In this paper, we consider a fully cooperative multi-agent system where agents have to coordinate their uncertain behaviors. In this system, an agent can partially observe the state of the others. We present a method allowing agents to construct and to solve an MMDP by exchanging the expected reward value of some states. For large systems, we present a model to approximate the expected reward value using the distributed MDPs.