A Multi-agent Reinforcement Learning Model for Service Composition

This paper describes a multi-agent reinforcement learning model for the optimization of Web service composition. Based on the model, we propose a multiagent Q-learning algorithm, where each agent would benefit from the advice of other agents in team. In contrast to single-agent reinforcement learning, our algorithm can speed up convergence to optimal policy. In addition, it allows composite service to dynamically adjust itself to fit the varying environment, where the properties of the component services continue changing. Our experiments demonstrate the efficiency of our algorithm.