Cooperative performance system based on virtual agents

In this paper, we propose a cooperative performance system based on virtual agents. To realize more intimate cooperation, it is necessary for the system to consider the feelings of the user, which reflect his/her personal taste and mental state. We propose a model of cooperation of the agents considering those feelings. In the model, emotional factors are expressed by the mental potential which is estimated based upon the relation between the agent´s behavior and the situation. The mental potential is used for cooperative decision making. A prototype system of creating a musical ensemble has been developed for evaluation and it is confirmed that the users were relatively satisfied with playing the music together with the agents