Towards a simulation of conversations with expressive embodied speakers and listeners

In this paper we present some results to model complex interactions among virtual characters that participate in negotiation dialogues as well as our work related to a gaze model that controls the eye behavior of several agents conversing with each other. As a test-bed we have created an Avatar Arena in which several avatars negotiate on meeting arrangement tasks on behalf of their users. To enhance the naturalness of the emerging negotiation dialogues we need to determine both the behaviors of speakers as well as the behaviors of listening characters. In our approach we try to exploit socio-physiological concepts, such as cognitive balance and dissonance to determine verbal and nonverbal behavior of all dialogue participants. We pay particular attention to the gaze behavior of the speaker considering the communicative functions the speaker desires to communicate as well as a statistical model of eye movements. In addition, a model of gaze behavior for listeners is also proposed.