DocumentCode :
2961297
Title :
Auditory dialog analysis and understanding by generative modelling of interactional dynamics
Author :
Cristani, Matteo ; Pesarin, A. ; Drioli, C. ; Tavano, A. ; Perina, A. ; Murino, Vittorio
Author_Institution :
Dipt. di Inf., Univ. of Verona, Verona, Italy
fYear :
2009
fDate :
20-25 June 2009
Firstpage :
103
Lastpage :
109
Abstract :
In the last few years, the interest in the analysis of human behavioral schemes has dramatically grown, in particular for the interpretation of the communication modalities called social signals. They represent well defined interaction patterns, possibly unconscious, characterizing different conversational situations and behaviors in general. In this paper, we illustrate an automatic system based on a generative structure able to analyze conversational scenarios. The generative model is composed by integrating a Gaussian mixture model and the (observed) influence model, and it is fed with a novel kind of simple low-level auditory social signals, which are termed steady conversational periods (SCPs). These are built on duration of continuous slots of silence or speech, taking also into account conversational turn-taking. The interactional dynamics built upon the transitions among SCPs provide a behavioral blueprint of conversational settings without relying on segmental or continuous phonetic features. Our contribution here is to show the effectiveness of our model when applied on dialogs classification and clustering tasks, considering dialogs between adults and between children and adults, in both flat and arguing discussions, and showing excellent performances also in comparison with state-of-the-art frameworks.
Keywords :
Gaussian processes; audio signal processing; signal classification; social sciences computing; Gaussian mixture model; auditory dialog analysis; clustering tasks; communication modalities; dialogs classification; generative modelling; human behavioral schemes; interactional dynamics; low-level auditory social signals; steady conversational periods; Character generation; Humans; Psychology; Signal analysis; Signal generators; Signal processing; Speech analysis;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Vision and Pattern Recognition Workshops, 2009. CVPR Workshops 2009. IEEE Computer Society Conference on
Conference_Location :
Miami, FL
ISSN :
2160-7508
Print_ISBN :
978-1-4244-3994-2
Type :
conf
DOI :
10.1109/CVPRW.2009.5204265
Filename :
5204265
Link To Document :
بازگشت