Modeling Dynamic Structure of Human Verbal and Nonverbal Communication

In human communication, dynamics of communication, i.e. timing structure of utterances, nodding, gesture, pause and so on, plays a crucial role to realize smooth natural communication. We proposed a computational scheme named interval-based linear hybrid dynamical system (ILHDS, in short) for modeling complex dynamic events and conducted several experiments to explore characteristics of dynamic structures of human verbal and nonverbal communication based on ILHDS. In the paper, we describe the theoretical scheme of ILHDS followed by its practical applications