Communication architectures and algorithms for media mixing in multimedia conferences

The problem of media mixing that arises in teleconferencing applications such as teleorchestra is addressed. The mixing algorithm presented minimizes the difference between generation times of the media packets that are being mixed together in the absence of globally synchronized clocks, but in the presence of jitter in communication delays on packet switched networks. In order to support applications, such as teleorchestra, that involve a large number of participants, hierarchical mixing architectures are proposed, and it is shown that they are an order of magnitude more scalable than purely centralized or distributed architectures. Furthermore, mechanisms for minimizing the delays incurred by mixing in various communication architectures are presented. The mixing algorithms are implemented on a network of workstations connected by Ethernets, and the performance of various mixing architectures is experimentally evaluated. The results reveal the maximum number of participants that can be supported in a conference