Progressive sound rendering in multimedia applications

Realistic audio rendering is an integral part of any immersive multimedia applications. A progressive sound-rendering scheme, which integrates sound source modeling with sound transmission simulation, is proposed to generate D sound effects for multimedia applications. At first, sound source modeling is performed through either sinusoidal analysis of prerecorded sound or modal analysis of virtual object based on its geometry and material properties. Then, all the sub components derived are sorted according to perceptual criteria. Dependent on resource availability, the afterwards real time synthesis can be done in a progressive way and binaural filtering is integrated into this process directly