Manipulation of vocal signal in mixed music signal using side information of F0 and backing spectrum

We have been developing a system that enables a listener of streaming audio to control the volume of independent part in a mixed audio signal in real-time. In the previous work, we proposed the basic framework of the system and proved the effectiveness of the proposed method. In this paper, we proposed a method to improve the quality of manipulated audio signal by improving the side information. The basic idea of the proposed method is to consider the ratio between the level of the signal to be manipulated and the backing signal. As an experimental result, we obtained that the proposed method improved the quality of the manipulated signal using 4 kbit/s side information.