Frame rate control for video streaming

This paper aims to reduce the amount of prebuffering required to ensure a maximum video continuity in streaming. Current approaches do this by slowing the playout frame rate of the decoder, this is known as adaptive media playout (AMP). However, doing this introduces playout distortion to the viewers as the video is played slower than its natural playout rate. We approach this by proposing a frame rate control scheme that jointly adjusts the encoder frame generation rate of the encoder and the playout frame rate of the decoder. This is done such that the scheme can choose to sacrifice the frame quality or continuity of the video to reduce the playout distortion introduced. This implies that the scheme needs to find the optimal trade-off between frame quality, playout distortion and video continuity. To do that, we characterize the frame rate control problem using Lyapunov optimization. We then systematically derive the optimization policies. We also show that these policies can be decoupled into separate encoder and decoder optimization policies, thus allowing for a distributed implementation. Simulation results show significant reductions in the prebuffering requirements over a scheme that perform no frame rate control and lower playout distortions compared to the AMP schemes, while exhibiting a modest drop in frame quality.