Jointly optimized mode decisions in redundant video streaming

This paper revisits the problem of source-channel coding for error-resilient video streaming, using redundant encoding. We propose a new method to jointly optimize the macroblock (MB) mode in both the primary and the secondary, redundant encoding. Encoding decisions are based on end-to-end distortion using the ROPE estimate, and are adaptive at the MB level. Further, we present a reduced complexity approach to redundant encoding. The proposed methods are general in nature, and could be implemented on top of any (hybrid) video codec. An example implementation employs the redundant slice mechanism of H.264 (JM 13.2). Simulation results show significant performance gains over conventional methods such as fixed redundant encoding schemes or non-redundant optimal MB mode selection.