Frame-rate up-conversion using transmitted motion and segmentation fields for very low bit-rate video coding

We present a motion-compensated interpolation scheme that allows recovery of skipped frames at the receiver. The interpolation is performed based on an object-based interpretation of the video. The main advantage of the scheme is that the decoded motion and segmentation information is used without refinement. This is attributable to the fact that the object-based representation is true to the “real” motion. We present simulation results in a very low bit-rate coding environment, where multiple frames need to be skipped. The interpolated frames show good reconstruction quality, whereas standard block-based methods lead to unacceptable artifacts