Background modeling for video coding: From sprites to Global Motion Temporal filtering

Techniques for modeling the background of a video sequence can be useful in alternative video coding approaches. Sprite coding has been evolved to provide high quality decoded video frames after transmission by a reduced amount of bits. However, it has also been shown that this works only for a certain kind of video sequences. It also meets quality limits due to the Sprite generation step. To tackle this problem, multiple Sprites have been proposed. Considering the improved quality coming with multiple Sprites, a method has been developed which provides an optimal quality, i.e. local background Sprite generation. This method can be used to conduct Global Motion Temporal Filtering (GMTF) of distorted video frames. In a first application, GMTF is applied as a post-processing deblocking filter in a video coding environment, which is experimentally evaluated.