Spatial and temporal correlation based frame rate up-conversion

In this paper, we present a new motion-compensated interpolation method for frame rate up-conversion based on spatial and temporal correlation. First, the motion vectors (MVs) embedded in the bit-stream are examined and corrected by using the spatial correlation in the MV field. Second, motion trajectory based MV estimation for the block in the interpolated frame is used to gain the initial value. Third, further refinement on the estimated MV is performed based on consideration of the spatial correlation in the interpolated frame and temporal correlation in the before and after frames together. Finally, bi-directional interpolation is applied to obtain final recovered pixels using the refined MV. Experimental results show that the proposed algorithm achieves a significant increase on PSNR and also a great improvement of visual performance.