Frame rate up-conversion with motion region segmentation based optimization

Frame rate up conversion (FRUC) is used to enhance the visual quality of low frame rate materials by inserting the predicted frames into the original sequence. In this paper, we propose a novel FRUC algorithm which uses motion region segmentation technology to optimize the result. Firstly, block-matching algorithm (BMA) is employed to track the motion of each block between the adjacent two fames and motion vector refinement (MVF) is used to process the motion vectors. Secondly, we segment the motion region based on the motion vectors acquired in the first step, correct partial isolated motion vectors and classify them to the nearest region. Finally, we use variable size overlapped block motion compensation (OBMC) based on motion region segmentation result to interpolate the intermediate frame. The coefficient of the two original frames is also influenced by the segmentation result. Experiment results show that the proposed algorithm can achieve better effect compared with conventional methods both subjectively and objectively.