Frame-rate conversion for multiview video exploiting 3D motion models

A frame-rate conversion (FRC) scheme for increasing the frame-rate of multiview video for reduction of motion blur in hold-type displays is proposed. In order to obtain high quality inter-frames, the proposed method utilizes 3D motion models relying on the 3D scene information extractable from multiview video. First of all, independently moving objects (IMOs) are segmented by using a depth-based object segmentation method. Then, interest points on IMOs are obtained via scale invariant feature transform (SIFT). Estimating 3D rotation and translation matrices of moving rigid objects by the help of SIFT features between successive frames; 3D scene is reconstructed at any desired time instant. Inter-frames for the desired view of the multiview set are rendered by projecting the reconstructed 3D scene on this view. Simulation results reveal that, by utilizing true 3D object trajectory, the proposed method interpolates frames with increased quality compared to some conventional techniques.