Real-time video frame rate adaptation based on warping of edge-preserving meshes

We propose a technique for the real-time synthesis of temporally interpolated video frames suitable for low bandwidth applications. The system is based on the warping of edge preserving meshes. Node selection segments the scene and places mesh nodes on top of object edges in the reference frame. Constrained Delaunay triangulation is used to create a mesh that keeps triangulation edges aligned with object edges in the scene. Node displacements are estimated and several interpolated frames may be synthesized between each pair of original frames without the need for fitting a new mesh to the reference frame. Each of the interpolated frames is synthesized by warping the mesh. We present experimental results that demonstrate the performance and applicability of the proposed method