Title :
Video Inpainting on Digitized Vintage Films via Maintaining Spatiotemporal Continuity
Author :
Tang, Nick C. ; Hsu, Chiou-Ting ; Su, Chih-Wen ; Shih, Timothy K. ; Liao, Hong-Yuan Mark
Author_Institution :
Inst. of Inf. Sci., Acad. Sinica, Taipei, Taiwan
Abstract :
Video inpainting is an important video enhancement technique used to facilitate the repair or editing of digital videos. It has been employed worldwide to transform cultural artifacts such as vintage videos/films into digital formats. However, the quality of such videos is usually very poor and often contain unstable luminance and damaged content. In this paper, we propose a video inpainting algorithm for repairing damaged content in digitized vintage films, focusing on maintaining good spatiotemporal continuity. The proposed algorithm utilizes two key techniques. Motion completion recovers missing motion information in damaged areas to maintain good temporal continuity. Frame completion repairs damaged frames to produce a visually pleasing video with good spatial continuity and stabilized luminance. We demonstrate the efficacy of the algorithm on different types of video clips.
Keywords :
image enhancement; image restoration; motion estimation; video retrieval; video signal processing; damaged content repairing; digital video editing; digitized vintage film; frame completion repairs; missing motion information recovery; motion completion; spatiotemporal continuity; video clips; video enhancement technique; video inpainting algorithm; video quality; Algorithm design and analysis; Films; Maintenance engineering; Motion estimation; Spatiotemporal phenomena; Video sequences; Visualization; Frame completion; motion completion; motion estimation; video inpainting;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2011.2112642