Automatic closed eye correction

On a large group picture, having all people open their eyes can turn out to be a difficult task for photographers. Therefore, in this paper, we describe an original method to automatically correct closed eyes on everyday pictures. For this aim, we explore the combination possibilities of (1) active shape model (ASM) to detect facial features, such as eyes, nose and head shape, and (2) Poisson editing to clone open eyes seamlessly. To improve the performance of seamless cloning, we suggest a pre-processing method that adjusts skin luminosity between two pictures. A nearest neighbor-based search to find the best suited pair of eyes among a set of donor candidates is also presented. We applied the proposed algorithm on several pictures and obtained very natural results, which demonstrates the validity of our approach.