Title :
Multiframe demosaicing and super-resolution of color images
Author :
Farsiu, Sina ; Elad, Michael ; Milanfar, Peyman
Author_Institution :
Electr. Eng. Dept., California Univ., Santa Cruz, CA, USA
Abstract :
In the last two decades, two related categories of problems have been studied independently in image restoration literature: super-resolution and demosaicing. A closer look at these problems reveals the relation between them, and, as conventional color digital cameras suffer from both low-spatial resolution and color-filtering, it is reasonable to address them in a unified context. In this paper, we propose a fast and robust hybrid method of super-resolution and demosaicing, based on a maximum a posteriori estimation technique by minimizing a multiterm cost function. The L1 norm is used for measuring the difference between the projected estimate of the high-resolution image and each low-resolution image, removing outliers in the data and errors due to possibly inaccurate motion estimation. Bilateral regularization is used for spatially regularizing the luminance component, resulting in sharp edges and forcing interpolation along the edges and not across them. Simultaneously, Tikhonov regularization is used to smooth the chrominance components. Finally, an additional regularization term is used to force similar edge location and orientation in different color channels. We show that the minimization of the total cost function is relatively easy and fast. Experimental results on synthetic and real data sets confirm the effectiveness of our method.
Keywords :
image resolution; image segmentation; maximum likelihood estimation; motion estimation; optical filters; Tikhonov regularization; bilateral regularization; chrominance components; color digital cameras; color image superresolution; color-filtering; cost function; image restoration; low-spatial resolution; luminance component; maximum a posteriori estimation; motion estimation; multiframe demosaicing; multiterm cost function; Color; Cost function; Digital cameras; Image resolution; Image restoration; Maximum a posteriori estimation; Motion estimation; Motion measurement; Robustness; Spatial resolution; Color enhancement; demosaicing; image restoration; robust estimation; robust regularization; super-resolution; Algorithms; Color; Colorimetry; Image Enhancement; Image Interpretation, Computer-Assisted; Information Storage and Retrieval; Signal Processing, Computer-Assisted; Subtraction Technique;
Journal_Title :
Image Processing, IEEE Transactions on
DOI :
10.1109/TIP.2005.860336