Title :
Content-Aware Photo Collage Using Circle Packing
Author :
Zongqiao Yu ; Lin Lu ; Yanwen Guo ; Rongfei Fan ; Mingming Liu ; Wenping Wang
Author_Institution :
Nanjing Univ., Nanjing, China
Abstract :
In this paper, we present a novel approach for automatically creating the photo collage that assembles the interest regions of a given group of images naturally. Previous methods on photo collage are generally built upon a well-defined optimization framework, which computes all the geometric parameters and layer indices for input photos on the given canvas by optimizing a unified objective function. The complex nonlinear form of optimization function limits their scalability and efficiency. From the geometric point of view, we recast the generation of collage as a region partition problem such that each image is displayed in its corresponding region partitioned from the canvas. The core of this is an efficient power-diagram-based circle packing algorithm that arranges a series of circles assigned to input photos compactly in the given canvas. To favor important photos, the circles are associated with image importances determined by an image ranking process. A heuristic search process is developed to ensure that salient information of each photo is displayed in the polygonal area resulting from circle packing. With our new formulation, each factor influencing the state of a photo is optimized in an independent stage, and computation of the optimal states for neighboring photos are completely decoupled. This improves the scalability of collage results and ensures their diversity. We also devise a saliency-based image fusion scheme to generate seamless compositive collage. Our approach can generate the collages on nonrectangular canvases and supports interactive collage that allows the user to refine collage results according to his/her personal preferences. We conduct extensive experiments and show the superiority of our algorithm by comparing against previous methods.
Keywords :
computational geometry; image fusion; mobile computing; search problems; smart phones; complex nonlinear form; content-aware photo collage; geometric parameters; heuristic search process; image ranking process; interactive collage; layer indices; nonrectangular canvases; optimization function; polygonal area; power-diagram-based circle packing algorithm; region partition problem; saliency-based image fusion scheme; seamless compositive collage generation; smartphones; unified objective function; Complexity theory; Histograms; Image color analysis; Image edge detection; Indexes; Optimization; Shape; Complexity theory; Histograms; Image color analysis; Image edge detection; Indexes; Optimization; Photo collage; Shape; circle packing; image saliency;
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
DOI :
10.1109/TVCG.2013.106