Author :
Liu, Tie ; Wang, Jingdong ; Sun, Jian ; Zheng, Nanning ; Tang, Xiaoou ; Shum, Heung-Yeung
Author_Institution :
Res. Lab., Anal. & Optimization Dept., IBM China, Beijing, China
Abstract :
In this paper, we address a novel problem of automatically creating a picture collage from a group of images. Picture collage is a kind of visual image summary-to arrange all input images on a given canvas, allowing overlay, to maximize visible visual information. We formulate the picture collage creation problem in a conditional random field model, which integrates image salience, canvas constraint, natural preference, and user interaction. Each image is represented by a group of weighted rectangles, which indicate the salient regions. Then picture collage is resolved by minimizing the energy, guided by the constraints. A two-step optimization method is proposed. First, a quick initialization algorithm based on the proposed 1D collage method is presented. Second, a very efficient Markov chain Monte Carlo method is designed for the refined optimization. We also integrate user interaction in the formulation and optimization to obtain an interactive collage reflecting personalized preference. Visual and quantitative experimental evaluations indicate the efficiency of the proposed collage creation technique.
Keywords :
Markov processes; Monte Carlo methods; image processing; interactive systems; optimisation; 1D collage method; Markov chain Monte Carlo method; canvas constraint; conditional random field model; image canvas; image group; image salience; interactive collage; natural preference; optimization method; personalized preference; picture collage creation problem; quantitative experimental evaluation; quick initialization algorithm; salient region; user interaction; visible visual information maximisation; visual evaluation; visual image summary; weighted rectangle group; 1-D collage; Markov chain Monto Carlo (MCMC) optimization; interactive collage; picture collage;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2009.2030741