• DocumentCode
    1304624
  • Title

    Picture Collage

  • Author

    Liu, Tie ; Wang, Jingdong ; Sun, Jian ; Zheng, Nanning ; Tang, Xiaoou ; Shum, Heung-Yeung

  • Author_Institution
    Res. Lab., Anal. & Optimization Dept., IBM China, Beijing, China
  • Volume
    11
  • Issue
    7
  • fYear
    2009
  • Firstpage
    1225
  • Lastpage
    1239
  • Abstract
    In this paper, we address a novel problem of automatically creating a picture collage from a group of images. Picture collage is a kind of visual image summary-to arrange all input images on a given canvas, allowing overlay, to maximize visible visual information. We formulate the picture collage creation problem in a conditional random field model, which integrates image salience, canvas constraint, natural preference, and user interaction. Each image is represented by a group of weighted rectangles, which indicate the salient regions. Then picture collage is resolved by minimizing the energy, guided by the constraints. A two-step optimization method is proposed. First, a quick initialization algorithm based on the proposed 1D collage method is presented. Second, a very efficient Markov chain Monte Carlo method is designed for the refined optimization. We also integrate user interaction in the formulation and optimization to obtain an interactive collage reflecting personalized preference. Visual and quantitative experimental evaluations indicate the efficiency of the proposed collage creation technique.
  • Keywords
    Markov processes; Monte Carlo methods; image processing; interactive systems; optimisation; 1D collage method; Markov chain Monte Carlo method; canvas constraint; conditional random field model; image canvas; image group; image salience; interactive collage; natural preference; optimization method; personalized preference; picture collage creation problem; quantitative experimental evaluation; quick initialization algorithm; salient region; user interaction; visible visual information maximisation; visual evaluation; visual image summary; weighted rectangle group; 1-D collage; Markov chain Monto Carlo (MCMC) optimization; interactive collage; picture collage;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2009.2030741
  • Filename
    5210167