• DocumentCode
    2388603
  • Title

    Generating text description from content-based annotated image

  • Author

    Zhu, Yan ; Xiang, Hui ; Feng, Wenjuan

  • Author_Institution
    Sch. of Comput. Sci. & Technol., Shandong Univ., Jinan, China
  • fYear
    2012
  • fDate
    19-20 May 2012
  • Firstpage
    805
  • Lastpage
    809
  • Abstract
    This paper proposes a statistical generative model to generate sentences from an annotated picture. The images are segmented into regions (using Graph-based algorithms) and then features are computed over each of these regions. Given a training set of images with annotations, we parse the image to get position information. We use SVM to get the probabilities of combinations between labels and prepositions, obtain the data to text set. We use a standard semantic representation to express the image message. Finally generate sentence from the xml report. In view of landscape pictures, this paper implemented experiments on the dataset we collected and annotated, obtained ideal results.
  • Keywords
    XML; content-based retrieval; graph theory; image retrieval; image segmentation; probability; support vector machines; text analysis; SVM; XML report; annotated picture; content-based annotated image; graph-based algorithms; image message; image segmentation; labels; landscape pictures; position information; prepositions; probabilities; sentence generation; standard semantic representation; statistical generative model; text description generation; Accuracy; Educational institutions; Image segmentation; Probability; Semantics; Training; XML; cross-media retrieval; image annotation; machine learning; text generation;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Systems and Informatics (ICSAI), 2012 International Conference on
  • Conference_Location
    Yantai
  • Print_ISBN
    978-1-4673-0198-5
  • Type

    conf

  • DOI
    10.1109/ICSAI.2012.6223132
  • Filename
    6223132