• DocumentCode
    3607975
  • Title

    Predicting Eye Fixations on Webpage With an Ensemble of Early Features and High-Level Representations from Deep Network

  • Author

    Chengyao Shen ; Xun Huang ; Qi Zhao

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
  • Volume
    17
  • Issue
    11
  • fYear
    2015
  • Firstpage
    2084
  • Lastpage
    2093
  • Abstract
    In recent decades, webpages are becoming an increasingly important visual information source. Compared with natural images, webpages are different in many ways. For example, webpages are usually rich in semantically meaningful visual media (text, pictures, logos, and animations), which make the direct application of some traditional low-level saliency models ineffective. Besides, distinct web-viewing patterns such as top-left bias and banner blindness suggest different ways for predicting attention deployment on a webpage. In this study, we utilize a new scheme of low-level feature extraction pipeline and combine it with high-level representations from deep neural networks. The proposed model is evaluated on a newly published webpage saliency dataset with three popular evaluation metrics. Results show that our model outperforms other existing saliency models by a large margin and both low- and high-level features play an important role in predicting fixations on webpage.
  • Keywords
    Internet; feature extraction; neural nets; Web page; Web-viewing pattern; deep neural network; high-level representation; low-level feature extraction pipeline; visual information source; visual media; Computational modeling; Feature extraction; Image color analysis; Internet; Media; Predictive models; Visualization; Deep learning; visual attention; web viewing; webpage saliency;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2015.2483370
  • Filename
    7294708