DocumentCode
3607975
Title
Predicting Eye Fixations on Webpage With an Ensemble of Early Features and High-Level Representations from Deep Network
Author
Chengyao Shen ; Xun Huang ; Qi Zhao
Author_Institution
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
Volume
17
Issue
11
fYear
2015
Firstpage
2084
Lastpage
2093
Abstract
In recent decades, webpages are becoming an increasingly important visual information source. Compared with natural images, webpages are different in many ways. For example, webpages are usually rich in semantically meaningful visual media (text, pictures, logos, and animations), which make the direct application of some traditional low-level saliency models ineffective. Besides, distinct web-viewing patterns such as top-left bias and banner blindness suggest different ways for predicting attention deployment on a webpage. In this study, we utilize a new scheme of low-level feature extraction pipeline and combine it with high-level representations from deep neural networks. The proposed model is evaluated on a newly published webpage saliency dataset with three popular evaluation metrics. Results show that our model outperforms other existing saliency models by a large margin and both low- and high-level features play an important role in predicting fixations on webpage.
Keywords
Internet; feature extraction; neural nets; Web page; Web-viewing pattern; deep neural network; high-level representation; low-level feature extraction pipeline; visual information source; visual media; Computational modeling; Feature extraction; Image color analysis; Internet; Media; Predictive models; Visualization; Deep learning; visual attention; web viewing; webpage saliency;
fLanguage
English
Journal_Title
Multimedia, IEEE Transactions on
Publisher
ieee
ISSN
1520-9210
Type
jour
DOI
10.1109/TMM.2015.2483370
Filename
7294708
Link To Document