Title :
Modeling visual attention´s modulatory aftereffects on visual sensitivity and quality evaluation
Author :
Lu, Zhongkang ; Lin, Weisi ; Yang, Xiaokang ; Ong, EePing ; Yao, Susu
Author_Institution :
Inst. for Infocomm Res., Agency for Sci. Technol. & Res., Singapore, Singapore
Abstract :
With the fast development of visual noise-shaping related applications (visual compression, error resilience, watermarking, encryption, and display), there is an increasingly significant demand on incorporating perceptual characteristics into these applications for improved performance. In this paper, a very important mechanism of the human brain, visual attention, is introduced for visual sensitivity and visual quality evaluation. Based upon the analysis, a new numerical measure for visual attention´s modulatory aftereffects, perceptual quality significance map (PQSM), is proposed. To a certain extent, the PQSM reflects the processing ability of the human brain on local visual contents statistically. The PQSM is generated with the integration of local perceptual stimuli from color contrast, texture contrast, motion, as well as cognitive features (skin color and face in this study). Experimental results with subjective viewing demonstrate the performance improvement on two PQSM-modulated visual sensitivity models and two PQSM-based visual quality metrics.
Keywords :
brain; feature extraction; image texture; neurophysiology; visual perception; JND; PQSM; cognitive feature; color contrast; human brain; just-noticeable difference; modulatory aftereffect modeling; perceptual quality significance map; quality evaluation; texture contrast; visual noise-shaping; visual sensitivity; Automatic control; Colored noise; Cryptography; Displays; Humans; Noise shaping; Resilience; Shape control; Visual perception; Watermarking; Just-noticeable difference (JND); noise shaping; perceptual quality significance map (PQSM); visual attention; visual quality evaluation; visual sensitivity; Algorithms; Artificial Intelligence; Attention; Biomimetics; Computer Simulation; Humans; Image Enhancement; Image Interpretation, Computer-Assisted; Information Storage and Retrieval; Models, Biological; Reproducibility of Results; Sensitivity and Specificity; Visual Perception;
Journal_Title :
Image Processing, IEEE Transactions on
DOI :
10.1109/TIP.2005.854478