Title :
Automatic prediction of saliency on JPEG distorted images
Author :
Mittal, Anish ; Moorthy, Anush K. ; Bovik, Alan C. ; Cormack, Lawrence K.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Texas at Austin, Austin, TX, USA
Abstract :
We propose an algorithm to detect salient regions for JPEG distorted images for two tasks: quality assessment and free viewing. The algorithm extracts low-level features such as contrast, luminance, quality and so on and uses a machine-learning framework to predict salient regions in JPEG distorted images. We demonstrate that the automatically predicted regions-of-interest highly correlate with those from (human) ground truth saliency maps. Further, we evaluate the relevance of extracted low-level features for saliency prediction and analyze how incorporation of quality as a feature improves prediction performance as a function of the distortion severity. Applications of such a saliency prediction framework include developing novel pooling strategies for image quality assessment.
Keywords :
data compression; image coding; learning (artificial intelligence); JPEG distorted images; automatic prediction; distortion severity; image quality assessment; machine-learning; pooling strategies; Databases; Feature extraction; Humans; Quality assessment; Training; Transform coding; Visualization; Bottom up; Eye movements; Image compression; Quality Assessment; Saliency Prediction; Task-dependence; Visual attention;
Conference_Titel :
Quality of Multimedia Experience (QoMEX), 2011 Third International Workshop on
Conference_Location :
Mechelen
Print_ISBN :
978-1-4577-1333-0
Electronic_ISBN :
978-1-4577-1334-7
DOI :
10.1109/QoMEX.2011.6065702