DocumentCode :
185162
Title :
Assessing the validity of subjective QoE data through rating times and self-reported confidence
Author :
Robitza, Werner ; Hlavacs, Helmut
Author_Institution :
Telekom Innovation Labs., Tech. Univ. Berlin, Berlin, Germany
fYear :
2014
fDate :
18-20 Sept. 2014
Firstpage :
297
Lastpage :
302
Abstract :
When users give ratings in subjective Quality of Experience experiments, they may experience a lack of confidence in assigning a score to a stimulus. This results in invalid votes that might need to be removed from the acquired data. We show results from a subjective video quality experiment in which we measured the rating times and asked observers for their confidence, in addition to just the quality score. It is shown that the average confidence is higher for extremely good or bad MOS values. The results also demonstrate that collecting rating times is an effective way to detect issues with single votes caused by observers struggling to decide for a rating.
Keywords :
ergonomics; quality of experience; video signal processing; MOS values; quality of experience experiments; rating times; self-reported confidence; subjective QOE data validity; subjective video quality experiment; Conferences; Multimedia communication; Observers; Polynomials; Static VAr compensators; Time measurement; Visualization; Human Factors; Quality of Experience; Rating Times; Subjective Quality Assessment;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Quality of Multimedia Experience (QoMEX), 2014 Sixth International Workshop on
Conference_Location :
Singapore
Type :
conf
DOI :
10.1109/QoMEX.2014.6982335
Filename :
6982335
Link To Document :
بازگشت