Title :
Sheppard\´s correction for variances and the "quantization noise model"
Author :
Vardeman, Stephen B.
Author_Institution :
Stat. & Ind. & Manuf. Syst. Eng. Departments, Iowa State Univ., Ames, IA, USA
Abstract :
In this paper, we examine the relevance of Sheppard\´s correction for variances and (both the original and a valid weak form of) the so-called "quantization noise model" to understanding the effects of integer rounding on continuous random variables. We further consider whether there is any real relationship between the two. We observe that the strong form of the model is not really relevant to describing rounding effects. We demonstrate using simple cases the substantial limitations of the Sheppard correction, and use simple versions of a weak form of the model to establish that there is no real connection between the correction and the model.
Keywords :
noise; probability; quantisation (signal); Sheppard correction; continuous random variables; dithering; histogram density; integer rounding; quantization noise model; uniform distribution; Analysis of variance; Electrical engineering; Helium; Histograms; Manufacturing industries; Manufacturing systems; Quantization; Random variables; Statistical distributions; Systems engineering and theory; Dithering; histogram density; independent; rounding; uncorrelated; uniform distribution;
Journal_Title :
Instrumentation and Measurement, IEEE Transactions on
DOI :
10.1109/TIM.2005.853348