DocumentCode
864673
Title
A Coincidence-Based Test for Uniformity Given Very Sparsely Sampled Discrete Data
Author
Paninski, L.
Author_Institution
Dept. of Stat., Columbia Univ., New York, NY
Volume
54
Issue
10
fYear
2008
Firstpage
4750
Lastpage
4755
Abstract
How many independent samples N do we need from a distribution p to decide that p is epsiv-distant from uniform in an L1 sense, Sigmai=1 m |p(i) - 1/m| > epsiv? (Here m is the number of bins on which the distribution is supported, and is assumed known a priori.) Somewhat surprisingly, we only need N epsiv2 Gt m 1/2 to make this decision reliably (this condition is both sufficient and necessary). The test for uniformity introduced here is based on the number of observed ldquocoincidencesrdquo (samples that fall into the same bin), the mean and variance of which may be computed explicitly for the uniform distribution and bounded nonparametrically for any distribution that is known to be epsiv-distant from uniform. Some connections to the classical birthday problem are noted.
Keywords
information theory; statistical distributions; classical birthday problem; coincidence-based test; convex bounds; hypothesis testing; minimax; uniform distribution; very sparsely sampled discrete data; Computer errors; Computer science; Distributed computing; Engineering profession; Entropy; Minimax techniques; Statistical analysis; Statistical distributions; Testing; Upper bound; Convex bounds; hypothesis testing; minimax;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2008.928987
Filename
4626074
Link To Document