Let

be independent random variables, each having a

distribution. If we try to estimate

with an

-state learning algorithm, then the minimum mean-squared error is bounded below by that obtained by the best

-level quantizer (which requires knowledge of

). Here we show that this lower bound is tight. The results are easily extended to a number of other problems, such as estimating the mean

of a uniform distribution.