• DocumentCode
    1502357
  • Title

    Best asymptotic normality of the kernel density entropy estimator for smooth densities

  • Author

    Eggermont, Paul P B ; LaRiccia, Vincent N.

  • Author_Institution
    Dept. of Math. Sci., Delaware Univ., Newark, DE, USA
  • Volume
    45
  • Issue
    4
  • fYear
    1999
  • fDate
    5/1/1999 12:00:00 AM
  • Firstpage
    1321
  • Lastpage
    1326
  • Abstract
    In the random sampling setting we estimate the entropy of a probability density distribution by the entropy of a kernel density estimator using the double exponential kernel. Under mild smoothness and moment conditions we show that the entropy of the kernel density estimator equals a sum of independent and identically distributed (i.i.d.) random variables plus a perturbation which is asymptotically negligible compared to the parametric rate n-1/2. An essential part in the proof is obtained by exhibiting almost sure bounds for the Kullback-Leibler divergence between the kernel density estimator and its expected value. The basic technical tools are Doob´s submartingale inequality and convexity (Jensen´s inequality)
  • Keywords
    entropy; parameter estimation; probability; random processes; signal sampling; smoothing methods; Doob´s submartingale inequality; Jensen´s inequality; Kullback-Leibler divergence; best asymptotic normality; bounds; convexity; double exponential kernel; i.i.d random variables; independent identically distributed variables; kernel density entropy estimator; moment conditions; parametric rate; perturbation; probability density distribution; random sampling; smooth densities; Deconvolution; Distribution functions; Entropy; Kernel; Probability density function; Random variables; Sampling methods; Stochastic processes;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.761291
  • Filename
    761291