• DocumentCode
    588288
  • Title

    On the estimation of entropy for unknown support size

  • Author

    Schober, Steffen ; Mansour, Ayman

  • Author_Institution
    Inst. of Commun. Eng., Ulm Univ., Ulm, Germany
  • fYear
    2012
  • fDate
    3-7 Sept. 2012
  • Firstpage
    522
  • Lastpage
    526
  • Abstract
    We consider the problem of estimating the entropy of a distribution P of unknown support size N provided with k independently drawn samples, where we are mainly focused on the low sampling regime where k <; N. By extending a method of Hausser and Strimmer [1], which assumes a known support size, by using the support size estimator of Chao and Lee [2], we obtain a simple estimator that performs equally good as the methods of Nemenman, Shafee, and Bialek [3] and Chao and Chen [4].
  • Keywords
    entropy; estimation theory; Chao-and-Lee support size estimator; Hausser-and-Strimmer method; distribution entropy estimation problem; low sampling regime; unknown support size; Bayesian methods; Chaotic communication; Conferences; Entropy; Information theory; Maximum likelihood estimation;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Workshop (ITW), 2012 IEEE
  • Conference_Location
    Lausanne
  • Print_ISBN
    978-1-4673-0224-1
  • Electronic_ISBN
    978-1-4673-0222-7
  • Type

    conf

  • DOI
    10.1109/ITW.2012.6404729
  • Filename
    6404729