• DocumentCode
    1225421
  • Title

    On asymptotic properties of information-theoretic divergences

  • Author

    Pardo, María Del Carmen ; Vajda, Igor

  • Author_Institution
    Dept. of Stat. & O. R., Complutense Univ. of Madrid, Spain
  • Volume
    49
  • Issue
    7
  • fYear
    2003
  • fDate
    7/1/2003 12:00:00 AM
  • Firstpage
    1860
  • Lastpage
    1867
  • Abstract
    Mutual asymptotic equivalence is established within three classes of information-theoretic divergences of discrete probability distributions, namely, f-divergences of Csiszar, f-divergences of Bregman, and f-divergences of Burbea-Rao. These equivalences are used to find asymptotic distributions of the corresponding divergence statistics for testing the goodness of fit when the hypothetic distribution is uniform. All results are based on standard expansion techniques and on a new relation between the Bregman and Burbea-Rao divergences formulated in Lemma 2 of the paper.
  • Keywords
    information theory; probability; Bregman f-divergences; Burbea-Rao f-divergences; Csiszdr f-divergences; asymptotic properties; discrete probability distributions; information-theoretic divergences; mutual asymptotic equivalence; Bayesian methods; Probability;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2003.813509
  • Filename
    1207389