• DocumentCode
    930849
  • Title

    Axiomatic characterization of the directed divergences and their linear combinations

  • Author

    Johnson, Rodney W.

  • Volume
    25
  • Issue
    6
  • fYear
    1979
  • fDate
    11/1/1979 12:00:00 AM
  • Firstpage
    709
  • Lastpage
    716
  • Abstract
    The directed divergences of two probability densities p and q are given by \\int p(x) \\log (p(x)/q(x))dx and by the same expression with p and q interchanged; the divergence is the sum of the directed divergences. These quantities have applications in information theory and to the problem of assigning prior probabilities subject to constraints. It is shown that the directed divergences and their positive linear combinations, including the divegeoce, are characterized by axioms of it{positivity, additivity}, and it{finiteness}, which are fundamental in work on prior probabilities. In the course of the proof, the latter two are shown to imply yet another axiom: it{linear invariance}.
  • Keywords
    Probability functions; Books; Coordinate measuring machines; Density measurement; Entropy; Extraterrestrial measurements; Particle measurements; Probability density function; Q measurement; Terminology;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1979.1056113
  • Filename
    1056113