DocumentCode
930849
Title
Axiomatic characterization of the directed divergences and their linear combinations
Author
Johnson, Rodney W.
Volume
25
Issue
6
fYear
1979
fDate
11/1/1979 12:00:00 AM
Firstpage
709
Lastpage
716
Abstract
The directed divergences of two probability densities
and
are given by
and by the same expression with
and
interchanged; the divergence is the sum of the directed divergences. These quantities have applications in information theory and to the problem of assigning prior probabilities subject to constraints. It is shown that the directed divergences and their positive linear combinations, including the divegeoce, are characterized by axioms of it{positivity, additivity}, and it{finiteness}, which are fundamental in work on prior probabilities. In the course of the proof, the latter two are shown to imply yet another axiom: it{linear invariance}.
and
are given by
and by the same expression with
and
interchanged; the divergence is the sum of the directed divergences. These quantities have applications in information theory and to the problem of assigning prior probabilities subject to constraints. It is shown that the directed divergences and their positive linear combinations, including the divegeoce, are characterized by axioms of it{positivity, additivity}, and it{finiteness}, which are fundamental in work on prior probabilities. In the course of the proof, the latter two are shown to imply yet another axiom: it{linear invariance}.Keywords
Probability functions; Books; Coordinate measuring machines; Density measurement; Entropy; Extraterrestrial measurements; Particle measurements; Probability density function; Q measurement; Terminology;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1979.1056113
Filename
1056113
Link To Document