DocumentCode
754301
Title
Axiomatic geometry of conditional models
Author
Lebanon, Guy
Author_Institution
Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
Volume
51
Issue
4
fYear
2005
fDate
4/1/2005 12:00:00 AM
Firstpage
1283
Lastpage
1294
Abstract
We formulate and prove an axiomatic characterization of the Riemannian geometry underlying manifolds of conditional models. The characterization holds for both normalized and nonnormalized conditional models. In the normalized case, the characterization extends the derivation of the Fisher information by Cencov while in the nonnormalized case it extends Campbell´s theorem. Due to the close connection between the conditional I-divergence and the product Fisher information metric, we provides a new axiomatic interpretation of the geometries underlying logistic regression and AdaBoost
Keywords
Markov processes; geometry; information theory; probability; AdaBoost; Campbell´s theorem; Fisher information; Markov morphism; Riemannian geometry; axiomatic geometry; conditional I-divergence; conditional probability estimation; congruent embedding; information geometry; logistic regression; nonnormalized conditional model; normalized conditional models; Helium; Information geometry; Logistics; Mathematical model; Maximum likelihood estimation; Probability; Robustness; Solid modeling; Statistics; Testing; Conditional probability estimation; congruent embedding by a Markov morphism; information geometry;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2005.844060
Filename
1412025
Link To Document