• DocumentCode
    754301
  • Title

    Axiomatic geometry of conditional models

  • Author

    Lebanon, Guy

  • Author_Institution
    Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
  • Volume
    51
  • Issue
    4
  • fYear
    2005
  • fDate
    4/1/2005 12:00:00 AM
  • Firstpage
    1283
  • Lastpage
    1294
  • Abstract
    We formulate and prove an axiomatic characterization of the Riemannian geometry underlying manifolds of conditional models. The characterization holds for both normalized and nonnormalized conditional models. In the normalized case, the characterization extends the derivation of the Fisher information by Cencov while in the nonnormalized case it extends Campbell´s theorem. Due to the close connection between the conditional I-divergence and the product Fisher information metric, we provides a new axiomatic interpretation of the geometries underlying logistic regression and AdaBoost
  • Keywords
    Markov processes; geometry; information theory; probability; AdaBoost; Campbell´s theorem; Fisher information; Markov morphism; Riemannian geometry; axiomatic geometry; conditional I-divergence; conditional probability estimation; congruent embedding; information geometry; logistic regression; nonnormalized conditional model; normalized conditional models; Helium; Information geometry; Logistics; Mathematical model; Maximum likelihood estimation; Probability; Robustness; Solid modeling; Statistics; Testing; Conditional probability estimation; congruent embedding by a Markov morphism; information geometry;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2005.844060
  • Filename
    1412025