• DocumentCode
    1147892
  • Title

    On the Existence and Characterization of the Maxent Distribution Under General Moment Inequality Constraints

  • Author

    Ishwar, Prakash ; Moulin, Pierre

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Univ. of Illinois, Urbana, IL, USA
  • Volume
    51
  • Issue
    9
  • fYear
    2005
  • Firstpage
    3322
  • Lastpage
    3333
  • Abstract
    A broad set of sufficient conditions that guarantees the existence of the maximum entropy (maxent) distribution consistent with specified bounds on certain generalized moments is derived. Most results in the literature are either focused on the minimum cross-entropy distribution or apply only to distributions with a bounded-volume support or address only equality constraints. The results of this work hold for general moment inequality constraints for probability distributions with possibly unbounded support, and the technical conditions are explicitly on the underlying generalized moment functions. An analytical characterization of the maxent distribution is also derived using results from the theory of constrained optimization in infinite-dimensional normed linear spaces. Several auxiliary results of independent interest pertaining to certain properties of convex coercive functions are also presented.
  • Keywords
    convex programming; maximum entropy methods; probability; signal processing; coercive functions; constrained optimization; convex analysis; cross-entropy; general moment inequality constraints; maxent distribution; maximum entropy; probability distribution; Constraint optimization; Constraint theory; Density measurement; Entropy; Extraterrestrial measurements; Mechanical factors; Probability distribution; Signal processing; Statistical distributions; Sufficient conditions; Coercive functions; constrained optimization; convex analysis; cross-entropy; differential entropy; maximum entropy methods;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2005.853317
  • Filename
    1499064