• DocumentCode
    1007473
  • Title

    The generalized maximum entropy principle

  • Author

    Kesavan, H.K. ; Kapur, J.N.

  • Author_Institution
    Dept. Syst. Design Eng., Waterloo Univ., Ont., Canada
  • Volume
    19
  • Issue
    5
  • fYear
    1989
  • Firstpage
    1042
  • Lastpage
    1052
  • Abstract
    Generalizations of the maximum entropy principle (MEP) of E.T. Jaynes (1957) and the minimum discrimination information principle (MDIP) of S. Kullback (1959) are described. The generalizations have been achieved by enunciating the entropy maximization postulate and examining its consequences. The inverse principles which are inherent in the MEP and MDIP are made quite explicit. Several examples are given to illustrate the power and scope of the generalized maximum entropy principle that follows from the entropy maximization postulate
  • Keywords
    entropy; information theory; entropy maximization postulate; generalized maximum entropy principle; minimum discrimination information principle; Councils; Design engineering; Entropy; Information theory; Lagrangian functions; Probabilistic logic; Probability distribution; Systems engineering and theory; Terrorism; Thermodynamics;
  • fLanguage
    English
  • Journal_Title
    Systems, Man and Cybernetics, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9472
  • Type

    jour

  • DOI
    10.1109/21.44019
  • Filename
    44019