Title :
The generalized maximum entropy principle
Author :
Kesavan, H.K. ; Kapur, J.N.
Author_Institution :
Dept. Syst. Design Eng., Waterloo Univ., Ont., Canada
Abstract :
Generalizations of the maximum entropy principle (MEP) of E.T. Jaynes (1957) and the minimum discrimination information principle (MDIP) of S. Kullback (1959) are described. The generalizations have been achieved by enunciating the entropy maximization postulate and examining its consequences. The inverse principles which are inherent in the MEP and MDIP are made quite explicit. Several examples are given to illustrate the power and scope of the generalized maximum entropy principle that follows from the entropy maximization postulate
Keywords :
entropy; information theory; entropy maximization postulate; generalized maximum entropy principle; minimum discrimination information principle; Councils; Design engineering; Entropy; Information theory; Lagrangian functions; Probabilistic logic; Probability distribution; Systems engineering and theory; Terrorism; Thermodynamics;
Journal_Title :
Systems, Man and Cybernetics, IEEE Transactions on
