Title :
Analyses on Limitations of Information Theory
Author_Institution :
Coll. of Comput. & Control, Guilin Univ. of Electron. Technol., Guilin, China
Abstract :
The paper analyzes the limitations from the angles of conditional entropy and the expression of information. It is pointed out Shannon´s definition of information is not absolute and the probability in the expression of information maybe random variable in practice, but in information theory the probability is treated as a fixed value, then the application of Shannon´s theory is limited. It is stated that people would select information that is more reliable but more uncertain than the reverse in practice. The signality of the reliability of information which is ignored in Shannon´s information theory is indicated and the clew to measure the reliability of information is given to be the uncertainty of probability.
Keywords :
entropy; Shannon theory; conditional entropy; information theory; Artificial intelligence; Computational intelligence; Educational institutions; Electric variables control; Entropy; Information analysis; Information theory; Random variables; Reliability theory; Uncertainty; conditional entropy; information theory; measure; probability; uncertainty;
Conference_Titel :
Artificial Intelligence and Computational Intelligence, 2009. AICI '09. International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-4244-3835-8
Electronic_ISBN :
978-0-7695-3816-7
DOI :
10.1109/AICI.2009.413
