Title :
The interactions between ergodic theory and information theory
Author :
Shields, Paul C.
Author_Institution :
Dept. of Math., Toledo Univ., OH, USA
fDate :
10/1/1998 12:00:00 AM
Abstract :
Information theorists frequently use the ergodic theorem; likewise entropy concepts are often used in information theory. Recently, the two subjects have become partially intertwined as deeper results from each discipline find use in the other. A brief history of this interaction is presented in this paper, together with a more detailed look at three areas of connection, namely, recurrence theory, blowing-up bounds, and direct sample-path methods
Keywords :
entropy; history; information theory; probability; statistical analysis; blowing-up bounds; direct sample-path methods; entropy; ergodic theorem; ergodic theory; history; information theory; recurrence theory; Data compression; Entropy; History; Information analysis; Information theory; Mathematics; Physics; Probability; Source coding; Stochastic processes;
Journal_Title :
Information Theory, IEEE Transactions on