Title :
Entropy and data compression schemes
Author :
Ornstein, D.S. ; Weiss, Benjamin
Author_Institution :
Dept. of Math., Stanford Univ., CA, USA
fDate :
1/1/1993 12:00:00 AM
Abstract :
Some new ways of defining the entropy of a process by observing a single typical output sequence as well as a new kind of Shannon-McMillan-Breiman theorem are presented. This provides a new and conceptually very simple ways of estimating the entropy of an ergodic stationary source as well as new insight into the workings of such well-known data compression schemes as the Lempel-Ziv algorithm
Keywords :
data compression; entropy; information theory; Lempel-Ziv algorithm; Shannon-McMillan-Breiman theorem; data compression; entropy; ergodic stationary source; Data compression; Entropy; Heart; Mathematics;
Journal_Title :
Information Theory, IEEE Transactions on
