DocumentCode :
747588
Title :
Universal redundancy rates for the class of B-processes do not exist
Author :
Shields, Paul ; Weiss, Benjamin
Author_Institution :
Dept. of Math., Toledo Univ., OH, USA
Volume :
41
Issue :
2
fYear :
1995
fDate :
3/1/1995 12:00:00 AM
Firstpage :
508
Lastpage :
512
Abstract :
Shows that for any sequence ρ(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as ρ(n) for infinitely many n. This extends work of Shields (1993), whose examples had O entropy. The class of B-processes, that is, stationary codings of independent and identically distributed (i.i.d.) processes, includes the aperiodic Markov chains and functions thereof, aperiodic renewal and regenerative processes, and m-dependent processes, as well as many other processes of interest. In particular, the results show that the search for a universal redundancy rate for the class of all B-processes is doomed to failure, and redundancy rates for any given subclass must be obtained by direct analysis of that subclass
Keywords :
Markov processes; codes; entropy; redundancy; sequences; B-processes; aperiodic Markov chains; aperiodic renewal; entropy; iid processes; independent and identically distributed processes; m-dependent processes; maximum possible entropy; prefix codes; regenerative processes; sequence; stationary codings; universal redundancy rates; Entropy; Failure analysis; Information theory; Length measurement; Mathematics; Noise measurement;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.370156
Filename :
370156
Link To Document :
بازگشت