Title :
The method of types [information theory]
Author_Institution :
Math. Inst., Hungarian Acad. of Sci., Budapest, Hungary
fDate :
10/1/1998 12:00:00 AM
Abstract :
The method of types is one of the key technical tools in Shannon theory, and this tool is valuable also in other fields. In this paper, some key applications are presented in sufficient detail enabling an interested nonspecialist to gain a working knowledge of the method, and a wide selection of further applications are surveyed. These range from hypothesis testing and large deviations theory through error exponents for discrete memoryless channels and capacity of arbitrarily varying channels to multiuser problems. While the method of types is suitable primarily for discrete memoryless models, its extensions to certain models with memory are also discussed
Keywords :
channel capacity; channel coding; information theory; memoryless systems; reviews; source coding; Shannon theory; arbitrarily varying channels; channel capacity; discrete memoryless channels; error exponents; hypothesis testing; information theory; large deviations theory; method of types; multiuser problems; review; Block codes; Books; Channel capacity; Convergence; Decoding; Entropy; Error probability; Information theory; Memoryless systems; Testing;
Journal_Title :
Information Theory, IEEE Transactions on