Title :
An Identity of Chernoff Bounds With an Interpretation in Statistical Physics and Applications in Information Theory
Author_Institution :
Dept. of Electr. Eng., Technion- Israel Inst. of Technol., Haifa
Abstract :
An identity between two versions of the rate function of the probability a certain large deviations event is established. This identity has an interpretation in statistical physics, namely, an isothermal equilibrium of a composite system that consists of multiple subsystems of particles. Several information-theoretic application examples, where the analysis of this large deviations probability naturally arises, are then described from the viewpoint of this statistical mechanical interpretation. This results in several relationships between information theory and statistical physics, which we hope, the reader will find insightful.
Keywords :
information theory; statistical analysis; Chernoff bounds identity; composite system; information theory; isothermal equilibrium; large deviations probability; statistical mechanical interpretation; statistical physics interpretation; Entropy; Information analysis; Information theory; Interconnected systems; Isothermal processes; Optimization methods; Physics; Probability; Random variables; Thermodynamics; Chernoff bound; equipartition; large deviations theory; phase transitions; statistical physics; thermal equilibrium; thermodynamics;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2008.926340
