Title :
An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory
Author_Institution :
EE Dept., Technion - Israel Inst. of Technol., Haifa
Abstract :
An identity between two versions of the large deviations rate function of the probability a certain rare event is established. This identity has an interpretation in statistical physics, namely, an isothermal equilibrium of a composite system that consists of multiple subsystems. Several information-theoretic application examples, where the analysis of this large deviations probability naturally arises, are then described from the viewpoint of this statistical mechanical interpretation. This results in several relationships between information theory and statistical physics, which we hope, the reader will find insightful.
Keywords :
information theory; statistical analysis; statistical mechanics; Chernoff bounds; information theory; large deviations rate function; probability; statistical mechanical interpretation; statistical physics; Cities and towns; Entropy; Information analysis; Information theory; Interconnected systems; Isothermal processes; Phased arrays; Physics; Probability; Random variables;
Conference_Titel :
Information Theory, 2008. ISIT 2008. IEEE International Symposium on
Conference_Location :
Toronto, ON
Print_ISBN :
978-1-4244-2256-2
Electronic_ISBN :
978-1-4244-2257-9
DOI :
10.1109/ISIT.2008.4595036