Title :
Divergence minimization under prior inequality constraints
Author :
Csiszár, I. ; Tusnády, G. ; Ispány, M. ; Verdes, E. ; Michaletzky, Gy ; Rudas, T.
Author_Institution :
A. Renyi Inst., Hungarian Acad. of Sci., Budapest, Hungary
Abstract :
Motivated by problems in robust statistics we first give a simple proof of the following: Given a probability measure P and positive measures μ<ν, the γ-divergence from P of probability measures Q satisfying μ⩽Q or μ⩽Q⩽ν is minimized by an explicitly determined Q* not depending on (the convex function) γ. Next we address γ-divergence minimization under the above inequality constraint and additional moment constraints
Keywords :
constraint theory; information theory; minimisation; probability; divergence minimization; information measures; moment constraints; positive measures; prior inequality constraints; probability measure; robust statistics; Contamination; Density measurement; Extraterrestrial measurements; Maximum likelihood estimation; Pollution measurement; Probability; Q measurement; Robustness; Statistics; Testing;
Conference_Titel :
Information Theory, 2001. Proceedings. 2001 IEEE International Symposium on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-7123-2
DOI :
10.1109/ISIT.2001.935884