DocumentCode
659131
Title
Asymptotically minimax regret by Bayes mixtures for non-exponential families
Author
Takeuchi, Jun ; Barron, Andrew R.
Author_Institution
Dept. of Inf., Kyushu Univ., Fukuoka, Japan
fYear
2013
fDate
9-13 Sept. 2013
Firstpage
1
Lastpage
5
Abstract
We study the problems of data compression, gambling and prediction of a sequence xn = x1x2...xn from an alphabet X, in terms of regret with respect to various families of probability distributions. It is known that the regret of the Bayes mixture with respect to a general exponential families asymptotically achieves the minimax value when variants of Jeffreys prior are used, under the condition that the maximum likelihood estimate is in the interior of the parameter space. We discuss a modification of Jeffreys prior which has measure outside the given family of densities, to achieve minimax regret with respect to non-exponential type families, e.g. curved exponential families and mixture families. These results also provide characterization of Rissanen´s stochastic complexity for those classes.
Keywords
Bayes methods; data compression; maximum likelihood estimation; minimax techniques; sequences; statistical distributions; stochastic processes; Bayes mixtures; Jeffreys prior; Rissanen´s stochastic complexity; alphabet; asymptotically minimax regret; data compression; gambling; maximum likelihood estimation; nonexponential families; prediction; probability distributions; sequence; Complexity theory; Context; Data compression; Educational institutions; Encoding; Information geometry; Maximum likelihood estimation;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Workshop (ITW), 2013 IEEE
Conference_Location
Sevilla
Print_ISBN
978-1-4799-1321-3
Type
conf
DOI
10.1109/ITW.2013.6691254
Filename
6691254
Link To Document