• DocumentCode
    1780604
  • Title

    Asymptotically minimax regret for models with hidden variables

  • Author

    Takeuchi, Jun ; Barron, Andrew R.

  • Author_Institution
    Dept. of Inf., Kyushu Univ., Fukuoka, Japan
  • fYear
    2014
  • fDate
    June 29 2014-July 4 2014
  • Firstpage
    3037
  • Lastpage
    3041
  • Abstract
    We study the problems of data compression, gambling and prediction of a string xn = x1x2...xn from an alphabet X, in terms of regret with respect to models with hidden variables including general mixture families. When the target class is a non-exponential family, a modification of Jeffreys prior which has measure outside the given family of densities was introduced to achieve the minimax regret [8], under certain regularity conditions. In this paper, we show that the models with hidden variables satisfy those regularity conditions, when the hidden variables´ model is an exponential family. In paticular, we do not have to restrict the class of data strings so that the MLE is in the interior of the parameter space for the case of the general mixture family.
  • Keywords
    data compression; minimax techniques; asymptotically minimax regret; data compression; data gambling; data prediction; data strings; general mixture family; hidden variables model; non-exponential family; Data models; Eigenvalues and eigenfunctions; Encoding; Information geometry; Maximum likelihood estimation; Predictive models;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory (ISIT), 2014 IEEE International Symposium on
  • Conference_Location
    Honolulu, HI
  • Type

    conf

  • DOI
    10.1109/ISIT.2014.6875392
  • Filename
    6875392