• DocumentCode
    771636
  • Title

    On delayed prediction of individual sequences

  • Author

    Weinberger, Marcelo J. ; Ordentlich, Erik

  • Author_Institution
    Hewlett-Packard Co. Labs., Palo Alto, CA, USA
  • Volume
    48
  • Issue
    7
  • fYear
    2002
  • fDate
    7/1/2002 12:00:00 AM
  • Firstpage
    1959
  • Lastpage
    1976
  • Abstract
    Prediction of individual sequences is investigated for cases in which the decision maker observes a delayed version of the sequence, or is forced to issue his/her predictions a number of steps in advance, with incomplete information. For finite action and observation spaces, it is shown that the prediction strategy that minimizes the worst case regret with respect to the Bayes envelope is obtained through subsampling of the sequence of observations. The result extends to the case of logarithmic loss. For finite-state (FS) reference prediction strategies, the delayed FS predictability (DFSP) is defined and related to its nondelayed counterpart. As in the nondelayed case, an efficient on-line decision algorithm, based on the incremental parsing rule, is shown to perform in the long run essentially as well as the best FS strategy determined in hindsight, with full knowledge of the given sequence of observations. An application to adaptive prefetching in computer memory architectures is discussed
  • Keywords
    Bayes methods; adaptive systems; binary sequences; decision theory; delays; information theory; memory architecture; prediction theory; signal sampling; Bayes envelope; adaptive prefetching; binary sequence; computer memory architectures; delayed FS predictability; delayed prediction; efficient on-line decision algorithm; finite action space; finite observation space; finite-state reference prediction; incomplete information; incremental parsing rule; individual sequences; logarithmic loss; observation sequence; subsampling; Application software; Binary sequences; Computer errors; Data compression; Delay; Helium; Information theory; Memory architecture; Minimax techniques; Prefetching;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2002.1013136
  • Filename
    1013136