Title :
Optimal universal learning and prediction of probabilistic concepts
Author :
Feder, Meir ; Freund, Yoav ; Mansour, Yishay
Author_Institution :
Dept. of Electr. Eng., Tel Aviv Univ., Israel
Abstract :
We consider the following setting of the (supervised) learning problem. A sequence of input data x1,…,xt,…, is given, one by one, and the goal is to predict the corresponding outputs y1,…,yt,…. Our proposed solution for the supervised learning problem is Bayesian, and the contribution of this work lies in determining the optimal way to choose the Bayesian “prior” for the supervised learning problem, and observing the strong sequential, non-anticipating, structure of the resulting universal predictor
Keywords :
Bayes methods; encoding; learning (artificial intelligence); optimisation; prediction theory; probability; Bayesian method; input data; optimal universal learning; outputs; prediction; probabilistic concepts; sequential nonanticipating structure; supervised learning; universal predictor; Bayesian methods; Capacity planning; Mutual information; Prediction algorithms; Supervised learning;
Conference_Titel :
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Conference_Location :
Whistler, BC
Print_ISBN :
0-7803-2453-6
DOI :
10.1109/ISIT.1995.535748