Title :
Bias learning, knowledge sharing
Author :
Ghosn, Joumana ; Bengio, Yoshua
Author_Institution :
Dept. d´´Inf. et de Recherche Oper., Montreal Univ., Que., Canada
Abstract :
Biasing the hypothesis space of a learner has been shown to improve generalisation performances. Methods for achieving this goal are proposed, that range from deriving and introducing a bias into a learner to automatically learning the bias. In the latter case, most methods learn the bias by simultaneously training several related tasks derived from the same domain and imposing constraints on their parameters. We extend some of the ideas presented in this field and describe a new model that parametrizes the parameters of each task as a function of an affine manifold defined in parameter space and a point lying on the manifold. An analysis of variance on a class of learning tasks is performed that shows some significantly improved performances when using the model
Keywords :
generalisation (artificial intelligence); learning (artificial intelligence); optimisation; bias learning; generalisation; knowledge sharing; optimisation; parameter space; Analysis of variance; Economic forecasting; Environmental economics; Knowledge transfer; Learning systems; Motion planning; Neural networks; Parallel robots;
Conference_Titel :
Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on
Conference_Location :
Como
Print_ISBN :
0-7695-0619-4
DOI :
10.1109/IJCNN.2000.857806