Bagging.LMS: A Bagging-based Linear Fusion with Least-Mean-Square Error Update for Regression

The merits of linear decision fusion in multiple learner systems have been widely accepted, and their practical applications are rich in literature. In this paper we present a new linear decision fusion strategy named BaggingmiddotLMS, which takes advantage of the least-mean-square (LMS) algorithm to update the fusion parameters in the Bagging ensemble systems. In the regression experiments on four synthetic and two benchmark data sets, we compared this method with the bagging-based simple average and adaptive mixture of experts ensemble methods. The empirical results show that the BaggingmiddotLMS method may significantly reduce the regression errors versus the other two types of Bagging ensembles, which indicates the superiority of the suggested BaggingmiddotLMS method