DocumentCode :
1277744
Title :
Experience Transfer for the Configuration Tuning in Large-Scale Computing Systems
Author :
Chen, Haifeng ; Zhang, Wenxuan ; Jiang, Guofei
Author_Institution :
NEC Labs. America, Inc., Princeton, NJ, USA
Volume :
23
Issue :
3
fYear :
2011
fDate :
3/1/2011 12:00:00 AM
Firstpage :
388
Lastpage :
401
Abstract :
This paper proposes a new strategy, the experience transfer, to facilitate the management of large-scale computing systems. It deals with the utilization of management experiences in one system (or previous systems) to benefit the same management task in other systems (or current systems). We use the system configuration tuning as a case application to demonstrate all procedures involved in the experience transfer including the experience representation, experience extraction, and experience embedding. The dependencies between system configuration parameters are treated as transferable experiences in the configuration tuning for two reasons: 1) because such knowledge is helpful to the efficiency of the optimal configuration search, and 2) because the parameter dependencies are typically unchanged between two similar systems. We use the Bayesian network to model configuration dependencies and present a configuration tuning algorithm based on the Bayesian network construction and sampling. As a result, after the configuration tuning is completed in the original system, we can obtain a Bayesian network as the by-product which records the dependencies between system configuration parameters. Such a network is then embedded into the tuning process in other similar systems as transferred experiences to improve the configuration search efficiency. Experimental results in a web-based system show that with the help of transferred experiences, the configuration tuning process can be significantly accelerated.
Keywords :
belief networks; distributed programming; embedded systems; Bayesian network; configuration tuning; current systems; experience embedding; experience extraction; experience representation; large scale computing systems; web based system; Acceleration; Bayesian methods; Construction industry; Joints; Measurement; System performance; Tuning; Distributed systems; active sampling.; configuration tuning; knowledge acquisition; knowledge reuse;
fLanguage :
English
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
Publisher :
ieee
ISSN :
1041-4347
Type :
jour
DOI :
10.1109/TKDE.2010.121
Filename :
5530314
Link To Document :
بازگشت