Title :
Team of Bayesian optimization algorithms to solve task assignment problems in heterogeneous computing systems
Author :
Jie Li ; JunQi Zhang ; Qi Kang ; Changjun Jiang
Author_Institution :
Dept. of Comput. Sci. & Technol., Tongji Univ., Shanghai, China
Abstract :
A Bayesian optimization algorithm (BOA) belongs to estimation of distribution algorithms (EDAs). It is characterized by combining a Bayesian network and evolutionary algorithms to solve nearly decomposable optimization problems. BOA is less popularly applied to solve high dimensionality complex optimization problems. A key reason is that the cost of training all dimensions by BOA becomes expensive with the increase of problem dimensionality. Since data are relatively sparse in a high dimensional space, even though BOA can train all dimensions simultaneously, the interdependent relations between different dimensions are difficult to learn. Its search ability is thus significantly reduced. In this paper, we propose a team of Bayesian optimization algorithms (TBOA) to search and learn dimensionality. TBOA consists of multiple BOAs, in which each BOA corresponds to a dimension of the solution domain and it is responsible for the search of this dimension´s value region. The proposed TBOA is used to solve the real problem of task assignment in heterogeneous computing systems. Extensive experiments demonstrate that the computational cost of the overall training in TBOA is decreased very significantly while keeping high solution accuracy.
Keywords :
Bayes methods; distributed algorithms; evolutionary computation; learning (artificial intelligence); search problems; Bayesian network; EDA; TBOA; decomposable optimization problems; dimension value region; dimensionality learning; dimensionality search; estimation of distribution algorithms; evolutionary algorithms; heterogeneous computing systems; high dimensional space; high dimensionality complex optimization problems; problem dimensionality; search ability; task assignment problems; team of Bayesian optimization algorithms; Bayes methods; Computational efficiency; Joints; Optimization; Probability distribution; Sociology; Statistics; Bayesian optimization algorithm (BOA); Estimation of distribution algorithm (EDA); dimensionality learning;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6973895