Title :
An enabling framework for parallel optimization on the computational grid
Author :
Cahon, S. ; Melab, N. ; Talbi, E.-G.
Author_Institution :
Lab. d´´Informatique Fondamentale de Lille, CNRS, Villeneuve d´´Ascq, France
Abstract :
In this paper, we present ParadisEO-CMW, an extension of the open source ParadisEO framework, originally intended to the design and deployment of parallel hybrid meta heuristics on dedicated clusters of SMPs. Coupled with the Condor-MW library, it enables the execution of such parallel applications on volatile heterogeneous computational resources. The motivations, architecture and main features will be discussed. The framework has been tested by tackling a real-world NP-hard problem: feature selection in near-infrared spectroscopic data mining. It has been resolved by deploying a multi-level parallel model of evolutionary algorithms. Experimentations have been carried out on more than one hundred PCs originally intended for education. The obtained results are convincing, both in terms of flexibility and easiness at implementation, and in terms of efficiency and quality of provided solutions at execution.
Keywords :
computational complexity; evolutionary computation; grid computing; parallel processing; shared memory systems; Condor-MW library; NP-hard problem; ParadisEO-CMW; computational grid; evolutionary algorithm; parallel hybrid meta heuristics; parallel optimization; spectroscopic data mining; Computer architecture; Concurrent computing; Data mining; Evolutionary computation; Grid computing; Libraries; NP-hard problem; Personal communication networks; Spectroscopy; Testing;
Conference_Titel :
Cluster Computing and the Grid, 2005. CCGrid 2005. IEEE International Symposium on
Print_ISBN :
0-7803-9074-1
DOI :
10.1109/CCGRID.2005.1558632