Title :
Scaling eCGA model building via data-intensive computing
Author :
Verma, Abhishek ; Llorà, Xavier ; Venkataraman, Shivaram ; Goldberg, David E. ; Campbell, Roy H.
Author_Institution :
Dept. of Comput. Sci., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
Abstract :
This paper shows how the extended compact genetic algorithm can be scaled using data-intensive computing techniques such as MapReduce. Two different frameworks (Hadoop and MongoDB) are used to deploy MapReduce implementations of the compact and extended compact genetic algorithms. Results show that both are good choices to deal with large-scale problems as they can scale with the number of commodity machines, as opposed to previous efforts with other techniques that either required specialized high-performance hardware or shared memory environments.
Keywords :
genetic algorithms; mathematics computing; Hadoop; MapReduce; MongoDB; commodity machines; data-intensive computing; extended compact genetic algorithm; Complexity theory; Computational modeling; Electronic mail; Mathematical model; Probabilistic logic; Servers;
Conference_Titel :
Evolutionary Computation (CEC), 2010 IEEE Congress on
Conference_Location :
Barcelona
Print_ISBN :
978-1-4244-6909-3
DOI :
10.1109/CEC.2010.5586468