Title :
Tuple MapReduce: Beyond Classic MapReduce
Author :
Ferrera, P. ; de Prado, I. ; Palacios, Elvia ; Fernandez-Marquez, Jose Luis ; Di Marzo Serugendo, Giovanna
Author_Institution :
Datasalt Syst. S.L., Barcelona, Spain
Abstract :
This paper proposes Tuple Map Reduce, a new foundational model extending Map Reduce with the notion of tuples. Tuple Map Reduce allows to bridge the gap between the low-level constructs provided by Map Reduce and higher-level needs required by programmers, such as compound records, sorting or joins. This paper presents as well Pangool, an open-source framework implementing Tuple Map Reduce. Pangool eases the design and implementation of applications based on Map Reduce and increases their flexibility, still maintaining Hadoop´s performance.
Keywords :
distributed programming; public domain software; Hadoop; Pangool; compound records; foundational model; low-level constructs; open-source framework; tuple MapReduce; Companies; Compounds; Computational modeling; Data models; Mathematical model; Programming; Sorting; Big Data; Distributed systems; Hadoop; MapReduce; Scalability;
Conference_Titel :
Data Mining (ICDM), 2012 IEEE 12th International Conference on
Conference_Location :
Brussels
Print_ISBN :
978-1-4673-4649-8
DOI :
10.1109/ICDM.2012.141