Title :
Improvement of the MapReduce Model Based on Message Middleware Oriented Data Intensive Computing
Author :
Junwei, Ge ; Jiang, Xian ; Fang, Yiqiu
Author_Institution :
Libr. of Chongqing, Chongqing Univ. of Posts & Telecommun., Chongqing, China
Abstract :
MapReduce is an abstract model of processing big data with the parallel computing framework. However it is heavy that the model for the data intensive computing, DIC, depends on the data transmission between the cluster´s nodes which causes the overload on the master node handling the messages used to communicate with the nodes in the cluster. Therefore, this paper proposes an improved model of MapReduce based on message middleware, to improve the performance of DIC. This paper describes the principles and mechanism of the improved model in detail.
Keywords :
data handling; middleware; parallel processing; MapReduce model; data intensive computing; data transmission; message middleware; parallel computing; Computational modeling; Data communication; Data models; Distributed databases; Middleware; Parallel processing; Programming; MapReduce; data intensive computing; message middleware;
Conference_Titel :
Computational Intelligence and Security (CIS), 2011 Seventh International Conference on
Conference_Location :
Hainan
Print_ISBN :
978-1-4577-2008-6
DOI :
10.1109/CIS.2011.27
