DocumentCode :
168699
Title :
Wave: Trigger Based Synchronous Data Process System
Author :
Kun Lu ; MingMing Sun ; ChangLong Li ; Hang Zhuang ; Jinhong Zhou ; Xuehai Zhou
Author_Institution :
Dept. of Comput. Sci. & Technol., Univ. of Sci. & Technol. of China, Hefei, China
fYear :
2014
fDate :
26-29 May 2014
Firstpage :
540
Lastpage :
541
Abstract :
With the rapid development of cloud computing, more and more applications need to process large amount of data on clusters. Different types of data processing frameworks in cloud have appeared, such as MapReduce, Spark and Percolator. These frameworks are used to a certain type of data processing. In this paper, we provide processing framework called Wave, which is designed for bulk data processing, incremental computing and iterative processing with a uniform application interface. Wave is an event driven data process model for semi-structured data of distributed systems. Programmers use events and trigger reactions to process the data. Wave provides simplified API for users to implements parallel programs on cluster. Programs running in Wave are automatically parallelized and executed on cluster synchronously. Wave uses an implicit mechanism to synchronize the parallel program´s execution without any user specification.
Keywords :
application program interfaces; cloud computing; parallel programming; pattern clustering; API; MapReduce; Percolator; Spark; application interface; bulk data processing; cloud computing; data processing framework; distributed system; event driven data process model; incremental computing; iterative processing; parallel program; rapid development; semistructured data; trigger based synchronous data process system; user specification; Computational modeling; Data models; Data processing; Distributed databases; Generators; Programming; Synchronization; incremental computing; synchronized data process; trigger based system;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Cluster, Cloud and Grid Computing (CCGrid), 2014 14th IEEE/ACM International Symposium on
Conference_Location :
Chicago, IL
Type :
conf
DOI :
10.1109/CCGrid.2014.124
Filename :
6846492
Link To Document :
بازگشت