Title :
Real-time analytics processing with MapReduce
Author :
Peng, Cheng-zhang ; Jiang, Ze-jun ; Cai, Xiao-bin ; Zhang, Zhi-ke
Author_Institution :
Sch. of Comput. Sci. & Technol., Northwestern Polytech. Univ., Xi´´an, China
Abstract :
Many real-time analytical applications over massive data streams were performed by usually introducing a specific stream processing core. In general, these SPCs were not popularly applied to enterprises same as MapReduce, even if now real-time analytics applications are taken into attention more and more. For reversing this tide, we developed a new analytics system. Our system modified the stock Hadoop´s MapReduce programming model and execution framework, and used Chord model as temporary data, Cassandra as its persistent storage. With our system, we can develop data stream processing application with the familiar MapReduce programming model.
Keywords :
Internet; data handling; real-time systems; Chord model; MapReduce programming; SPC; massive data streams; persistent storage; real-time analytics processing; stream processing core; Abstracts; Adaptation models; Computational modeling; Monitoring; Programming; Real-time systems; Storms; Cassandra; Data stream processing; JOL; MapReduce; Real-time analytics;
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2012 International Conference on
Conference_Location :
Xian
Print_ISBN :
978-1-4673-1484-8
DOI :
10.1109/ICMLC.2012.6359554