Title :
Big Data Real-Time Processing Based on Storm
Author :
Wenjie Yang ; Xingang Liu ; Lan Zhang ; Yang, L.T.
Author_Institution :
Dept. of Electron. Eng., Univ. of Electron. Sci. & Technol. of China, Chengdu, China
Abstract :
As the growth of Internet, Cloud Computing, Mobile Network and Internet of Things is increasing rapidly, Big Data is becoming a hot-spot in recent years. Big Data Processing is involved in our daily life such as mobile devices, RFID and wireless sensors, which aims at dealing with billions of users´ interactive data. At the same time, real-time processing is eagerly needed in integrated system. In this paper, several technologies associated with real-time big data processing are introduced, among which the core technology called Storm is emphasized. An entire system is built based on Storm, associated with RabbitMQ, NoSQL and JSP. To ensure the practical applicability and high efficiency, a simulation system is established and shows acceptable performance in various expressions using data sheet and Ganglia. It is proved that the big data real-time processing based on Storm can be widely used in various computing environment.
Keywords :
Big Data; digital simulation; high level languages; Big Data real-time processing; Ganglia; Internet of Things; JSP; NoSQL; RabbitMQ; Storm; cloud computing; data sheet; mobile network; simulation system; Data handling; Data storage systems; Distributed databases; Information management; Real-time systems; Storms; User interfaces; Big Data; real-time processing; Storm; Distributed Computing;
Conference_Titel :
Trust, Security and Privacy in Computing and Communications (TrustCom), 2013 12th IEEE International Conference on
Conference_Location :
Melbourne, VIC
DOI :
10.1109/TrustCom.2013.247