Large-scale Real-time Data-driven Scientific Applications

Large-scale real-time data processing is becoming common in many scientific disciplines. But processing large amount of data in real-time is still challenging with existing technology. In last few years, the dynamic data driven approach is becoming people´s spotlight due to its potential in reducing data intelligently. Enlighten by this concept, a new data-driven framework for large-scale real-time data analysis is proposed in this work and a scientific application under this framework is given in details. By introducing additional information to data analysis processes, large-scale data processing can be achieved with real-time time constraint.