A Unified Storage and Query Optimization Framework for Sensor Data

With the development of Internet of Things (IoT), large amounts of sensor data, which has the characteristics of multi-source, high speed and large volumes, etc., are generated. Traditional data storage and query approaches cannot handle them properly. To deal with such limitations, a unified storage and query optimization framework, named DeCloud-RealBase, is proposed towards the management of large volumes of sensor data. An adaptation layer is applied to connect the bottom-layer database clusters and basic database operations can be realized by top-layer applications through a unified interface. Furthermore, Caching technology, data partition strategy and multi-threading technology are applied to realize data storage and query in a high performance manner. Experiments demonstrate that DeCloud-RealBase is capable of handling the storage and query of sensor data with an excellent performance.