Implementation of the Big Data Management System for Demand Side Energy Management

In this work, we develop the Business Platform for demand side management in energy sector. This paper introduces the Business Platform and describes the development of the pilot platform and main components. In addition, main applications such as Automated Demand Response (AutoDR) and Monitoring Based Commissioning (MBCx) is presented. One of main components of the platform is the Big Data Management System to save and analyze the energy big data. We constructed two big data cluster systems: one is a Hadoop cluster and the other is the one Spark installed. We also implemented software modules to collect and generate the energy big data. The data flow inside the platform is presented and development of APIs to access the big data is implemented. In addition, we developed various applications on top of the platform using the APIs and present one application in this paper, which is the monitoring service.