Research of multi-power structure optimization for grid-connected photovoltaic system based on Markov decision-making model

With renewable energy generating rapid growth, multi-power structure optimization problem with the grid-connected PV power has been a cause of concern. This paper presents Markov decision-making process (MDP) conditions, optimal dynamic programming strategy, N-stage total expectation reward criteria and total expectation cost of MDP model in multi-power structure optimization with grid-connected PV power. In considering the grid-connected PV power system constraints, MDP transition probability matrix of the multi-power structural optimization has been determined. After testing and verifying by the actual operation of 5.6 kW grid-connected PV power in Beijing University of Civil Engineering and Architecture, it is shown that the MDP model is a useful theoretical tool to study multi-power structure optimization problem with the grid-connected PV power under the random environment.