Benefit analysis for grid-connected photovoltaic system based on markov decision processes with expected total reward criterion

With the help of Markov decision-making process (MDP), the power optimization structure has been established based on 5.6 kW grid-connected PV system generation in Beijing. Using the infinite-stage decision of MDP, one step transition probability matrix and the expected total reward criterion have been obtained. According to weather conditions and the surplus of benefits matrix, PV generation was distributed to load, grid power and batteries. The example result shows that the expected total reward criterion of MDP applying to grid-connected photovoltaic system is more powerful.