Strategy Entropy as a Measure of Strategy Convergence in Reinforcement Learning

The concept of entropy is introduced into reinforcement learning. The definitions of the local and global strategy entropy are presented. The global strategy entropy is experimentally proved to be the quantitative problem-independent measure of the strategypsilas convergence degree. The experimental results show that the learning based on the local strategy entropy improves the learning performance.