State and action space segmentation algorithm in Q-learning

In this paper, we propose a novel Q-learning algorithm that segmentalizes the agent environment and action. This algorithm is learned through interaction with an environment and provides deterministic space segmentation. The purposes of this study can be divided into two main groups: search domain reduction and heuristic space segmentation. In our method, the most activated space segment is divided into new two segments with the learning by a heuristic and recognizable method. Appropriate search domain reduction can minimize the learning time and enables us to recognize the evolutionary process. This segmentation method is also designed for social simulation models. Social space segmentation, such as language systems and culture, is revealed by multi-agent social simulation with our method.