Deep neural network language model research and application overview

Research of the neural network language model in NLP is reviewed. In this paper, the neural network language models are classified into early shallow language models and deep neural network models based on deep learning. This paper emphatically introduces progress of the deep neural network language models, and summarizes the status of deep neural network research´s development. Finally, the existing problems and deficiencies are put forward.