Modelling on clustering algorithm based on iteration feature selection for micro-blog posts

With the coming of big data era, data mining and intelligent processing become more and more important, and modelling on novel intelligent processing is necessary. As micro-blog posts´ properties on short texts, together with their linguistic unreliable features and the incompleteness of lexical, it is necessary to analyze and cluster these similar posts together for the further data mining and recommendation. This paper takes advantage of the classical clustering algorithm of k-means, and then presents a novel modelling approach to partition the big data into the corresponding k groups. Furthermore, a text feature selection model based on 2-phase iteration is proposed. Based on this model, a micro-blog post clustering algorithm is present. The proposed algorithm takes use of the partition idea and avoids the influence of noise data. Experiment shows the feasible of the proposed approach, and some existing problems and further works are also presented in the end.