Dempster-Shafer theory of evidence in Single Pass Fuzzy C Means

Clustering large data sets has become very importantas the amount of available unlabeled data increases. Single Pass Fuzzy C Means (SPFCM) is useful when memory is too limited to load the whole data set. The main idea is to divide dataset into several chunks and to apply FCM to each chunk. SPFCM uses the weighted cluster centers of the previous chunk in the next chunks. Although when the number of chunks is increased, the algorithm shows sensitivity to the order the data processed. Hence, we improved SPFCM by recognizing boundary and noisy data in each chunk and using it to influence clustering in the next chunks. In this regard, the proposed approach transfers the boundary and noisy data as well as the weighted cluster centers to the next chunks. We show that our proposed approach is significantly less sensitive to the order in which the data is loaded in each chunk.