A Cluster Validity Framework Based on Induced Partition Dissimilarity

We describe a new cluster validity framework (CVF) that compares structure in the data (in dissimilarity form) to the structure of dissimilarity matrices induced by a matrix transformation of the partition being tested. As part of this framework, we show two possible cluster validation measures: one, visual cluster validity, that that uses visual comparison and another one, correlation cluster validity, based on correlation. Unlike many existing measures, the measures we propose can be applied to crisp or soft partitions obtained by any relational or object data clustering algorithm. We illustrate the new measures and compare them to several well-known existing measures using real and artificial data sets.