Title :
A similarity algorithm for categorical variables
Author :
Liang Zhao ; Jian-hui Liu
Author_Institution :
Inst. of Grad., Liaoning Tech. Univ., Huludao, China
Abstract :
How to measure the similarity of data objects is one of the most important problems in the data analysis. This paper proposes a method which uses only information of the distribution of attributes to measure the similarity between nominal data objects. In this algorithm, we made the logarithm form of the conditional probability the main interest, because we think that the distribution information is the only information that a dataset can tell us without domain knowledge. First we calculate conditional probability of the target data objects and every other attributes. Then we turn them into logarithm form and sort by the data objects. In last step, we use the average value of each attribute column to compose the feature vector of data objects, and the Euclidean distance will be the similarity metrics between the data objects. The experiments on extensive UCI data sets based on the derived similarity metrics will show the considerable accuracy.
Keywords :
category theory; data analysis; probability; Euclidean distance; UCI data sets; attribute column; categorical variables; conditional probability; data analysis; distribution information; domain knowledge; feature vector; nominal data object; similarity algorithm; similarity metrics; target data objects; Accuracy; Algorithm design and analysis; Bayes methods; Frequency measurement; Support vector machine classification; Vectors; Accuracy; Categorical Variables; Similarity measure;
Conference_Titel :
Natural Computation (ICNC), 2013 Ninth International Conference on
Conference_Location :
Shenyang
DOI :
10.1109/ICNC.2013.6818100