DocumentCode
1173318
Title
The similarity metric
Author
Li, Ming ; Chen, Xin ; Li, Xin ; Ma, Bin ; Vitányi, Paul M B
Author_Institution
Comput. Sci. Dept., Univ. of Waterloo, Ont., Canada
Volume
50
Issue
12
fYear
2004
Firstpage
3250
Lastpage
3264
Abstract
A new class of distances appropriate for measuring similarity relations between sequences, say one type of similarity per distance, is studied. We propose a new "normalized information distance," based on the noncomputable notion of Kolmogorov complexity, and show that it is in this class and it minorizes every computable distance in the class (that is, it is universal in that it discovers all computable similarities). We demonstrate that it is a metric and call it the similarity metric . This theory forms the foundation for a new practical tool. To evidence generality and robustness, we give two distinctive applications in widely divergent areas using standard compression programs like gzip and GenCompress. First, we compare whole mitochondrial genomes and infer their evolutionary history. This results in a first completely automatic computed whole mitochondrial phylogeny tree. Secondly, we fully automatically compute the language tree of 52 different languages.
Keywords
data mining; information theory; GenCompress; Kolmogorov complexity; gzip; language tree computation; normalized information distance; parameter-free data mining; phylogeny tree; similarity metric; standard compression programs; whole mitochondrial genomes; Bioinformatics; Biology computing; Computer science; Data mining; Genomics; History; Internet; Phylogeny; Plagiarism; Robustness; 65; Dissimilarity distance; Kolmogorov complexity; language tree construction; normalized compression distance; normalized information distance; parameter-free data mining; phylogeny in bioinformatics; universal similarity metric;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2004.838101
Filename
1362909
Link To Document