Title :
Clustering with Normalized Information Potential Constrained Maximum Entropy Boltzmann Distribution
Author :
Ozertem, Umut ; Erdogmus, Deniz
Abstract :
From a probabilistic perspective, the question of clustering is ´what is the probability that two data samples belong to the same cluster?´´ Accepting the natural preclustering of samples into corresponding modes of the data probability distribution and answering the question posed above for these modes can reduce the problem complexity. Under the maximum entropy principle, a Boltzmann distribution model can be employed to evaluate the required mode-connectivity probabilities. An algorithm is developed using kernel density estimation in this framework. Its performance is demonstrated on benchmark datasets.
Keywords :
Boltzmann equation; estimation theory; maximum entropy methods; pattern clustering; probability; statistical distributions; Boltzmann distribution; kernel density estimation; maximum entropy principle; normalized information potential; pattern clustering; probability distribution; problem complexity; question answering; Boltzmann distribution; Clustering algorithms; Data analysis; Entropy; Kernel; Machine learning; Machine learning algorithms; Merging; Partitioning algorithms; Probability distribution;
Conference_Titel :
Neural Networks, 2006. IJCNN '06. International Joint Conference on
Conference_Location :
Vancouver, BC
Print_ISBN :
0-7803-9490-9
DOI :
10.1109/IJCNN.2006.247169