Title :
Theoretical analysis and improved decision criteria for the n-tuple classifier
Author :
Jørgensen, Thomas Martini ; Linneberg, Christian
Author_Institution :
Riso Nat. Lab., Roskilde, Denmark
fDate :
4/1/1999 12:00:00 AM
Abstract :
The anticipated behavior of the n-tuple classification system is that it gives the highest output score for the class to which the input example actually belongs. By performing a theoretical analysis of how the output scores are related to the underlying probability distributions of the data, this paper shows that this in general is not to be expected. The theoretical results are able to explain the behavior that is observed in experimental studies. The theoretical analysis also give valuable insight into how the n-tuple classifier can be improved to deal with skewed training priors, which until now have been a hard problem for the architecture to tackle. It is shown that by relating an output score to the probability that a given class generates the data makes it possible to design the n-tuple net to operate as a close approximation to the Bayes estimator. It is specifically illustrated that this approximation can be obtained by modifying the decision criteria. In real cases, the underlying example distributions are unknown and accordingly the optimum way to treat the output scores cannot be calculated theoretically. However, it is shown that the feasibility of performing leave-one-out cross-validation tests in n-tuple networks makes it possible to obtain proper processing of the scores in such cases
Keywords :
Bayes methods; pattern classification; probability; Bayes estimator; classification system; decision criteria; leave-one-out cross-validation tests; probability distributions; Bayesian methods; Helium; Maximum likelihood estimation; Neural networks; Pattern recognition; Performance analysis; Performance evaluation; Probability distribution; Table lookup; Testing;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on