DocumentCode :
1502184
Title :
Theoretical analysis and improved decision criteria for the n-tuple classifier
Author :
Jørgensen, Thomas Martini ; Linneberg, Christian
Author_Institution :
Riso Nat. Lab., Roskilde, Denmark
Volume :
21
Issue :
4
fYear :
1999
fDate :
4/1/1999 12:00:00 AM
Firstpage :
336
Lastpage :
347
Abstract :
The anticipated behavior of the n-tuple classification system is that it gives the highest output score for the class to which the input example actually belongs. By performing a theoretical analysis of how the output scores are related to the underlying probability distributions of the data, this paper shows that this in general is not to be expected. The theoretical results are able to explain the behavior that is observed in experimental studies. The theoretical analysis also give valuable insight into how the n-tuple classifier can be improved to deal with skewed training priors, which until now have been a hard problem for the architecture to tackle. It is shown that by relating an output score to the probability that a given class generates the data makes it possible to design the n-tuple net to operate as a close approximation to the Bayes estimator. It is specifically illustrated that this approximation can be obtained by modifying the decision criteria. In real cases, the underlying example distributions are unknown and accordingly the optimum way to treat the output scores cannot be calculated theoretically. However, it is shown that the feasibility of performing leave-one-out cross-validation tests in n-tuple networks makes it possible to obtain proper processing of the scores in such cases
Keywords :
Bayes methods; pattern classification; probability; Bayes estimator; classification system; decision criteria; leave-one-out cross-validation tests; probability distributions; Bayesian methods; Helium; Maximum likelihood estimation; Neural networks; Pattern recognition; Performance analysis; Performance evaluation; Probability distribution; Table lookup; Testing;
fLanguage :
English
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
Publisher :
ieee
ISSN :
0162-8828
Type :
jour
DOI :
10.1109/34.761264
Filename :
761264
Link To Document :
بازگشت