Title :
Statistical Optimality in Multipartite Ranking and Ordinal Regression
Author :
Uematsu, Kazuki ; Yoonkyung Lee
Author_Institution :
Yamanashi Testing Center, Chemitox, Inc., Yamanashi, Japan
Abstract :
Statistical optimality in multipartite ranking is investigated as an extension of bipartite ranking. We consider the optimality of ranking algorithms through minimization of the theoretical risk which combines pairwise ranking errors of ordinal categories with differential ranking costs. The extension shows that for a certain class of convex loss functions including exponential loss, the optimal ranking function can be represented as a ratio of weighted conditional probability of upper categories to lower categories, where the weights are given by the misranking costs. This result also bridges traditional ranking methods such as proportional odds model in statistics with various ranking algorithms in machine learning. Further, the analysis of multipartite ranking with different costs provides a new perspective on non-smooth list-wise ranking measures such as the discounted cumulative gain and preference learning. We illustrate our findings with simulation study and real data analysis.
Keywords :
data analysis; regression analysis; statistics; bipartite ranking algorithms; convex loss functions; differential ranking costs; discounted cumulative gain; misranking costs; multipartite ranking; nonsmooth list-wise ranking measures; optimal ranking function; ordinal categories; ordinal regression; pairwise ranking errors; preference learning; proportional odds model; real data analysis; statistical optimality; statistics; traditional ranking methods; weighted conditional probability; Measurement; Minimization; Ranking (statistics); Sociology; Support vector machines; Training data; Bayes optimality; consistency; convex risk; multipartite ranking; ordinal regression;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2014.2360397