Paper characterizes minimax regret rates for online ranking with top-k feedback.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper introduces MPES for top-k ranking BO with preferential observations.
The paper proposes methods to identify and sample from mixtures of Mallows models for top-k rankings.
We present online boosting algorithms for multilabel ranking with top-k feedback, where the learner only receives information about the top k items from the ranking it provides. We propose a novel surrogate loss function and unbiased estimator, allowing weak learners to update themselves with limited information. Using…
The paper addresses calibration in label ranking, a structured prediction task.
This paper explores the preference-based top- rank aggregation problem. Suppose that a collection of items is repeatedly compared in pairs, and one wishes to recover a consistent ordering that emphasizes the top- ranked items, based on partially revealed preferences. We focus on the Bradley-Terry-Luce (BTL) model…
RAMPART ranks top-k features more accurately than existing methods.
Proposes a method to infer ranking properties and top-K rankings with uncertainty quantification.
Optimizes ranking of top-k players from partial comparison data.
We explore the top- rank aggregation problem. Suppose a collection of items is compared in pairs repeatedly, and we aim to recover a consistent ordering that focuses on the top- ranked items based on partially revealed preference information. We investigate the Bradley-Terry-Luce model in which one ranks items ac…
We study the active learning problem of top- ranking from multi-wise comparisons under the popular multinomial logit model. Our goal is to identify the top- items with high probability by adaptively querying sets for comparisons and observing the noisy output of the most preferred item from each comparison. To ac…
We study the top- ranking problem where the goal is to recover the set of top- ranked items out of a large collection of items based on partially revealed preferences. We consider an adversarial crowdsourced setting where there are two population sets, and pairwise comparison samples drawn from one of the populat…
New methods provide stable ranking without assumptions on data distributions.
This paper explores the adaptive (active) PAC (probably approximately correct) top- ranking (i.e., top- item selection) and total ranking problems from -wise () comparisons under the multinomial logit (MNL) model. By adaptively choosing sets to query and observing the noisy output of the most favored …
Paper extends top-k Mallows model for better user preference analysis.
Paper introduces efficient top-k selection with differential privacy.
Motivated by applications in recommender systems, web search, social choice and crowdsourcing, we consider the problem of identifying the set of top items from noisy pairwise comparisons. In our setting, we are non-actively given pairwise comparisons between each pair of items, where each comparison has noi…
Given an incomplete ratings data over a set of users and items, the preference completion problem aims to estimate a personalized total preference order over a subset of the items. In practical settings, a ranked list of top- items from the estimated preference order is recommended to the end user in the decreasing …
Low-rank framework for task-specific LLM ranking from sparse comparisons.
This paper is concerned with the problem of top- ranking from pairwise comparisons. Given a collection of items and a few pairwise comparisons across them, one wishes to identify the set of items that receive the highest ranks. To tackle this problem, we adopt the logistic parametric model --- the Bradley-Te…
Paper tackles ranking items with a semi-random comparison graph and a monotone adversary.
New method reduces variance in estimating PL model expectations.
New approaches estimate recommendation metrics using sampling.
Efficiently calculates PL model likelihood for partitioned preference data.
We consider data in the form of pairwise comparisons of n items, with the goal of precisely identifying the top k items for some value of k < n, or alternatively, recovering a ranking of all the items. We analyze the Copeland counting algorithm that ranks the items in order of the number of pairwise comparisons won, an…
New statistical models for predicting ranked preferences from partial orders.
Paper analyzes trade-offs in top-k classification accuracies and proposes a new loss function.
Distributions over rankings are used to model data in various settings such as preference analysis and political elections. The factorial size of the space of rankings, however, typically forces one to make structural assumptions, such as smoothness, sparsity, or probabilistic independence about these underlying distri…
Class ambiguity is typical in image classification problems with a large number of classes. When classes are difficult to discriminate, it makes sense to allow k guesses and evaluate classifiers based on the top-k error instead of the standard zero-one loss. We propose top-k multiclass SVM as a direct method to optimiz…
The top- error is often employed to evaluate performance for challenging classification tasks in computer vision as it is designed to compensate for ambiguity in ground truth labels. This practical success motivates our theoretical analysis of consistent top- classification. Surprisingly, it is not rigorously und…
A method for rank verification in multivariate Gaussian data, improving on existing approaches.
The paper tackles learning true rankings from noisy, incomplete data.
Paper introduces a new loss function for deep imbalanced classification.
Smoothed top-k operator improves model training efficiency.
We consider the problem of personalization of online services from the viewpoint of ad targeting, where we seek to find the best ad categories to be shown to each user, resulting in improved user experience and increased advertisers' revenue. We propose to address this problem as a task of ranking the ad categories dep…
CIT and CIF improve feature selection for downstream prediction.
In order to push the performance on realistic computer vision tasks, the number of classes in modern benchmark datasets has significantly increased in recent years. This increase in the number of classes comes along with increased ambiguity between the class labels, raising the question if top-1 error is the right perf…
We propose a rank- variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation (-SVD) in Frank-Wolfe with a top- singular-vector computation (-SVD), which can be done by repeatedly applying -SVD times. …
Unified model for prediction and deferral selects top-k entities efficiently.
Top-k error is currently a popular performance measure on large scale image classification benchmarks such as ImageNet and Places. Despite its wide acceptance, our understanding of this metric is limited as most of the previous research is focused on its special case, the top-1 error. In this work, we explore two direc…
A framework for quantifying uncertainty in feature importance values.
A common problem in machine learning is to rank a set of n items based on pairwise comparisons. Here ranking refers to partitioning the items into sets of pre-specified sizes according to their scores, which includes identification of the top-k items as the most prominent special case. The score of a given item is defi…
Study improves top-k set prediction with low cardinality.
Top-k sparsification reduces deep learning communication costs.
Proposes differentiable and sparse top-k operators for neural networks.
Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet popular probabilistic models are often too rigid to capture such complexities. In…
Proposes efficient stochastic algorithms for optimizing NDCG with provable convergence guarantees.
Work on making classifiers robust against adversarial attacks for top-k predictions.