Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

56112168224 · Jun 202019922001200920172026
48 results for top-k selection

Introduces top-kk regularization for better feature selection in machine learning.

problem Limited ability of existing feature selection methods to reconcile feature representativeness and inter-correlations.
method Top-kk regularization, which induces a sub-architecture on the model's architecture to select informative features and model complex relationships.
result Uniform approximation error bound for top-kk regularization approximating high-dimensional sparse functions.

Proposes differentiable and sparse top-k operators for neural networks.

problem Discontinuity of top-k operator makes it unsuitable for end-to-end training with backpropagation.
method Formulates top-k as a linear program over permutahedron, introduces p-norm regularization, and uses isotonic optimization.
result Successfully applied to neural network pruning, fine-tuning, and routing.

A new algorithm for selecting top-k arms in extreme contextual bandits with improved efficiency.

problem Selecting top-k arms from a large set with contextual information and limited rewards.
method Proposes an algorithm for both non-extreme and extreme settings, using Inverse Gap Weighting and arm hierarchy models.
result Achieves improved regret guarantees for extreme settings with significant computational and statistical efficiency.

Unified framework for deferring queries to top-k experts, improving accuracy-cost trade-offs.

problem Limitation of existing L2D frameworks to single-expert deferral.
method Top-kk Learning-to-Defer framework, including adaptive Top-k(x)k(x) variant.
result Superior accuracy-cost trade-offs with multi-expert deferral.

Distributed stochastic gradient descent (SGD) algorithms are widely deployed in training large-scale deep learning models, while the communication overhead among workers becomes the new system bottleneck. Recently proposed gradient sparsification techniques, especially Top-kk sparsification with error compensation (To…

2019-11-20abs ↗pdf ↗

New insights into the top-K sparse softmax gating function for deep learning.

problem Understanding the theoretical effects of the top-K sparse softmax gating function on density and parameter estimations.
method Using a Gaussian mixture of experts, novel loss functions, and theoretical analysis.
result The convergence rates of density and parameter estimations are parametric under certain conditions, but slow under over-specified models.

Class ambiguity is typical in image classification problems with a large number of classes. When classes are difficult to discriminate, it makes sense to allow k guesses and evaluate classifiers based on the top-k error instead of the standard zero-one loss. We propose top-k multiclass SVM as a direct method to optimiz…

2015-11-20abs ↗pdf ↗

The top-kk error is often employed to evaluate performance for challenging classification tasks in computer vision as it is designed to compensate for ambiguity in ground truth labels. This practical success motivates our theoretical analysis of consistent top-kk classification. Surprisingly, it is not rigorously und…

2019-01-30abs ↗pdf ↗

A method for finding most influential sets reduces a complex problem to a sequence of simpler top-kk problems.

problem Identifying most influential subsets in complex models.
method Reduces the problem to a sequence of top-kk problems using Dinkelbach's method.
result The method returns a globally optimal set for the univariate ratio objective, including partial linear models.

FedSel uses local differential privacy to protect data privacy in federated SGD.

problem Privacy leakage from gradients in federated SGD.
method Two-stage framework with top-k dimension selection and gradient accumulation.
result FedSel reduces privacy leakage by privately selecting important dimensions.

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks, especially white-box targeted attacks. One scheme of learning attacks is to design a proper adversarial objective function that leads to the imperceptible perturbation for any test image (e.g., the Carlini-Wagner (C&W) method). Most methods address targ…

2019-05-25abs ↗pdf ↗

Motivated by applications in recommender systems, web search, social choice and crowdsourcing, we consider the problem of identifying the set of top KK items from noisy pairwise comparisons. In our setting, we are non-actively given rr pairwise comparisons between each pair of nn items, where each comparison has noi…

2016-05-12abs ↗pdf ↗

In order to push the performance on realistic computer vision tasks, the number of classes in modern benchmark datasets has significantly increased in recent years. This increase in the number of classes comes along with increased ambiguity between the class labels, raising the question if top-1 error is the right perf…

2015-12-01abs ↗pdf ↗

Industrial recommender systems deal with extremely large action spaces -- many millions of items to recommend. Moreover, they need to serve billions of users, who are unique at any point in time, making a complex user state space. Luckily, huge quantities of logged implicit feedback (e.g., user clicks, dwell time) are …

2018-12-06abs ↗pdf ↗

DSelect-k improves MoE models for multi-task learning with better performance and smoother training.

problem Smoothness and convergence issues in sparse gate selection for MoE models.
method Developed DSelect-k, a differentiable and sparse gate for MoE models.
result DSelect-k achieves statistically significant improvements in prediction and expert selection over Top-k.

DART optimizes subset selection in non-linear bandit problems.

problem Optimizing subset selection in non-linear bandit problems with correlated rewards.
method DART algorithm for combinatorial bandits without individual arm feedback or linearity assumption.
result DART achieves a regret bound of ildeO(KKNT) ilde{\mathcal{O}}(K\sqrt{KNT}).

We present online boosting algorithms for multilabel ranking with top-k feedback, where the learner only receives information about the top k items from the ranking it provides. We propose a novel surrogate loss function and unbiased estimator, allowing weak learners to update themselves with limited information. Using…

2019-10-24abs ↗pdf ↗

Study on top-kk classification with new loss functions and algorithms.

problem Improving multi-class classification accuracy and cardinality trade-off.
method Introducing cardinality-aware loss functions and deriving their consistency bounds.
result New cardinality-aware algorithms for top-kk classification.

This paper explores the preference-based top-KK rank aggregation problem. Suppose that a collection of items is repeatedly compared in pairs, and one wishes to recover a consistent ordering that emphasizes the top-KK ranked items, based on partially revealed preferences. We focus on the Bradley-Terry-Luce (BTL) model…

2015-04-27abs ↗pdf ↗

A method for rank verification in multivariate Gaussian data, improving on existing approaches.

problem Determining the top KK means in multivariate Gaussian data with any covariance structure.
method Selective inference tools to generalize the two-sided difference-of-means test for any KK and covariance structure.
result The method provides a generalization for rank verification in multivariate Gaussian data with any covariance structure.

The paper proposes methods to identify and sample from mixtures of Mallows models for top-k rankings.

problem Identifying and sampling from mixtures of Mallows models for top-k rankings in a heterogeneous population.
method Efficient sampling algorithms and identifiability proofs for both components of the mixture.
result The identifiability and learnability of the Mallows components' parameters in the mixture.

Master-slave architecture tackles combinatorial multi-armed bandits with diversity constraints.

problem Solving top-KK combinatorial multi-armed bandits with non-linear feedback and diversity constraints.
method Master-slave architecture with six slave models, teacher learning, and policy co-training.
result Significantly outperforms existing algorithms in synthetic and real datasets.

We propose the Limited Multi-Label (LML) projection layer as a new primitive operation for end-to-end learning systems. The LML layer provides a probabilistic way of modeling multi-label predictions limited to having exactly k labels. We derive efficient forward and backward passes for this layer and show how the layer…

2019-06-20abs ↗pdf ↗

We study the top-KK ranking problem where the goal is to recover the set of top-KK ranked items out of a large collection of items based on partially revealed preferences. We consider an adversarial crowdsourced setting where there are two population sets, and pairwise comparison samples drawn from one of the populat…

2016-02-15abs ↗pdf ↗

Optimizes ranking of top-k players from partial comparison data.

problem Identifying the top-k players from incomplete pairwise comparisons.
method Maximum Likelihood Estimator (MLE) and Spectral Method.
result MLE achieves optimal partial and exact recovery, while Spectral Method is sub-optimal.

Optimizes identifying top-k items from comparisons with minimal comparisons.

problem Finding the top-k items from pairwise comparisons with a fixed error rate.
method Developed an asymptotically optimal algorithm using primal-dual procedure and adaptive comparison allocation.
result Proves the algorithm is asymptotically optimal for top-k identification.

A new energy-efficient pruning method for federated learning.

problem Energy inefficiency in gradient sparsification for federated learning.
method Formalized energy-constrained projection problem and proposed Cost-Weighted Magnitude Pruning (CWMP).
result CWMP optimally balances performance and energy efficiency in federated learning.

The paper addresses calibration in label ranking, a structured prediction task.

problem Calibration in label ranking is not well understood and often poorly calibrated.
method Formalized calibration for label ranking, developed a hierarchy of notions, and empirically evaluated models.
result Popular label ranking models are often poorly calibrated, with differences between sub-ranking and top-k metrics.

The paper addresses selection bias in conformal prediction for focal units.

problem Selection bias in marginally valid conformal prediction intervals for focal units.
method A general framework for constructing selection-conditional coverage prediction sets.
result Efficient methods for various selection rules with exact finite-sample coverage.