Unified approach to aggregating models and preferences.
problem Consistent aggregation of models and preferences.
method Formal definition and weighted averaging of models and preferences.
result All rational aggregation rules are weighted averages of highest-ranked models/experts.
A method for learning rankings in non-stationary data streams.
problem Learning preferences in a population that changes over time.
method Generalized Borda algorithm for non-stationary ranking streams.
result Bounds on the minimum number of samples required to output the ground truth.
A novel MQCAL method selects high-value samples via weighted rank aggregation.
problem Lack of scalable and general integration criteria for MQCAL methods.
method Proposes a novel MQCAL method using weighted rank aggregation.
result Achieves superior results compared to state-of-the-art MQCALs.
This paper solves aggregation of Pareto optimal models by using Bayesian priors and weighted averaging.
problem How to rationally aggregate Pareto optimal models while preserving Pareto efficiency.
method Four logical steps: 1) Bayesian models, 2) Prior as preference ranking, 3) Consistent aggregation, 4) Weighted average of priors.
result All rational/consistent aggregation rules follow a generalized hierarchical Bayesian model.
We study the problem of rank aggregation: given a set of ranked lists, we want to form a consensus ranking. Furthermore, we consider the case of extreme lists: i.e., only the rank of the best or worst elements are known. We impute missing ranks by the average value and generalise Spearman's ρto extreme ranks. Our main …
Proposes DATELINE for aggregating k-ary preferences with uncertainty.
problem Aggregating k-ary preferences with feature information and uncertainty.
method Employing deep neural networks and a weighted Plackett-Luce model with uncertainty vectors.
result Provides theoretical guarantees for robustness.
This paper addresses the problem of rank aggregation, which aims to find a consensus ranking among multiple ranking inputs. Traditional rank aggregation methods are deterministic, and can be categorized into explicit and implicit methods depending on whether rank information is explicitly or implicitly utilized. Surpri…
Annealed Entropic Allocation improves ranking and selection by mitigating hard switching and improving finite-budget discrimination.
problem Sequential budget allocation in ranking and selection
method Annealed weighted soft-min framework
result Surrogate converges uniformly to the hard minimum, soft-min weights concentrate on active challengers, and target allocation map is continuous.
The paper addresses privacy in rank aggregation using randomized responses.
problem Preserving privacy while aggregating pairwise rankings.
method Adaptive debiasing method for randomized response rankings.
result Established minimax rates for estimation errors and optimal privacy guarantees.
Learning the true ordering between objects by aggregating a set of expert opinion rank order lists is an important and ubiquitous problem in many applications ranging from social choice theory to natural language processing and search aggregation. We study the problem of unsupervised rank aggregation where no ground tr…
This paper compares rank aggregation methods for partial label ranking.
problem Handling partial label ranking with ties.
method Scoring-based and non-parametric probabilistic-based rank aggregation methods.
result Scoring-based variants consistently outperform the state-of-the-art method.
This work analyzes two methods for combining multiple binary labels in bipartite ranking.
problem Combining multiple binary labels for optimal bipartite ranking.
method Loss aggregation vs. label aggregation approaches.
result Label aggregation is preferable to loss aggregation due to label dictatorship issues.
Learning algorithms that aggregate predictions from an ensemble of diverse base classifiers consistently outperform individual methods. Many of these strategies have been developed in a supervised setting, where the accuracy of each base classifier can be empirically measured and this information is incorporated in the…
New method improves forecast accuracy using CRPS for probabilistic predictions.
problem Improving forecast accuracy for probabilistic predictions, especially in the tails of distributions.
method Introduces a new weighting method for pointwise CRPS learning, optimizing across quantiles.
result Proposed fully adaptive Bernstein online aggregation (BOA) method for pointwise CRPS online learning has optimal convergence properties.
Proposes HTM for aggregating ranked data considering user accuracy.
problem Aggregating ranked data from heterogeneous users with varying accuracy levels.
method Heterogeneous Thurstone Model (HTM) with alternating gradient descent algorithm.
result Algorithm converges linearly and outperforms existing methods.
Optimal fuzzy classification aggregation functions are weighted means.
problem Characterizing optimal fuzzy classification aggregation functions.
method Proving optimality of weighted arithmetic means for fuzzy classification.
result Optimal fuzzy classification aggregation functions are weighted means.
Partial fusion combines neural networks to balance accuracy and efficiency.
problem Balancing accuracy and computational cost in neural networks.
method Extending weight aggregation methods based on neuron-level similarity, using partial optimal transport to match similar neurons.
result Achieves a flexible tradeoff between computational cost and performance.
We introduce a new family of minmax rank aggregation problems under two distance measures, the Kendall τ and the Spearman footrule. As the problems are NP-hard, we proceed to describe a number of constant-approximation algorithms for solving them. We conclude with illustrative applications of the aggregation methods on…
We extend the recently introduced theory of Lovasz-Bregman (LB) divergences (Iyer & Bilmes 2012) in several ways. We show that they represent a distortion between a "score" and an "ordering", thus providing a new view of rank aggregation and order based clustering with interesting connections to web ranking. We show ho…
We extend the recently introduced theory of Lovasz-Bregman (LB) divergences (Iyer & Bilmes, 2012) in several ways. We show that they represent a distortion between a 'score' and an 'ordering', thus providing a new view of rank aggregation and order based clustering with interesting connections to web ranking. We show h…
We improve prediction set coverage by assigning weights to individual sets.
problem Aggregating multiple prediction sets weakens overall coverage guarantee.
method Propose a framework for weighted aggregation of prediction sets.
result Achieve tighter coverage bounds that interpolate between 1−2α and 1−α guarantees. Paper analyzes sparse aggregation in GLMs with Kullback-Leibler risk bounds.
problem Sparse aggregation in GLMs for parameter approximation.
method Exponential weighted aggregation scheme with Kullback-Leibler risk bounds.
result Sharp oracle inequality for Kullback-Leibler risk with leading constant 1 and minimax-optimal rate of aggregation.
A new method for forming learning objectives using the sum of ranked range.
problem Forming learning objectives from aggregated values.
method Sum of ranked range (SoRR) minimization with DCA.
result The proposed method effectively forms learning objectives and is applicable to binary and multi-label/multi-class classification.
The study shows how probability weighting can lead to betting in a risk-averse economy.
problem Understanding how probability weighting affects economic behavior and risk aversion.
method Examining a von Neumann-Morgenstern economy with an RDU agent to model probability weighting effects.
result Probability weighting can lead to endogenous betting in an economy with common beliefs.
MANA-Net improves market predictions by dynamically weighting news sentiments.
problem Aggregated Sentiment Homogenization in financial news data.
method Dynamic market-news attention mechanism to aggregate sentiments.
result MANA-Net outperforms recent market prediction methods by 1.1% Profit & Loss and 0.252 daily Sharpe ratio.
Improved rank aggregation via spectral method reduces sample complexity.
problem Ranking items from pairwise comparisons with corrupted data.
method Spectral ranking algorithms based on unnormalized and normalized data matrices.
result Sharper ℓ∞-norm perturbation bound and error bound on maximum displacement for each item. The paper tackles targeted attacks on rank aggregation methods, proving the fixed point of adversarial game.
problem The security issue of rank aggregation methods, especially the vulnerability to targeted attacks.
method Formulated as a game-theoretic framework, the attack behavior is a fixed point of the composition of the adversary and the victim.
result The victims will produce the target ranking list once the adversary has complete information.
A novel approach for federated learning over-the-air computation to reduce latency and improve privacy.
problem Low-latency and privacy issues in edge machine learning for intelligent devices.
method Over-the-air computation and sparse-low-rank optimization for efficient global model aggregation.
result Efficient global model aggregation with low latency and improved privacy.
Paper develops a method to approximate Markov chains with fewer states.
problem Identifying the state aggregation structure of Markov chains with fewer states.
method Proposes a convex optimization problem with a nonnegative factorization approach.
result The method likely converges to the global solution and outperforms existing methods.
Paper proposes a method to aggregate customer engagement data for better ranking of e-commerce results.
problem Cold start problem and under-representation of new or under-impressed products in e-commerce search results.
method Aggregates customer engagements within a day for the same query as input training data for machine learning models.
result Training models on aggregated data leads to better ranking of new and under-impressed products.
New method preserves privacy by aggregating feature-vectors with weighted sums, ensuring label differential privacy.
problem Ensuring privacy in training data aggregation for sensitive labels.
method Learning from bag aggregates (LBA) with weighted Gaussian sums, preserving label differential privacy (label-DP).
result Weighted LBA using iid Gaussian weights with m randomly sampled disjoint k-sized bags provides (ε,δ)-label-DP. Paper improves probabilistic forecasts of electricity prices.
problem Combining multivariate probabilistic forecasts with dependencies.
method Online learning algorithm using Bernstein Online Aggregation (BOA).
result Significant improvement in CRPS over uniform combination.
Label ranking aims to learn a mapping from instances to rankings over a finite number of predefined labels. Random forest is a powerful and one of the most successful general-purpose machine learning algorithms of modern times. In this paper, we present a powerful random forest label ranking method which uses random de…
Decentralized ranking consensus via gossip for robust and scalable systems.
problem Achieving reliable and resilient consensus on collective rankings in a decentralized setting.
method Random gossip communication for decentralized computation of global rankings.
result Robust and scalable consensus on collective rankings achieved through decentralized, local interactions.
Rank aggregation systems collect ordinal preferences from individuals to produce a global ranking that represents the social preference. Rank-breaking is a common practice to reduce the computational complexity of learning the global ranking. The individual preferences are broken into pairwise comparisons and applied t…
Introduces SoRR for aggregating losses in supervised learning.
problem Aggregating individual losses into a single output for machine learning models.
method Sum of ranked range (SoRR) minimization using DCA.
result Demonstrates effectiveness of AoRR and TKML in improving robustness of multi-label learning.
New method ranks European countries' innovation performance considering criterion interactions.
problem Lack of consensus on weighting composite innovation indicators.
method Hierarchical-SMAA-Choquet integral approach to rank and benchmark innovation performance.
result Robust measurement of innovation performances in Europe with a hierarchy of interacting composite indicators.
The article improves prediction by aggregating Kalman recursions online.
problem Improving expert aggregation in prediction models.
method Using exponential weights and state-space models to aggregate Kalman recursions.
result New algorithms outperform existing methods in Kalman recursion expert aggregation.
We consider the problem of statistical inference for ranking data, specifically rank aggregation, under the assumption that samples are incomplete in the sense of not comprising all choice alternatives. In contrast to most existing methods, we explicitly model the process of turning a full ranking into an incomplete on…
PREMA recovers detailed data from aggregated views.
problem Reconstructing detailed data from aggregated views.
method Low-rank tensor factorization.
result Recovery guarantees under certain conditions.
Bayesian framework for comparing trading algorithms using cost analysis.
problem Comparing trading algorithms using cost analysis.
method Bayesian framework, hierarchical models, standardized benchmarks, fat tails, skewness, heteroscedasticity.
result Effective calculation of trading benchmarks with limited data.
Hierarchical framework for model evaluation on leaderboards
problem Uncertainty and variability in model performance across tasks
method Hierarchical framework with task-level and leaderboard-level rank prediction intervals
result Statistically valid and informative model rank intervals
New model reduces bias in crowdsourced pairwise comparisons.
problem Crowdsourced pairwise comparisons are biased due to perceptual factors.
method factorBT model accounts for irrelevant factors affecting worker answers.
result factorBT produces more accurate rankings than previous models.
CoarsenRank improves robustness in rank aggregation despite model misspecification.
problem Rank aggregation under model misspecification in real-world scenarios.
method CoarsenRank designs a neighborhood of ideal preferences to handle agnostic noise-corrupted data.
result CoarsenRank achieves robustness against model misspecification within a defined neighborhood.
New aggregation strategy handles unbounded losses with regret bounds.
problem Online optimization with unbounded loss functions.
method Follow The Regularized Leader (FTRL) with φ-divergence.
result Worst regret bound for unbounded losses with alternative divergences.
New method ranks sectors and countries using local and aggregate I-O data.
problem Ranking sectors and countries in global value chains using incomplete I-O tables.
method Rank-1 approximation to I-O tables using local and aggregate information. result Consistently good performance in reconstructing rankings of upstreamness and downstreamness.
CAggNet improves medical image segmentation by fusing coarse and fine features.
problem Medical image segmentation accuracy and efficiency.
method Crossing Aggregation Network with nested skip connections and weighted aggregation.
result CAggNet achieves more accurate and efficient segmentation compared to existing methods.
Improved ranking method for scarce data with feature info.
problem Ranking items with limited comparisons and feature data.
method Modified RankCentrality using diffusion methods for feature info.
result Meaningful rankings even with scarce comparisons.