New ranking system balances fairness and user utility.
problem Achieving group fairness in ranking systems.
method Formulated a minimax game between a ranking player and an adversary.
result Better utility for highly fair rankings.
The problem of ranking is a multi-billion dollar problem. In this paper we present an overview of several production quality ranking systems. We show that due to conflicting goals of employing the most effective machine learning models and responding to users in real time, ranking systems have evolved into a system of …
Scorio.jl ranks systems from repeated tasks using various methods.
problem Evaluating and ranking systems from repeated responses to shared tasks.
method Common tensor-based interface for multiple ranking methods.
result Pilot experiments show stability and runtime scaling.
Paper identifies tensor ranks via prior predictive matching, solving system of equations.
problem Determining the latent dimensions (ranks) in tensor factorization models.
method Prior predictive moment matching to transform moment matching conditions into a log-linear system of equations.
result Identifies which tensor models have identifiable ranks and derives rank estimators.
Two-stage risk control for ranked retrieval systems.
problem Assessing prediction uncertainty and risk control in sequential machine learning systems.
method Developed two-stage risk control methods based on LTT and CRC frameworks, leveraging sequential nature of retrieval and ranking phases.
result The proposed methods provide theoretical guarantees and reduce computational burden compared to prior work.
We implement a method for re-ranking top-10 results of a state-of-the-art question answering (QA) system. The goal of our re-ranking approach is to improve the answer selection given the user question and the top-10 candidates. We focus on improving deployed QA systems that do not allow re-training or re-training comes…
StealthRank subtly boosts LLM rankings without detectable anomalies.
problem Adversarial manipulation of LLM-driven ranking systems.
method Energy-based optimization with Langevin dynamics for stealthy prompt generation.
result StealthRank outperforms existing methods in covertly boosting rankings.
Paper introduces robust methods for consensus ranking in AI systems.
problem Developing reliable ranking systems in AI despite contaminated data.
method Introduces robustness concepts and statistical methods for consensus ranking.
result Proposes extensions of breakdown point for consensus ranking.
PSI-LinUCB improves scalability for large recommender systems.
problem Efficiently training and inferring for large action spaces in recommender systems.
method Represent inverse design matrix as diagonal + low-rank correction, derive stable rank-1 and batched updates, use projector-splitting integrator.
result Demonstrated effectiveness on recommender system datasets, achieving scalable training and inference.
The paper improves recommendation systems by ensuring their outputs are reliable.
problem Recommendation systems often lack reliability guarantees for their outputs.
method The method uses a pre-trained ranking model to create a set of items with rigorous FDR control.
result The approach provides a way to guarantee the reliability of recommendation outputs.
This work transfers fairness notions from binary classification to learning to rank.
problem Fairness concerns in automated ranking systems.
method Formalism to incorporate fairness objectives in learning to rank with provable guarantees.
result Improves ranking fairness substantially with minimal loss in model quality.
Paper tackles underranking in group-fair ranking systems, proving a trade-off and presenting an algorithm.
problem Underranking in group-fair ranking systems can worsen social and economic inequalities.
method Formulated underranking as a new problem, proved a lower bound, and presented a fair ranking algorithm.
result Algorithm achieves best of underranking and group fairness, confirming theoretical trade-off.
Proposes a method for explaining ranking decisions in learning systems.
problem Limited work on interpreting ranking decisions from learning systems.
method Model agnostic local explanation method using optimization to maximize validity.
result Approach outperforms other methods in validity across different LTR models.
Review of algorithms for linear system approximations.
problem Linear approximation of high-dimensional dynamical systems.
method State-of-the-art algorithms for low-rank DMD.
result Provides additional details for comprehensive understanding.
Develops TOFU for tensor bandits with low-rank structure.
problem Linear bandit models fail to capture high-dimensional, low-rank tensor structures.
method Develops TOFU, a tensor bandit algorithm that estimates low-dimensional subspaces and uses norm constraints.
result Improves regret bound by a multiplicative factor that grows exponentially in system order.
Develops algorithms for personalized ranking in recommender and energy systems.
problem Designing algorithms for personalized ranking in dynamic systems.
method Proposes SAROS for recommender systems and a fault detection algorithm for power systems.
result SAROS outperforms traditional methods in both recommender and energy systems.
Owing to the advancement of deep learning, artificial systems are now rival to humans in several pattern recognition tasks, such as visual recognition of object categories. However, this is only the case with the tasks for which correct answers exist independent of human perception. There is another type of tasks for w…
A new kernel for ranked data tackles computational challenges.
problem Complex geometric structure and partial rankings make existing algorithms infeasible for real-world applications.
method Derives a graph cut kernel that combines submodular optimization and kernel-based methods.
result The graph cut kernel efficiently handles large-scale ranked data.
An Atlas model is a rank-based system of continuous semimartingales for which the steady-state values of the processes follow a power law, or Pareto distribution. For a power law, the log-log plot of these steady-state values versus rank is a straight line. Zipf's law is a power law for which the slope of this line is …
Melanoma is the deadliest form of skin cancer. Computer systems can assist in melanoma detection, but are not widespread in clinical practice. In 2016, an open challenge in classification of dermoscopic images of skin lesions was announced. A training set of 900 images with corresponding class labels and semi-automatic…
We propose a method to infer stochastic low-rank RNNs from neural data.
problem Fitting low-rank RNNs to noisy, stochastic neural data.
method Variational sequential Monte Carlo methods for stochastic low-rank RNNs.
result Lower dimensional latent dynamics compared to state-of-the-art methods.
Unified transformer-based LT-TTD improves ranking efficiency and quality.
problem Decoupled L1 and L2 models in recommendation and search systems cause irreversible error propagation and suboptimal ranking.
method LT-TTD combines two-tower models with transformer expressivity in a unified listwise learning framework, providing theoretical guarantees and UPQE evaluation.
result LT-TTD reduces irretrievable relevant items and achieves better global optimization than disjoint training.
The paper tackles long-context linear system identification with improved sample complexity bounds.
problem Identifying dynamical systems with long dependencies over fixed context windows.
method Established sample complexity bounds for systems with linear dependencies over a context window of length p.
result The learning process is not hindered by slow mixing properties in extended context windows.
Motivated by control-affine systems in optimal control theory, we introduce the notion of a point-affine distribution on a manifold X - i.e., an affine distribution F together with a distinguished vector field contained in F. We compute local invariants for point-affine distributions of constant type when dim(X)=n, ran…
New gossip algorithms improve robustness of rank-based statistics in decentralized systems.
problem Ensuring robustness in decentralized AI and edge intelligence systems, especially in the presence of corrupted or adversarial data.
method Developed asynchronous gossip algorithms for computing rank-based statistics.
result First convergence rate bound for asynchronous gossip-based rank estimation.
Extended dual Coxeter and Artin groups theory to rank-three systems.
problem Extend dual Coxeter and Artin groups theory to rank-three systems.
method Geometric, combinatorial, and topological techniques.
result Proved the K(π,1) conjecture, triviality of the center, and solubility of the word problem for rank-three Artin groups. Rank-based Bayesian Optimization improves molecule selection in chemical systems.
problem Optimizing chemical compounds using traditional regression models.
method Introducing Rank-based Bayesian Optimization (RBO) using ranking models.
result RBO outperforms regression-based BO, especially for rough landscapes and activity cliffs.
Effective rank rigidity proved for cubulated groups with factor systems.
problem Rank rigidity in cubulated groups with factor systems.
method Exhibiting special pairs of hyperplanes and curtains for skewering.
result Effective form of rank rigidity proved for cubulated groups.
Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks, how can we quantify them, and how should we address them? In this paper we offer …
This research finds three meta-indicators for university rankings.
problem Complexity in university ranking systems.
method Interpretable machine learning approach.
result Identified three meta-indicators: time, space, and relationships.
We propose a novel way to train ranking models, such as recommender systems, that are both effective and efficient. Knowledge distillation (KD) was shown to be successful in image recognition to achieve both effectiveness and efficiency. We propose a KD technique for learning to rank problems, called \emph{ranking dist…
The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has been applied to produce Top-N recommendations. This approach uses the nuclear nor…
Proposes a deep learning model for timely and accurate recommendations.
problem Inability to provide timely recommendations and ranking issues with implicit feedback.
method Unified cross-network solution using listwise ranking for implicit data.
result Superior performance in accuracy, novelty, and diversity compared to baselines.
We consider systems of diffusion processes ("particles") interacting through their ranks (also referred to as "rank-based models" in the mathematical finance literature). We show that, as the number of particles becomes large, the process of fluctuations of the empirical cumulative distribution functions converges to t…
Paper proves finite BMS measure for SPR groups in higher rank Lie groups.
problem Finite measure for certain groups in higher rank Lie groups.
method Developed SPR property and proved finite BMS measure.
result Finite Bowen-Margulis-Sullivan measure for SPR groups in higher rank Lie groups.
Sample-Rank simplifies MO recommendations by sampling and ranking, improving revenue with stable conversion rates.
problem Multi-objective recommendations in online food ordering systems.
method Multi-goal sampling followed by ranking, reducing MO problem to LTR model.
result Significant lift in revenue (2.64%) with stable conversion rates, no drop in last-mile traversal.
We study the limiting behaviour of the empirical measure of a system of diffusions interacting through their ranks when the number of diffusions tends to infinity. We prove that the limiting dynamics is given by a McKean-Vlasov evolution equation. Moreover, we show that in a wide range of cases the evolution of the cum…
Researchers classify and characterize Bäcklund transformations for hyperbolic Monge-Ampère systems.
problem Classifying and characterizing Bäcklund transformations for hyperbolic Monge-Ampère systems.
method Completely determined a subclass of Bäcklund transformations for Type A systems and formulated conditions for Type B systems.
result Parametrized Bäcklund transformations for Type A systems and provided an invariant condition for Type B systems.
Top-N recommender systems have been investigated widely both in industry and academia. However, the recommendation quality is far from satisfactory. In this paper, we propose a simple yet promising algorithm. We fill the user-item matrix based on a low-rank assumption and simultaneously keep the original information. T…
This paper improves fairness in recommendation systems by learning individual preferences across multiple dimensions.
problem Fairness in recommender systems, especially in areas with social impact.
method Opportunistic multi-aspect re-ranking approach that learns individual preferences and enhances provider fairness.
result Achieves a better trade-off between accuracy and fairness across multiple fairness dimensions.
We establish a structure theorem for the integral points on moduli of special linear rank two local systems over surfaces, using mapping class group descent and boundedness results for systoles of local systems.
SALT models combine ARHMM and SLDS for efficient, interpretable time-series analysis.
problem Efficient modeling of systems with time-varying dynamics and long-range dependencies.
method Switching autoregressive low-rank tensor models parameterized with a low-rank factorization.
result SALT models provide a balance of interpretability and efficiency, outperforming ARHMMs and SLDSs.
Sparse sampling method for tensor factorization and completion of high rank tensors.
problem Completion of high rank tensors with missing data in recommendation systems.
method Sparse measurements and message-passing algorithms in a high-dimensional limit.
result Theoretical insights and performance analysis of tensor factorization in dense limit.
In this research, we introduce a robust metric to identify Systemically Important Financial Institution (SIFI) in a financial network by taking into account both common idiosyncratic shocks and contagion through counterparty exposures. We develop an efficient algorithm to rank financial institutions by formulating a fi…
Let $\A$ be a line arrangement in the complex projective plane $\PP^2$. Denote by M its complement and by $\M$ the set of points in $\A$ with multiplicity at least 3. A rank one local system L on M is admissible if roughly speaking the dimension of the cohomology groups Hm(M,L) can be compu…
Atlas models are systems of Ito processes with parameters that depend on rank. We show that the parameters of a simple Atlas model can be identified by measuring the variance of the top-ranked process for different sampling intervals.
Modern retrieval systems are often driven by an underlying machine learning model. The goal of such systems is to identify and possibly rank the few most relevant items for a given query or context. Thus, such systems are typically evaluated using a ranking-based performance metric such as the area under the precision-…
Decentralized ranking consensus via gossip for robust and scalable systems.
problem Achieving reliable and resilient consensus on collective rankings in a decentralized setting.
method Random gossip communication for decentralized computation of global rankings.
result Robust and scalable consensus on collective rankings achieved through decentralized, local interactions.