Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

56112168224 · Jun 202019922001200920182026
48 results for pairwise probabilities

New methods estimate probabilities from pairwise comparisons, adapting to difficulty.

problem Estimating probabilities from pairwise comparisons with varying difficulty.
method Adaptive estimators using an adaptivity index based on indifference sets.
result CRL estimator has adaptivity index upper bounded by n\sqrt{n} up to logarithmic factors.

New algorithm learns HMM from pairwise co-occurrences, improving topic modeling.

problem Identifying hidden Markov models from limited pairwise co-occurrence data.
method Uses pairwise co-occurrence data to uniquely identify HMMs, even if higher-order probabilities are unknown.
result Shows improved topic modeling quality with HMMs compared to bag-of-words models.

Active seriation recovers item order from noisy pairwise similarity measurements.

problem Recovering an unknown item ordering from noisy pairwise similarity measurements.
method Proposes an active seriation algorithm that provably recovers the latent ordering with high probability.
result Establishes optimal performance guarantees for successful recovery under a uniform separation condition.

The paper proposes a method to calibrate evidential clustering using bootstrapped finite mixture models.

problem Representing uncertainty in cluster membership using Dempster-Shafer mass functions.
method Constructing Dempster-Shafer mass functions by bootstrapping finite mixture models, computing confidence intervals, and calibrating the evidential partition.
result The proposed method calibrates the evidential partition such that the belief and plausibility degrees approximate the true probabilities with high confidence.

Efficiently approximates softmax probabilities for large-scale inference.

problem High cost of computing softmax probabilities for large-scale inference.
method Introduces a lower bound on softmax probabilities as a product of pairwise probabilities, scalable through stochastic optimization and subsampling.
result Demonstrates that the new bound has interesting theoretical properties and can be used in classification problems.

Improved model capacity for graph cut algorithms by relaxing submodularity constraints.

problem Improving graph cut algorithms for complex image processing tasks.
method Enforce probably approximately submodular pairwise potentials instead of guaranteed submodular ones.
result Substantial improvement in model capacity with reduced inference error.

This work proposes a new method to estimate joint probability from pairwise marginals, reducing sample complexity.

problem Direct nonparametric estimation of high-dimensional joint probability is infeasible due to the curse of dimensionality.
method Developed a coupled nonnegative matrix factorization (CNMF) framework using only pairwise marginals.
result The method provably recovers the joint probability mass function up to bounded error in finite iterations under reasonable conditions.

An algorithm ranks items based on noisy comparisons, proving optimality without parametric assumptions.

problem Ranking items from noisy pairwise comparisons without making strong assumptions.
method Sequential ranking algorithm using counts of comparisons won and confidence intervals.
result Algorithm succeeds in optimal number of comparisons for non-parametric models.

New model for pairwise comparisons without stochastic transitivity.

problem Suboptimal performance of models assuming stochastic transitivity in real-world scenarios.
method Proposes a general family of statistical models using a skew-symmetric matrix.
result Achieves minimax-rate optimality and adapts to data sparsity.

This paper examines the problem of ranking a collection of objects using pairwise comparisons (rankings of two objects). In general, the ranking of nn objects can be identified by standard sorting methods using nlog2nn log_2 n pairwise comparisons. We are interested in natural situations in which relationships among the o…

2011-09-16abs ↗pdf ↗

Sampling a fraction of pairs can match full evaluation in machine learning losses.

problem High computational cost of full pairwise loss evaluation.
method Survey sampling techniques targeting informative pairs.
result Performance close to full pairwise evaluation achieved with frugal sampling.

Study on deep neural networks for reward modeling with pairwise comparison data.

problem Reward modeling with deep neural networks in non-parametric settings.
method Established a non-asymptotic regret bound for deep reward estimators, introduced a margin-type condition.
result Improved regret bound for deep reward estimators, highlighting the importance of clear human beliefs.

Develops a statistical framework to measure uncertainty in model rankings based on human preferences.

problem Uncertainty in model rankings based on human preferences due to mismatch between human and model preferences.
method Statistical framework using pairwise comparisons by humans and models to provide rank-sets for each model.
result Rank-sets constructed using only pairwise comparisons by strong models often do not cover the true ranking of human preferences.

New model accounts for scale variation and noise in pairwise comparisons.

problem Nonreciprocal pairwise comparisons in decision analysis.
method Additive model with structured matrix and random perturbation.
result Explicit estimators and probability assessments of admissible ranking regions.

An algorithm finds approximate rankings from pairwise comparisons with near-optimal comparisons.

problem Ranking items based on pairwise comparisons with minimal comparisons.
method Active ranking algorithm that decides comparisons based on confidence intervals.
result The algorithm succeeds in recovering approximate rankings with near-optimal comparisons.

Pairwise quantile regression tackles similarity scoring in biometric systems.

problem Analyzing errors in similarity scoring for facial recognition.
method Established theoretical guarantees for pairwise quantile regression solutions, leveraging sharp concentration results for UU-processes.
result Proved generalization bounds and identified conditions for fast learning rates.

Pairwise learning usually refers to a learning task which involves a loss function depending on pairs of examples, among which most notable ones include ranking, metric learning and AUC maximization. In this paper, we study an online algorithm for pairwise learning with a least-square loss function in an unconstrained …

2015-02-25abs ↗pdf ↗

Surv-IPTB estimates patient-specific treatment benefits using survival data.

problem Estimating individual treatment benefits in survival analysis.
method Attention-based framework for binary classification of treatment effects.
result Surv-IPTB outperforms existing methods in complex survival scenarios.

Exact simulation of correlated binary outcomes using PMF constraints and linear programming.

problem Simulating dependent Bernoulli outcomes with specific means and correlations.
method Formulate the problem over the joint Bernoulli PMF, impose constraints, and solve as a linear program. Use convex-hull characterization and truncated-moment completion scheme for feasibility and simulation.
result Exact simulation framework for correlated binary outcomes, providing a convex-hull characterization and truncated-moment completion scheme.

Paper introduces a new method for learning with distributions using dissimilarity measures.

problem Learning with probability distributions using dissimilarity measures.
method Introduces embeddings based on dissimilarity of distributions to templates, extending similarity theory to population distributions.
result Proves that dissimilarity theory holds for empirical distributions and shows better performance of Wasserstein distance embedding.

Estimates latent positions in 1D torus from noisy pairwise affinities.

problem Estimating latent positions in a 1D torus from noisy pairwise affinities.
method Introduced an estimation procedure with provable localization error of O(log(n)/n)O(\sqrt{\log(n)/n}).
result The estimation procedure provably localizes latent positions with a maximum error of O(log(n)/n)O(\sqrt{\log(n)/n}).

The paper develops a method to estimate consumer preferences from observed rankings.

problem Estimating consumer preferences from partial ranking information.
method Interpreting observed rankings as pairwise comparisons, modeling latent utility, and correcting for selection bias.
result The method improves recommendation performance, especially for previously unconsumed products.

We present a global optimization algorithm for clustering data given the ratio of likelihoods that each pair of data points is in the same cluster or in different clusters. To define a clustering solution in terms of pairwise relationships, a necessary and sufficient condition is that belonging to the same cluster sati…

2015-06-09abs ↗pdf ↗

This paper optimizes the number of comparisons needed to find the best k items from pairwise comparisons.

problem Finding the best k items from pairwise comparisons with limited comparisons.
method Developed algorithms for finding probably approximately correct and exact best k items under stochastic conditions.
result Upper and lower bounds on the number of comparisons for finding the best k items, with matching upper bounds for PAC best k items.

If L_1 and L_2 are two Brunnian links with all pairwise linking numbers 0, then we show that L_1 and L_2 are equivalent if and only if they have homeomorphic complements. In particular, this holds for all Brunnian links with at least three components. If L_1 is a Brunnian link with all pairwise linking numbers 0, and t…

1999-12-01abs ↗pdf ↗

The paper studies ranking algorithms from pairwise and listwise comparisons, deriving lower bounds and optimal algorithms.

problem Designing efficient ranking algorithms from pairwise and listwise comparisons.
method Deriving lower bounds and proposing optimal algorithms for top-k and total ranking problems.
result The proposed algorithms match the derived lower bounds and are optimal up to a logarithmic factor.

Optimizes identifying top-k items from comparisons with minimal comparisons.

problem Finding the top-k items from pairwise comparisons with a fixed error rate.
method Developed an asymptotically optimal algorithm using primal-dual procedure and adaptive comparison allocation.
result Proves the algorithm is asymptotically optimal for top-k identification.

New estimators show consistent estimation is possible with randomized item assignment.

problem Estimating underlying comparison probabilities from noisy pairwise comparisons.
method Study permutation-based models under strong stochastic transitivity, randomized item assignment.
result Rates of estimators are optimal for a large class of graphs.

Proposes a new method to improve multiclass probability calibration.

problem Uncalibrated class probabilities in multiclass classifiers leading to over-confidence.
method Dirichlet calibration method applicable to any model class, derived from Dirichlet distributions.
result Improved probabilistic predictions across various datasets and classifiers.