Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3066129171,223 · Jun 202019922001200920172026
48 results for method comparison

New proposed models are often compared to state-of-the-art using statistical significance testing. Literature is scarce for classifier comparison using metrics other than accuracy. We present a survey of statistical methods that can be used for classifier comparison using precision, accounting for inter-precision corre…

2016-09-29abs ↗pdf ↗

Comparison data arises in many important contexts, e.g. shopping, web clicks, or sports competitions. Typically we are given a dataset of comparisons and wish to train a model to make predictions about the outcome of unseen comparisons. In many cases available datasets have relatively few comparisons (e.g. there are on…

2018-07-24abs ↗pdf ↗

Paper tackles clustering with ordinal comparisons, achieving near-optimal results.

problem Clustering with ordinal comparisons when similarity measures are not available.
method Two-step procedure: estimate similarity matrix from comparisons, then apply SDP clustering.
result Near-optimal recovery of planted clustering using near-optimal number of comparisons.

Develops comparison methods for semilinear elliptic problems on Riemannian manifolds with Ricci lower bound.

problem Analyzing positive solutions of semilinear Dirichlet problems on Riemannian manifolds with Ricci lower bound.
method Sharp pointwise gradient comparison method, derived from admissibility and structural conditions on f.
result Explicit isoperimetric-type inequality and quantitative hot-spot localization estimate.

In a context where most published articles are devoted to the development of "new methods", comparison studies are generally appreciated by readers but surprisingly given poor consideration by many scientific journals. In connection with recent articles on over-optimism and epistemology published in Bioinformatics, thi…

2012-08-13abs ↗pdf ↗

Learning from triplet comparison data has been extensively studied in the context of metric learning, where we want to learn a distance metric between two instances, and ordinal embedding, where we want to learn an embedding in an Euclidean space of the given instances that preserves the comparison order as well as pos…

2019-07-24abs ↗pdf ↗

This paper compares and evaluates methods for evaluating statistical models using benchmarking data and simulations.

problem Choosing between benchmarking data sets and simulation studies for method comparison studies.
method Borrowing ideas from mixed methods research and Clinical Scenario Evaluation, the paper investigates and develops new approaches to evaluate methods.
result Develops new approaches to evaluate methods by combining the strengths of benchmarking data sets and simulation studies.

Active sampling algorithm improves accuracy of inferred scores from pairwise comparisons.

problem Inference of accurate scores from time-consuming pairwise comparisons.
method Approximate message passing and expected information gain maximization.
result ASAP offers the highest accuracy of inferred scores compared to existing methods.

Existing ordinal embedding methods usually follow a two-stage routine: outlier detection is first employed to pick out the inconsistent comparisons; then an embedding is learned from the clean data. However, learning in a multi-stage manner is well-known to suffer from sub-optimal solutions. In this paper, we propose a…

2018-12-05abs ↗pdf ↗

This paper examines the problem of ranking a collection of objects using pairwise comparisons (rankings of two objects). In general, the ranking of nn objects can be identified by standard sorting methods using nlog2nn log_2 n pairwise comparisons. We are interested in natural situations in which relationships among the o…

2011-09-16abs ↗pdf ↗

We consider the problem of classification in a comparison-based setting: given a set of objects, we only have access to triplet comparisons of the form "object xix_i is closer to object xjx_j than to object xkx_k." In this paper we introduce TripletBoost, a new method that can learn a classifier just from such triplet …

2018-10-31abs ↗pdf ↗

We examine several recently suggested methods for the detection of long-range correlations in data series based on similar ideas as the well-established Detrended Fluctuation Analysis (DFA). In particular, we present a detailed comparison between the regular DFA and two recently suggested methods: the Centered Moving A…

2008-04-25abs ↗pdf ↗

Self-consistency improves the accuracy of model comparison methods.

problem Improving the accuracy of model comparison methods when simulation models are misspecified.
method Supplement traditional simulation-based training with a self-consistency loss on unlabeled real data.
result Self-consistency training improves model comparison accuracy, especially in open-world scenarios.

Paper tackles ranking items with a semi-random comparison graph and a monotone adversary.

problem Ranking items based on pairwise comparisons from a semi-random comparison graph with a monotone adversary.
method Developed a weighted maximum likelihood estimator (MLE) and an SDP-based approach to reweight the semi-random graph.
result Achieves near-optimal sample complexity, up to a log^2(n) factor, for identifying the top-K preferred items.

New methods resolve conflicting treatment effect estimates in health tech assessments.

problem Conflicting conclusions from different sponsors analyzing the same data.
method Arbitrated indirect treatment comparisons (ArMAIC) targeting a common target population.
result Estimates treatment effects in a common target population, resolving the MAIC paradox.

The paper develops a method to estimate consumer preferences from observed rankings.

problem Estimating consumer preferences from partial ranking information.
method Interpreting observed rankings as pairwise comparisons, modeling latent utility, and correcting for selection bias.
result The method improves recommendation performance, especially for previously unconsumed products.

New model for pairwise comparisons without stochastic transitivity.

problem Suboptimal performance of models assuming stochastic transitivity in real-world scenarios.
method Proposes a general family of statistical models using a skew-symmetric matrix.
result Achieves minimax-rate optimality and adapts to data sparsity.

Novel method for Bayesian model comparison using deep learning.

problem Comparing complex models in science with intractable likelihood functions.
method Simulation-based, purely deep learning approach that amortizes model fitting costs.
result Achieves excellent results in accuracy, calibration, and efficiency.

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so by constructing a similarity matrix from pairwise comparisons, using seriation methods to reorder t…

2014-06-20abs ↗pdf ↗

Proves curvature comparison theorem for manifolds with conical singularities.

problem Comparing scalar mean curvature of manifolds with conical singularities.
method Uses Dirac operator and index theory to prove curvature comparison theorem.
result Proves curvature comparison theorem without knowing the index of the twisted Dirac operator.

New oracle uses uncertainty for active classification with noisy feedback.

problem Improving query complexity in interactive binary classifier learning.
method Proposes a new pairwise comparison oracle that considers uncertainty and an adaptive labeling algorithm.
result Demonstrates improved performance and efficiency compared to existing methods.

Comparison of UQ methods in deep learning for a simple physical system.

problem Uncertainty quantification in deep learning for physical systems.
method Bayesian Neural Networks (BNN), Concrete Dropout (CD), Deep Ensembles (DE), and Analytic Error Propagation.
result Pitfalls in using UQ methods, especially Bayesian Neural Networks and Concrete Dropout.

The paper improves spectral ranking methods for diverse comparison graphs.

problem Estimating preference scores from multiway comparisons with heterogeneous sizes.
method Develops a two-step spectral method for estimating preference scores and their uncertainties.
result The two-step spectral method achieves the same asymptotic efficiency as the Maximum Likelihood Estimator (MLE).

Paper proposes a sequential statistical test for comparing imitation learning policies with near-optimal stopping.

problem Challenges in rigorously comparing imitation learning policies due to small sample sizes and potential p-hacking.
method Sequential statistical test that adapts the number of trials based on intermediate results, achieving near-optimal stopping.
result Reduces the number of evaluation trials by up to 32% compared to state-of-the-art baselines, saving significant time and effort.

Gene annotation has traditionally required direct comparison of DNA sequences between an unknown gene and a database of known ones using string comparison methods. However, these methods do not provide useful information when a gene does not have a close match in the database. In addition, each comparison can be costly…

2019-09-16abs ↗pdf ↗

Paper develops methods for estimating gradients of Finslerian Schrödinger equations.

problem Estimating gradients of Finslerian Schrödinger equations.
method Develops new Laplacian comparison theorem and applies it to Finslerian Schrödinger equation.
result Global and local Li-Yau type gradient estimates for positive solutions.

Uncoupled regression is the problem to learn a model from unlabeled data and the set of target values while the correspondence between them is unknown. Such a situation arises in predicting anonymized targets that involve sensitive information, e.g., one's annual income. Since existing methods for uncoupled regression …

2019-05-31abs ↗pdf ↗

In this work, we will verify some comparison results on Kahler manifolds. They are complex Hessian comparison for the distance function from a closed complex submanifold of a Kahler manifold with holomorphic bisectional curvature bounded below by a constant, eigenvalue comparison and volume comparison in terms of scala…

2010-07-09abs ↗pdf ↗

Evidence Networks simplify Bayesian model comparison for complex models.

problem Bayesian model comparison challenges with intractable likelihoods or priors.
method Loss functions and neural networks for fast, amortized estimation of Bayes factors.
result Evidence Networks provide accurate and scalable Bayes factor estimation.