Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

118236353471 · Jun 202019922001200920172026
48 results for Empirical Comparison

Comparison data arises in many important contexts, e.g. shopping, web clicks, or sports competitions. Typically we are given a dataset of comparisons and wish to train a model to make predictions about the outcome of unseen comparisons. In many cases available datasets have relatively few comparisons (e.g. there are on…

2018-07-24abs ↗pdf ↗

The paper examines how optimizer comparisons in deep learning are influenced by hyperparameter tuning.

problem The sensitivity of optimizer comparisons to hyperparameter tuning protocols.
method Empirical comparisons of optimizers with and without varying hyperparameter search spaces.
result Inclusion relationships between optimizers matter in practice and can contradict recent empirical comparisons.

Paper tackles clustering with ordinal comparisons, achieving near-optimal results.

problem Clustering with ordinal comparisons when similarity measures are not available.
method Two-step procedure: estimate similarity matrix from comparisons, then apply SDP clustering.
result Near-optimal recovery of planted clustering using near-optimal number of comparisons.

We performed an empirical comparison of ICA and PCA algorithms by applying them on two simulated noisy time series with varying distribution parameters and level of noise. In general, ICA shows better results than PCA because it takes into account higher moments of data distribution. On the other hand, PCA remains quit…

2017-09-29abs ↗pdf ↗

Study metric learning from limited preference comparisons, showing how low-dimensional structure can still reveal metric information.

problem Learning metric from limited pairwise preference comparisons.
method Ideal point model, divide-and-conquer approach for low-dimensional structure.
result Metric can be jointly identified even with limited comparisons when items exhibit low-dimensional structure.

We address the classical problem of hierarchical clustering, but in a framework where one does not have access to a representation of the objects or their pairwise similarities. Instead, we assume that only a set of comparisons between objects is available, that is, statements of the form "objects ii and jj are more …

2018-11-02abs ↗pdf ↗

Study on deep neural networks for reward modeling with pairwise comparison data.

problem Reward modeling with deep neural networks in non-parametric settings.
method Established a non-asymptotic regret bound for deep reward estimators, introduced a margin-type condition.
result Improved regret bound for deep reward estimators, highlighting the importance of clear human beliefs.

We consider the problem of classification in a comparison-based setting: given a set of objects, we only have access to triplet comparisons of the form "object xix_i is closer to object xjx_j than to object xkx_k." In this paper we introduce TripletBoost, a new method that can learn a classifier just from such triplet …

2018-10-31abs ↗pdf ↗

Paper tackles noisy comparison oracle for robust clustering algorithms.

problem Finding robust clustering algorithms under noisy comparison oracle.
method Develops algorithms for k-center clustering and agglomerative hierarchical clustering using noisy comparison oracle.
result Proves robust algorithms achieve good approximation guarantees with high probability.

Develops a statistical framework to measure uncertainty in model rankings based on human preferences.

problem Uncertainty in model rankings based on human preferences due to mismatch between human and model preferences.
method Statistical framework using pairwise comparisons by humans and models to provide rank-sets for each model.
result Rank-sets constructed using only pairwise comparisons by strong models often do not cover the true ranking of human preferences.

This work analyzes Fréchet regression using comparison geometry, providing theoretical and practical insights.

problem Analyzing data on complex structures like manifolds and graphs.
method Theoretical analysis through comparison geometry, focusing on existence, uniqueness, and stability of the Fréchet mean.
result Key results on the existence, uniqueness, and stability of the Fréchet mean, along with statistical guarantees for nonparametric regression.

The paper introduces uncertainty estimates for embedding objects based on noisy triplet comparisons.

problem Learning from ordinal data without a distance metric.
method Bootstrap and Bayesian approaches to estimate uncertainty for embedding algorithms.
result Empirical uncertainty estimates are well-calibrated and useful for selecting parameters or quantifying uncertainty.

A new method learns from pairwise comparisons to predict sensitive data without making strong assumptions.

problem Predicting sensitive data like annual income from unlabeled data with unknown target correspondence.
method Utilizes pairwise comparison data to learn a regression model without strong assumptions.
result The learned model converges to optimal with optimal parametric rate for uniformly distributed targets.

Modeling preference rankings with salient features to explain irrational choices.

problem Estimating rankings from noisy pairwise comparisons with irrational choices.
method Salient feature preference model with maximum likelihood estimation.
result Strong performance of maximum likelihood estimation on synthetic and real data.

ERM with square loss achieves sublinear error for learnable function classes with smoothed data.

problem Statistical and computational hardness in sequential decision-making.
method Empirical Risk Minimization (ERM) with square loss, focusing on unknown base measure and smooth data.
result ERM achieves error scaling as ildeO(comp(F)T) ilde O( \sqrt{\mathrm{comp}(\mathcal F)\cdot T} ) for learnable function classes.

Generative Adversarial Networks create realistic financial correlation matrices.

problem Creating realistic financial correlation matrices for practical applications.
method Generative Adversarial Networks (GANs) to model correlation matrices.
result GANs can recover known stylized facts about empirical correlation matrices.

This paper compares FAISS and FENSHSES for nearest neighbor search in Hamming space.

problem Comparing nearest neighbor search systems in Hamming space.
method Comprehensive evaluations of indexing speed, search latency, and RAM consumption.
result Better understanding of trade-offs between main memory and secondary memory systems.

We study the KK-armed dueling bandit problem, a variation of the standard stochastic bandit problem where the feedback is limited to relative comparisons of a pair of arms. We introduce a tight asymptotic regret lower bound that is based on the information divergence. An algorithm that is inspired by the Deterministic…

2015-06-08abs ↗pdf ↗

New oracle uses uncertainty for active classification with noisy feedback.

problem Improving query complexity in interactive binary classifier learning.
method Proposes a new pairwise comparison oracle that considers uncertainty and an adaptive labeling algorithm.
result Demonstrates improved performance and efficiency compared to existing methods.

New algorithm learns human preferences from few comparisons efficiently.

problem Learning human preferences from limited comparison feedback.
method Formulated as D-optimal design for Plackett-Luce model, solved using randomized Frank-Wolfe algorithm.
result Proposed algorithm efficiently solves D-optimal design problem for Plackett-Luce objective.

The paper designs tests for comparing ranked preference data and finds significant differences.

problem Comparing pairwise comparison and ranking data in various applications.
method Developed two-sample tests for pairwise comparison and ranking data, proving upper and lower bounds.
result Upper and lower bounds show tightness of the proposed tests, and significant differences in preferences were found.

Paper introduces an efficient comparison operator for robust multi-objective optimization with uncertain objectives.

problem Optimizing with uncertain objectives in multi-objective problems.
method Empirical approach to compare solutions with arbitrary distributions of uncertain objectives.
result Higher optimization quality achieved at lower overheads compared to existing techniques.

We study the dependence structure of market states by estimating empirical pairwise copulas of daily stock returns. We consider both original returns, which exhibit time-varying trends and volatilities, as well as locally normalized ones, where the non-stationarity has been removed. The empirical pairwise copula for ea…

2015-03-31abs ↗pdf ↗

Bispectral OT improves dataset comparison by preserving intrinsic coherence.

problem Ignoring intrinsic coherence in dataset comparisons using pairwise geometric distances.
method Introduces Bispectral Optimal Transport, a symmetry-aware extension of discrete OT.
result Transport plans computed with Bispectral OT achieve greater class preservation accuracy.

Extends covariance estimation with multiple targets for better performance.

problem Improving covariance estimation for multiple targets.
method Combines multiple constant matrices with sample covariance matrix, derives estimators and proves convergence.
result The multi-target linear shrinkage estimator outperforms other estimators in various situations.

This paper extends Median-of-Means to new learning problems involving pairwise comparisons.

problem Learning from pairwise comparisons in machine learning.
method Segmenting data into blocks, comparing pairs of decision rules, and declaring the winner based on majority performance.
result The Median-of-Means approach maintains robustness and performance under various sampling schemes.

We review statistical properties of models generated by the application of a (positive and negative order) fractional derivative operator to a standard random walk and show that the resulting stochastic walks display slowly-decaying autocorrelation functions. The relation between these correlated walks and the well-kno…

2008-06-19abs ↗pdf ↗

Box Thirding identifies the best arm efficiently under limited samples.

problem Efficiently identifying the best arm with limited sampling.
method Iterative ternary comparison of arms, discarding the weakest and exploring the best.
result Achieves comparable performance to Successive Halving with less predefined parameters.

Two methods for quantile regression are compared and found to produce tighter intervals.

problem Comparing methods for producing prediction intervals in quantile regression.
method Two recently proposed methods combining conformal inference and quantile regression.
result Romano et al.'s method typically yields tighter prediction intervals in finite samples.