Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

77154230307 · Jun 202019922001200920172026
48 results for regression comparison

Rank regression from pairwise comparisons requires many comparisons to accurately learn model parameters.

problem Learning model parameters for rank regression from noisy pairwise comparisons.
method Uniform random pairwise comparisons to estimate model parameters with a given accuracy.
result Learning model parameters requires a number of comparisons proportional to dNlog3N/ε2dN\log^3 N/ε^2.

This work analyzes Fréchet regression using comparison geometry, providing theoretical and practical insights.

problem Analyzing data on complex structures like manifolds and graphs.
method Theoretical analysis through comparison geometry, focusing on existence, uniqueness, and stability of the Fréchet mean.
result Key results on the existence, uniqueness, and stability of the Fréchet mean, along with statistical guarantees for nonparametric regression.

We simplify complex regression coefficients using linearization and feature comparison.

problem Interpreting high-dimensional regression coefficients from nonlinear responses.
method Developed a linearization method to derive feature coefficients and compare them with regression coefficients.
result Shows how regression coefficients relate to linearized feature coefficients and how they change under regularization.

Uncoupled regression is the problem to learn a model from unlabeled data and the set of target values while the correspondence between them is unknown. Such a situation arises in predicting anonymized targets that involve sensitive information, e.g., one's annual income. Since existing methods for uncoupled regression …

2019-05-31abs ↗pdf ↗

New tests compare regression functions using machine learning, overcoming dimensionality issues.

problem Comparing regression functions in high-dimensional settings.
method Generalized kernel-based conditional mean dependence, machine learning methods for flexible estimation.
result Established asymptotic properties of tests under fixed and high-dimensional regimes.

GD outperforms ridge regression and SGD in linear regression problems.

problem Comparing the risks of GD, ridge regression, and SGD in linear regression problems.
method Instance-wise finite-sample risk analysis of GD, ridge regression, and SGD.
result GD outperforms ridge regression and is incomparable with SGD in some cases.

Transformer learns to estimate negative binomial parameters efficiently.

problem Parameter estimation for over-dispersed count data in large screens.
method Pre-trained transformer trained on synthetic data generation to invert parameter to count transformation.
result Method of moments provides faster, more efficient, and better-calibrated estimates.

We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then performs an ordinary (un-regularized) least squares regression in this subspace. This note shows that …

2011-05-04abs ↗pdf ↗

The paper extends multiple instance learning to multiclass and regression problems.

problem Learning from aggregate observations where supervision is given to sets of instances.
method Probabilistic framework for various aggregate observations, including classification and regression.
result The proposed estimator has nice convergence properties under mild assumptions.

Enhances Bayesian model comparison with a probabilistic framework for meta-uncertainty.

problem Uncertainty in posterior model probabilities (PMPs) when derived from finite data.
method Develops a fully probabilistic approach to quantify and represent meta-uncertainty over PMPs.
result Demonstrates utility in various BMC contexts, including regression, MCMC, and neural networks.

Change detection in heterogeneous multitemporal satellite images is an emerging and challenging topic in remote sensing. In particular, one of the main challenges is to tackle the problem in an unsupervised manner. In this paper we propose an unsupervised framework for bitemporal heterogeneous change detection based on…

2019-09-07abs ↗pdf ↗

New metrics improve regression evaluation across different data distributions.

problem Difficulty in comparing regression evaluations across datasets with varying distributions.
method Modification of regression metrics by weighting with the inverse distribution of function values or samples using a Gaussian kernel density estimator.
result New metrics are less sensitive to changing distributions, especially when correcting by the marginal distribution in XX.

Paper compares different models for time-to-event analysis.

problem Comparing models for time-to-event analysis.
method Experimental comparison of semi-parametric, parametric, and machine learning models.
result Models' performance evaluated using concordance index.

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors that describe the observed units as well as the available choice alternatives. T…

2013-09-30abs ↗pdf ↗

Batch Active Learning uses derivative information for Gaussian Process regression.

problem Efficiently selecting data batches in Gaussian Process regression models.
method Proposes using the predictive covariance matrix to select data batches, exploiting full correlation.
result Demonstrates the effectiveness of incorporating derivative information across diverse applications.

New TSER algorithms outperform existing methods in time series extrinsic regression.

problem Improving time series extrinsic regression models.
method Extended TSER archive, introduced two new algorithms (FreshPRINCE and DrCIF), compared with rotation forest.
result DrCIF and FreshPRINCE models significantly outperform existing methods.

This paper presents a detailed comparison of a recently proposed algorithm for optimizing decision trees, tree alternating optimization (TAO), with other popular, established algorithms. We compare their performance on a number of classification and regression datasets of various complexity, different size and dimensio…

2019-11-08abs ↗pdf ↗

Assume we are given a set of items from a general metric space, but we neither have access to the representation of the data nor to the distances between data points. Instead, suppose that we can actively choose a triplet of items (A,B,C) and ask an oracle whether item A is closer to item B or to item C. In this paper,…

2018-06-18abs ↗pdf ↗

Reduced-rank method improves least-squares regression under output regularity.

problem Least-squares regression with infinite dimensional outputs.
method Reduced-rank method for solving least-squares problems with output regularity assumptions.
result Learning bounds and improved statistical performance compared to full-rank method.

We introduce a novel boosting algorithm called `KTBoost' which combines kernel boosting and tree boosting. In each boosting iteration, the algorithm adds either a regression tree or reproducing kernel Hilbert space (RKHS) regression function to the ensemble of base learners. Intuitively, the idea is that discontinuous …

2019-02-11abs ↗pdf ↗

A visualization aids in comparing regression models by highlighting errors and correlations.

problem Comparing regression models is difficult due to varying hyper-parameters and metrics.
method Introduces a novel visualization approach using 2D residual space, Mahalanobis distance, and colormaps.
result Enhanced understanding of regression model performance differences and error distributions.

Bayesian method corrects for model selection multiplicity in regression.

problem Model selection multiplicity in regression analysis.
method Developed a Bayesian prior distribution based on Holm procedure analogy.
result Adequate multiplicity correction requires sparsity not provided by recommended priors.

FineMorphs models smooth transformations for multivariate regression.

problem Efficiently modeling complex transformations for multivariate regression.
method Optimal control of affine and diffeomorphic transformations using smooth vector fields.
result FineMorphs can reduce dimensionality and adapt to large datasets.

Proposes a new selective regression method using conformal prediction.

problem The need for models to abstain from predictions in cases of uncertainty.
method Leverages conformal prediction to provide grounded confidence measures for individual predictions based on model-specific biases.
result Demonstrates an advantage over state-of-the-art baselines in selective regression.

The Canonical Regression Quantile method predicts CEO compensation and future performance.

problem Determining fair CEO compensation and its impact on company performance.
method Canonical Regression Quantile method to assess CEO pay and performance.
result The method can predict future CEO performance and distinguish over/underpaid CEOs.

New similarity measure for covariate shift improves nonparametric regression rates.

problem Improving nonparametric regression under covariate shift.
method Introducing a new similarity measure based on probability ratios.
result Shows a sharper rate of convergence compared to transfer exponent.

DSPPs improve predictive distributions in scalable regression tasks.

problem Improving predictive distributions in scalable regression tasks.
method Inspired by DGPs, DSPPs use mini-batch training and kernel basis functions for uncertainty control.
result DSPPs provide significantly better calibrated predictive distributions than other methods.

Paper introduces a new method to improve learning on imbalanced regression problems.

problem Imbalanced distribution learning in predictive modeling reduces standard algorithms' performance.
method The paper proposes a novel method using disentangled VAEs and Smoothed Bootstrap in the latent space.
result The method improves learning on tabular data within the Imbalanced Regression framework.

A new family of penalty functions, adaptive to likelihood, is introduced for model selection in general regression models. It arises naturally through assuming certain types of prior distribution on the regression parameters. To study stability properties of the penalized maximum likelihood estimator, two types of asym…

2013-08-23abs ↗pdf ↗

Paper explores connections between loss functions and consistency in binary classification and regression.

problem Consistency in binary classification and regression applications.
method Characterization of conformable loss functions and derivation of a new Huber-type loss function.
result Margin-based loss functions are equivalent to loss functions of squared standardized logistic regression residuals.

Bayesian meta learning improves uncertainty quantification in regression.

problem Trusting uncertainty quantification in Bayesian regression.
method Trust-Bayes framework for Bayesian meta learning, optimizing for trustworthy uncertainty quantification.
result Lower bounds and sample complexity for trustworthy uncertainty quantification are characterized.