Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

0.4%0.8%1.3%1.7% · Jul 200019922001200920172026
48 results for hold-out

This paper improves neural network predictions with early stopping using conformal calibration.

problem Lack of precise statistical guarantees for neural networks trained with early stopping.
method Conformalized early stopping that combines early stopping with conformal calibration.
result Models provide both accuracy and precise inferences without additional data splits.

One significant challenge to scaling entity resolution algorithms to massive datasets is understanding how performance changes after moving beyond the realm of small, manually labeled reference datasets. Unlike traditional machine learning tasks, when an entity resolution algorithm performs well on small hold-out datas…

2015-09-10abs ↗pdf ↗

The paper validates a method for recovering over-parameterized matrices and images from noisy measurements.

problem Recovering a low-rank matrix from noisy measurements when the rank is unknown.
method Using gradient descent with small random initialization on a nonconvex objective function built from a rank-overspecified factored representation of the matrix variable.
result Gradient descent iterations converge to the ground-truth matrix under certain conditions and can be stopped efficiently to detect a nearly optimal estimator.

This paper is a comment on the survey paper by Biau and Scornet (2016) about random forests. We focus on the problem of quantifying the impact of each ingredient of random forests on their performance. We show that such a quantification is possible for a simple pure forest , leading to conclusions that could apply more…

2016-04-06abs ↗pdf ↗

Analyzing a comprehensive news dataset, we document that joint news coverage triggers attention contagion, causing temporarily inflated valuations for affected stocks. Tracing SEC EDGAR visits from unique IPs, we provide direct evidence of attention spillovers between stocks. Stocks with greater joint news coverage exh…

2017-03-08abs ↗pdf ↗

In this article, we derive concentration inequalities for the cross-validation estimate of the generalization error for subagged estimators, both for classification and regressor. General loss functions and class of predictors with both finite and infinite VC-dimension are considered. We slightly generalize the formali…

2010-11-23abs ↗pdf ↗

The paper optimizes hyperplanes for binary classification in high-dimensional data with latent Gaussian mixtures.

problem Binary classification in high-dimensional data with latent Gaussian mixtures.
method Generalized least squares estimator for estimating the direction of the optimal separating hyperplane. Simple correction for intercept estimation.
result The procedure is minimax optimal in many scenarios and can retain the interpolation property.

Adaptive classification methods ensure correct prediction intervals.

problem Developing methods to ensure correct prediction intervals for classification problems.
method Specialized conformal inference techniques combining cross-validation+, jackknife+, and a novel conformity score.
result The methods provide guaranteed approximate conditional coverage for complex data distributions.

We address the problem of {\it adaptivity} in the framework of reproducing kernel Hilbert space (RKHS) regression. More precisely, we analyze estimators arising from a linear regularization scheme $g_\lam$. In practical applications, an important task is to choose the regularization parameter $\lam$ appropriately, i.e.…

2018-04-15abs ↗pdf ↗

The article presents methods to select models from behavioral learning data, with applications to contextual bandits.

problem Model selection for behavioral learning data, especially in non-stationary environments.
method Two model selection methods: a general hold-out procedure and an AIC-type criterion, adapted for non-stationary dependent data.
result Theoretical error bounds for these methods are close to those of the standard i.i.d. case.

In this paper we establish a one-to-one correspondence between S1S^1-gerbes with connections, on the one hand, and their holonomies, for simply connected manifolds, or their parallel transports, in the general case, on the other hand. This result is a higher-order analogue of the familiar equivalence between bundles wi…

2000-07-10abs ↗pdf ↗

New algorithm reduces dimensionality in federated learning.

problem Estimating central dimension reduction subspace and variable selection in federated learning.
method Federated sparse sliced inverse regression, convex optimization, linearized alternating direction method of multipliers.
result Upper bound of statistical error rate established under heterogeneous setting.

A new approach combines prior knowledge with learning to adapt quickly to new tasks.

problem Adapting quickly to new tasks using prior knowledge.
method Combines behavior prior, robust off-policy learning, and value function representation.
result Achieves competitive adaptation performance compared to meta reinforcement learning baselines.

The study sets lower bounds on MMSE for inferring sensitive features from noisy data.

problem Estimating sensitive features from noisy observations of correlated features.
method Adversarial evaluation framework based on MMSE estimation with theoretical lower bounds.
result Derives closed-form bounds for linear models, showing optimality in noise variance.

Paper introduces Modular Jets for diagnosing model decompositions in pipelines.

problem Evaluating model decompositions in pipelines for unique identification.
method Estimates empirical jets from module-level representations to diagnose mirage vs identifiable decompositions.
result Proves jet-identifiability theorem for two-module linear regression pipelines.

Stabilizes online learning by using weighted reservoir sampling.

problem Real-world deployment sensitivity to outliers causes low accuracy in final solutions.
method Weighted reservoir sampling to stabilize ensemble model without additional data passes.
result Risk of ensemble classifier is bounded with respect to the underlying online learning method's regret.

Paper presents a novel gradient-based method for training models and hyperparameters simultaneously.

problem Achieving generalization in machine learning models.
method A novel gradient-based framework that trains parameters and hyperparameters simultaneously.
result Significantly smaller runtime compared to benchmark methods for equivalent prediction scores.

Paper introduces a novel approach to generalize models without validation data.

problem Achieving generalization in machine learning without validation data.
method Introduces a new risk measure and a novel criterion for training models.
result Demonstrates that the new approach outperforms popular methods in generalization and estimation tasks.

A method for non-parametric conditional distribution estimation using CRPS-optimal binning.

problem Non-parametric conditional distribution estimation.
method Partitioning covariate-sorted observations into bins to minimize LOO-CRPS, selecting K by K-fold cross-validation of test CRPS.
result Produces narrower prediction intervals with near-nominal coverage compared to split-conformal competitors.

A new method using negative-shifted gradient descent improves overparameterized linear regression by avoiding structural limitations of negative ridge endpoints.

problem Structural limitations of negative ridge endpoints in overparameterized linear regression.
method Negative-shifted gradient descent, which avoids the pole constraint of negative ridge endpoints.
result The method improves over all admissible endpoints by a polynomial factor in risk under explicit conditions.

Paper presents new training methods for neural networks with tighter risk certificates.

problem Training probabilistic neural networks with tighter risk certificates.
method Derived from PAC-Bayes bounds, two training objectives implemented for the first time in neural networks.
result Competitive test set errors and non-vacuous risk bounds with tighter values than previous results.

Proposes a new framework for evaluating diagnostic models with multiple co-primary endpoints.

problem Overoptimistic assessments of predictive performance in automated medical testing devices.
method Multiple testing framework for diagnostic accuracy studies with co-primary endpoints, using a parametric simultaneous test procedure and Bayesian approach to determine optimal number of models.
result Our approach leads to a better final diagnostic model and increased statistical power.

Develops an algorithm to approximate non-Gaussian posterior distributions in Bayesian inference.

problem Sampling non-Gaussian posterior distributions in Bayesian inverse problems.
method Iterative construction of Gaussian Process (GP) augmented proposal distributions for MCMC sampling.
result Optimal selection of sampling points using maximum information gain from GP surface.

New deep learning model estimates scattering timescale of FRBs efficiently.

problem Estimating scattering timescale of fast radio bursts (FRBs) is a bottleneck.
method Multimodal Transformer Based Generic Mixture Density Network (MT-GMDN) that ingests dynamic spectrum and timeseries profile.
result Achieves 94% R2R^2 on expected value of ττ for measurable scattering.

Incremental machine learning models predict COVID-19 cases more efficiently than traditional methods.

problem Predicting the spread of COVID-19 cases in real-time across multiple countries.
method Comparison of online incremental machine learning algorithms against traditional LSTM models.
result Incremental machine learning models are more efficient and computationally cheaper than traditional methods.