Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3.8%7.6%11.4%15.3% · Mar 202619922001200920172026
48 results for finite-sample risk

The paper studies how more data affects prediction risk in high-dimensional models.

problem The impact of increasing data on prediction risk in high-dimensional models.
method Derives central limit theorem and provides finite-sample distribution and confidence interval for prediction risk.
result Demonstrates 'more data hurt' phenomenon in high-dimensional least squares estimation.

In risk management, tail risks are of crucial importance. The assessment of risks should be carried out in accordance with the regulatory authority's requirement at high quantiles. In general, the underlying distribution function is unknown, the database is sparse, and therefore special tail models are used. Very often…

2019-04-27abs ↗pdf ↗

Method controls treatment risk in learning beneficial allocations.

problem Learning beneficial treatment allocations with risk control in precision medicine.
method Proposes a certifiable learning method that controls treatment risk with finite samples in the partially identified setting.
result Illustrates method using both simulated and real data.

Study shows interpolating predictor's risk is optimal in low-dimensional factor regression models.

problem Understanding the risk of interpolating predictors in high-dimensional factor regression models.
method Detailed finite-sample analysis of minimum-norm interpolating predictor's risk in factor regression models.
result The risk of the minimum-norm interpolating predictor approaches optimal benchmarks in low-dimensional factor regression models.

Study non-monotonic loss functions in CRC, achieving valid risk control with large calibration samples.

problem Non-monotonic loss functions in CRC, violating existing theory's monotonicity assumption.
method Finite grid selection, calibration sample size analysis, Lipschitz continuity, monotonicity, distribution shift.
result Valid CRC achieved with large calibration samples, optimal excess risk rate of log(m)/n\sqrt{\log(m)/n}.

We formalize AURC and develop estimators for SC systems.

problem Evaluation of SC systems' performance.
method Formal statistical formulation, Monte Carlo methods, plug-in estimators.
result Plug-in estimators are consistent, with low bias and bounded MSE.

This work analyzes IRM and ERM from sample complexity perspective, revealing different behaviors under various distribution shifts.

problem Choosing between IRM and ERM for OOD generalization.
method Sample complexity analysis comparing IRM and ERM under different data generation mechanisms.
result IRM is preferred over ERM for certain distribution shifts, leading to better OOD generalization.

This paper approaches the definition and properties of dynamic convex risk measures through the notion of a family of concave valuation operators satisfying certain simple and credible axioms. Exploring these in the simplest context of a finite time set and finite sample space, we find natural risk-transfer and time-co…

2007-09-03abs ↗pdf ↗

New framework calibrates decision robustness using inverse conformal risk control.

problem Inadequate robustness levels in decision-making due to ad hoc choices.
method Constructs valid estimators to trace miscoverage-regret Pareto frontier.
result Provides distribution-free, finite-sample guarantees on robustness levels.

This study analyzes prediction risk for PCR method in latent factor regression models.

problem Prediction risk analysis in latent factor regression models.
method Adaptive PCR method with risk bounds established under factor regression model.
result Unified framework for analyzing various linear prediction methods under factor regression.

GD outperforms ridge regression and SGD in linear regression problems.

problem Comparing the risks of GD, ridge regression, and SGD in linear regression problems.
method Instance-wise finite-sample risk analysis of GD, ridge regression, and SGD.
result GD outperforms ridge regression and is incomparable with SGD in some cases.

Novel AMP framework for multi-environment transfer learning.

problem Characterizing risk of Lasso-based transfer learning estimators.
method Multi-Environment Generalized Long AMP (multi-environment GLAMP) framework.
result Precise characterization of the risk of three Lasso-based transfer learning estimators.

The paper analyzes risk estimation methods and derives bounds for OCE risk.

problem Estimating the Optimized Certainty Equivalent (OCE) risk from samples.
method Derives mean-squared error and concentration bounds for SAA of OCE, and analyzes an efficient stochastic approximation-based estimator.
result Finite sample bounds and mis-identification probability bounds for the efficient estimator.

Robo-advisors estimate clients' risk aversion using interactive questionnaires.

problem Estimating risk aversion of non-expert clients using adaptive questionnaires.
method Model risk aversion with cost functions and spectral risk measures. Use inverse reinforcement learning to design questions maximizing distinguishing power.
result Designing questions by maximizing distinguishing power achieves satisfactory accuracy in learning risk aversion with fewer than 50 questions.

New method identifies parameters of wider shallow neural networks with biases.

problem Identifying parameters of wide shallow neural networks with biases from finite samples.
method Two-step pipeline: direction of weights via second order information, signs via algebraic evaluations, biases via gradient descent.
result Constructive methods and theoretical guarantees of finite sample identification for wider shallow networks with biases.

A machine learning model manages portfolio risk in high dimensions.

problem Managing risk in high-dimensional financial portfolios.
method A supervised learning approach using replicating martingales and polynomial/neural network bases.
result The model outperforms naive Monte Carlo and least-squares Monte Carlo methods.

We introduce new forecast encompassing tests for the risk measure Expected Shortfall (ES). The ES currently receives much attention through its introduction into the Basel III Accords, which stipulate its use as the primary market risk measure for the international banking regulation. We utilize joint loss functions fo…

2019-08-13abs ↗pdf ↗

The paper analyzes LOCV for high-dimensional risk estimation, proving error bounds.

problem Estimating out-of-sample prediction error in high-dimensional settings.
method Theoretical analysis of leave-one-out cross validation (LOCV) in penalized regression.
result Finite sample upper bounds on LOCV error, showing it converges to zero as n,p → ∞.

We derive PAC-Bayesian learning guarantees for heavy-tailed losses, and obtain a novel optimal Gibbs posterior which enjoys finite-sample excess risk bounds at logarithmic confidence. Our core technique itself makes use of PAC-Bayesian inequalities in order to derive a robust risk estimator, which by design is easy to …

2019-05-20abs ↗pdf ↗

Study improves understanding of non-differentiable penalties in high-dimensional settings.

problem Theoretical understanding of non-differentiable penalties like generalized LASSO and nuclear norm in high-dimensional settings.
method Proportional high-dimensional regime analysis with finite sample upper bounds on expected squared error.
result LO provides accurate estimation of out-of-sample risk in high-dimensional settings.

Split conformal prediction provides finite-sample guarantees for black-box models without distributional assumptions.

problem Weak performance guarantees for modern predictive models under minimal assumptions.
method Develops finite-sample guarantees for split conformal prediction, a method that uses nested prediction sets and order statistics.
result The coverage of prediction sets based on order statistics stochastically dominates the Beta distribution.

We study the task of learning from non-i.i.d. data. In particular, we aim at learning predictors that minimize the conditional risk for a stochastic process, i.e. the expected loss of the predictor on the next point conditioned on the set of training samples observed so far. For non-i.i.d. data, the training set contai…

2015-10-09abs ↗pdf ↗

This paper improves risk control for financial markets by calibrating VaR forecasts using conformal methods.

problem Nonstationary and regime-dependent losses in financial markets.
method Regime-weighted conformal risk control (RWC) for VaR forecasting.
result RWC improves regime-conditional stability in some settings with modest conservativeness changes.

We propose a new active learning algorithm for parametric linear regression with random design. We provide finite sample convergence guarantees for general distributions in the misspecified model. This is the first active learner for this setting that provably can improve over passive learning. Unlike other learning se…

2014-10-22abs ↗pdf ↗

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach builds off of techniques for distributionally robust optimization and Owen's empiric…

2016-10-08abs ↗pdf ↗

Unified framework for fair classification with group-blindness/awareness guarantees.

problem Challenges in enforcing fairness and group-blindness in binary classification.
method Unified framework based on post-processing procedure, applicable to various group fairness notions.
result Minimax rate-optimality of the proposed algorithm with controlled excess risk.

New framework calibrates models to control risk under performativity.

problem Calibrating models to ensure reliable decision-making under performativity.
method Iteratively refined calibration process for different risk measures and tail bounds.
result Statistically rigorous risk control under performativity demonstrated.

We enhance conformal prediction for risk-averse decisions with action-conditional guarantees.

problem Uncertainty quantification and safety guarantees for machine learning decisions.
method Action-conditional conformal prediction, pinball-loss minimization.
result Action-conditional prediction sets optimize risk-averse decision-making.

Framework calibrates ML models for risk control in various tasks.

problem Achieving statistical guarantees for model predictions.
method Reframing risk control as multiple hypothesis testing, applying statistical techniques.
result New calibration methods for multi-label classification, instance segmentation, outlier detection, and confidence set coverage.

Optimal decision-making using prediction sets to minimize risk.

problem Using prediction sets optimally for decision-making in uncertain scenarios.
method Decision-theoretic framework that seeks to minimize expected loss against a worst-case distribution.
result ROCP algorithm reduces critical mistakes compared to baselines, especially in costly out-of-set errors.