Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

209417626834 · Jun 202019922001200920172026
48 results for expected prediction loss

Extends conformal prediction for controlling expected risk of monotone loss functions.

problem Controlling expected risk of monotone loss functions.
method Generalizes split conformal prediction with coverage guarantee, extending to distribution shift, quantile risk, multiple, adversarial, and expectations of U-statistics.
result Tight up to an O(1/n)\mathcal{O}(1/n) factor, with worked examples in computer vision and natural language processing.

Paper proposes a probabilistic method to handle missing data in decision trees.

problem Handling missing data in decision trees.
method At deployment time, use density estimators to compute expected predictions. At learning time, fine-tune tree parameters to minimize expected prediction loss.
result Effective compared to baselines in experiments.

Generalized algorithm for translation and scale-invariant prediction.

problem Sequential prediction with expert advice, focusing on translation and scale invariance.
method Designing a generalized online algorithm using the universal prediction perspective to compete against a generic class of expert selection strategies.
result No preliminary knowledge of loss sequences is required; performance bounds are stable under arbitrary scalings and translations.

Paper establishes a formula linking model performance to insurance loss ratio.

problem Improving model performance does not always lead to proportional improvements in loss ratio.
method Derives a closed-form formula connecting Pearson correlation to expected loss ratio.
result Model improvements have diminishing marginal returns in reducing loss ratio.

Flexible framework for bounding high-loss predictions using quantiles.

problem Need for rigorous guarantees in risk-sensitive applications.
method Order statistics of loss values, flexible quantile-based metrics.
result Ability to rigorously control loss quantiles on real-world datasets.

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce training data, overfitting is typically mitigated by adding regularization term…

2017-10-27abs ↗pdf ↗

Paper tackles regression with cost-based rejection, balancing prediction and rejection costs.

problem Regression with cost-based rejection, balancing prediction and rejection costs in a continuous target space.
method Formulated expected risk, derived Bayes optimal solution, proposed surrogate loss function.
result Bayes optimal solution can be recovered by the proposed surrogate loss function.

New risk control method for non-monotonic losses in complex parameters.

problem Controlling risk for non-monotonic losses with multidimensional parameters.
method Stability-based guarantees for generic algorithms applied to non-monotonic losses.
result Guarantees depend on algorithm stability, with looser guarantees for unstable algorithms.

SEMF predicts prediction intervals for ML models using latent variables.

problem Uncertainty quantification in ML models, especially for diverse data distributions.
method Supervised Expectation-Maximization Framework (SEMF) extending EM algorithm for latent variable modeling.
result SEMF produces narrower prediction intervals with desired coverage probability.

AEW estimator achieves optimal risk in expectation for large enough temperatures.

problem Understanding minimax-rate optimality of AEW estimator in model selection aggregation.
method Analyzing AEW estimator with exponential weights for squared loss under random design.
result AEW achieves excess risk Tlog(M)/(n+1)T \log (M) / (n+1) in expectation for large enough temperatures.

Under covariate shift, training (source) data and testing (target) data differ in input space distribution, but share the same conditional label distribution. This poses a challenging machine learning task. Robust Bias-Aware (RBA) prediction provides the conditional label distribution that is robust to the worstcase lo…

2017-12-28abs ↗pdf ↗

Enhances crypto-asset AMM with deep learning for better liquidity and efficiency.

problem Reduced slippage and improved liquidity in decentralized finance.
method Deep reinforcement learning for predicting market equilibrium and optimizing liquidity.
result Improved capital efficiency and reduced slippage for crypto-asset traders.

Optimal decision-making using prediction sets to minimize risk.

problem Using prediction sets optimally for decision-making in uncertain scenarios.
method Decision-theoretic framework that seeks to minimize expected loss against a worst-case distribution.
result ROCP algorithm reduces critical mistakes compared to baselines, especially in costly out-of-set errors.

The paper improves sparse Gaussian processes by optimizing predictive loss.

problem Optimizing predictive loss in sparse Gaussian processes.
method Direct loss minimization (DLM) for log-loss and square loss, with product sampling (uPS) and biased Monte Carlo (bMC) for non-conjugate cases.
result DLM shows significant performance improvement in both log-loss and square loss cases.

Forecastability measures predictive information across horizons.

problem How much predictive information is available at each prediction horizon?
method Develops the consequences of mutual information between future observations and information set.
result Forecastability is a profile reflecting process dependence structure, with properties like compression and truncation error.

Transformers approximate Bayesian posteriors but not exactly.

problem Bayesian accounts of in-context learning face challenges due to task-preserving order changes in transformers.
method Showed that excess prequential code length is exactly cumulative predictive KL, decomposing expected regret into order-averaged predictor and order-averaging gain.
result Transformers approximate Bayesian posteriors but not exactly, priced by log loss.

Develops a framework for consistent loss functions with variable transformations.

problem Lack of theoretical understanding of variable transformations in consistent loss functions.
method Formal characterizations of consistency for transformed loss functions in two cases: realization and prediction variables.
result Establishes new identifiable and elicitable functionals for complex predictive tasks.

Study asset pricing with reference-dependent preferences, finding matching equity premia.

problem Understanding asset pricing under reference-dependent preferences.
method Discrete-time consumption-based capital asset pricing model with reference-dependent preferences.
result Models can generate equity premia matching empirical estimates, showing procyclical price-dividend ratio and countercyclical equity premium.

New algorithm handles bandit problems under translations and scales.

problem Adversarial multi-armed bandit problems with arbitrary translations and scales.
method Innovative online algorithm invariant to translations and scales, using universal prediction.
result Second-order regret bounds, unaffected by affine transformations of losses.

A new method approximates expected empirical loss for stochastic deep learning tasks.

problem Determining optimal step sizes for stochastic gradient descent in deep learning.
method Applying one-dimensional function fitting to noisy losses of vertical cross sections to approximate expected empirical loss.
result The method leads to a robust and straightforward optimization method that performs well across datasets and architectures.

Transformer-based models overfit financial time series data, leading to increased prediction variance.

problem Forecast collapse of transformer-based models under squared loss in financial time series.
method Theoretical analysis and numerical experiments on high-frequency EUR/USD exchange rate data.
result Increased model expressivity in Transformer-based models leads to spurious fluctuations without reducing bias, resulting in higher prediction variance.

Loss-calibrated EP improves Bayesian decision-making by focusing on utility-sensitive posterior approximations.

problem Bayesian decision-making under asymmetric utility functions.
method Loss-calibrated expectation propagation (Loss-EP) that tilts the posterior towards higher utility decisions.
result Loss-EP can capture useful information for decision-making under asymmetric penalties.

Investigates methods to regularize quantile regression for accurate predictions.

problem Improving accuracy and fairness in quantile regression predictions.
method Various regularization techniques including expected pinball loss, monotonicity constraints, and rate constraints.
result Deep lattice networks can maintain non-crossing quantiles and improve calibration and fairness.

Investigates conditions for risk or utility functionals to be sensitive to large losses.

problem Conditions for risk or utility functionals to be sensitive to large losses.
method Analyzes sensitivity to large losses for various risk and utility functionals.
result Value at Risk and Expected Shortfall generally fail to be sensitive to large losses, but expected utility functionals and certain adjusted versions are sensitive.

Model predicts operational risk using HMMs with economic covariates.

problem Predicting operational risk losses with time-dependent structures and economic covariates.
method Hidden Markov Models extended to multivariate observations with an auxiliary economic variable.
result Calibration results show relevance of including economic covariates.

Study uses property elicitation to understand how fairness regularizers affect optimal decisions.

problem Understanding how fairness regularizers change the optimal decision in predictive algorithms.
method Property elicitation to analyze the relationship between loss, regularization, and optimal decision.
result Necessary and sufficient condition for when a property changes with the addition of a regularizer.

New PG losses improve decision optimization in misspecified models.

problem Improving decision optimization in models that are not perfectly specified.
method Introducing Perturbation Gradient (PG) losses to connect decision loss with directional derivatives and optimizing using gradient techniques.
result PG losses yield best-in-class policies asymptotically, even in misspecified settings.

This paper rethinks confidence calibration under covariate shifts.

problem Calibration methods struggle with covariate shifts and unstable importance weighting.
method Derives Expectation consistency condition and proposes Expectation consistency loss (ECL).
result ECL loss is compatible with various types of calibration and has the same sample complexity as ECE.

Max-margin learning is a powerful approach to building classifiers and structured output predictors. Recent work on max-margin supervised topic models has successfully integrated it with Bayesian topic models to discover discriminative latent semantic structures and make accurate predictions for unseen testing data. Ho…

2013-10-10abs ↗pdf ↗

Algorithm provides online learning guarantees against general comparators in full and bandit feedback.

problem Adversarial online learning with data-dependent regret guarantees.
method Completely online algorithm with data-dependent regret guarantees for full and bandit feedback.
result Algorithm achieves expected performance against arbitrary comparator sequences in full and bandit feedback settings.

The paper tackles performative risk optimization under weak convexity assumptions.

problem Optimizing performative risk in a closed-loop prediction system with weak convexity.
method Relaxing convexity assumptions to maintain optimization feasibility.
result Iterative optimization methods remain applicable even with weakened convexity conditions.

The paper optimizes forecasting for risk-adjusted decisions under trading frictions.

problem Optimizing forecasting accuracy for investment decisions in the presence of transaction costs.
method Develops a utility-weighted calibration criterion to minimize decision loss net of costs.
result Utility-weighted calibration reduces decision loss by over 30% and improves Sharpe ratio.

GOIMDA selects inputs to maximize expected influence on a goal functional, reducing data acquisition needs.

problem Challenges in active data acquisition for learning and optimization tasks in deep neural networks.
method GOIMDA uses inverse curvature and goal gradient to select inputs maximizing expected influence on a specified goal functional.
result GOIMDA achieves target performance with fewer labeled samples or function evaluations compared to baselines.

Simplified plug-in loss approximates EDL for reliable uncertainty estimation.

problem Efficient and reliable uncertainty estimation in real-world sensor-based learning systems.
method Approximate Dirichlet expected objectives with plug-in losses evaluated at the Dirichlet mean.
result Plug-in losses provide comparable predictive accuracy and selective prediction performance to classical EDL, while being simpler to implement.

Gaptron algorithm reduces mistakes in online multiclass classification.

problem Online multiclass classification with limited information.
method Randomized first-order algorithm exploiting the gap between zero-one loss and surrogate losses.
result First linear time algorithm with O(KT)O(K\sqrt{T}) expected regret.

Proposes non-exchangeable conformal risk control for better uncertainty bounds.

problem Handling non-exchangeable data in black-box models for better risk control.
method Leverages and extends split conformal prediction and monotone loss function approaches.
result Allows controlling expected value of any monotone loss function for non-exchangeable data.

New algorithm identifies best arm in rested bandit setting.

problem Best arm identification in rested bandit with decreasing losses.
method Introduced a novel best arm identification problem and analyzed an arm elimination algorithm.
result Regret vanishes as time horizon increases, with convergence rate depending on expected loss function.

A new framework for time series forecasting that adapts to varying patterns.

problem Forecasting multivariate time series with predictive heterogeneity.
method Validation-driven clustering framework that applies specialization based on out-of-sample predictive performance.
result Improves robustness to heavy-tailed errors and local anomalies.

Given a task of predicting YY from XX, a loss function LL, and a set of probability distributions ΓΓ on (X,Y)(X,Y), what is the optimal decision rule minimizing the worst-case expected loss over ΓΓ? In this paper, we address this question by introducing a generalization of the principle of maximum entropy. Applying t…

2016-06-07abs ↗pdf ↗