Kernel ridge regression imputation with consistent variance estimation for handling missing data.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New method solves continuous time mean-variance model for consistent investment strategy.
Beam search improves UQ in LLMs by reducing duplicates and variance.
The discrete-time mean-variance portfolio selection formulation, a representative of general dynamic mean-risk portfolio selection problems, does not satisfy time consistency in efficiency (TCIE) in general, i.e., a truncated pre-committed efficient policy may become inefficient when considering the corresponding trunc…
Improves Monte-Carlo simulations for consistent mean and variance.
The paper develops estimators for variance in graph structures using fused lasso.
Maximum Variance Unfolding is one of the main methods for (nonlinear) dimensionality reduction. We study its large sample limit, providing specific rates of convergence under standard assumptions. We find that it is consistent when the underlying submanifold is isometric to a convex subset, and we provide some simple e…
Jackknife variance estimation validated for generalized U-statistics.
In this paper, we propose a random projection approach to estimate variance in kernel ridge regression. Our approach leads to a consistent estimator of the true variance, while being computationally more efficient. Our variance estimator is optimal for a large family of kernels, including cubic splines and Gaussian ker…
Optimal investment and risk control strategies for insurers are derived using a time-consistent approach.
When we implement a portfolio selection methodology under a mean-risk formulation, it is essential to correctly model investors' risk aversion which may be time-dependent, or even state-dependent during the investment procedure. In this paper, we propose a behavior risk aversion model, which is a piecewise linear funct…
Derives operational-time variance kernel for reaction boundaries in financial markets.
New metric reduces arbitrariness in fair binary classification predictions.
Bayesian method recovers causal structure in SEMs with equal error variances.
Study finds AUC is most consistent across different prevalence in binary classification.
Derives variance kernel for reaction boundary in financial models.
We study the distribution of hard-, soft-, and adaptive soft-thresholding estimators within a linear regression model where the number of parameters k can depend on sample size n and may diverge with n. In addition to the case of known error-variance, we define and study versions of the estimators when the error-varian…
The paper extends consistency results for sequential design strategies to vector-valued Gaussian processes.
Investigates RI strategies for life insurers with LRD mortality rates.
Diffusion models' consistency across splits explained by random matrix theory.
New unbiased variance estimator for random forests using Hoeffding decomposition.
Gradient-based Monte Carlo sampling algorithms, like Langevin dynamics and Hamiltonian Monte Carlo, are important methods for Bayesian inference. In large-scale settings, full-gradients are not affordable and thus stochastic gradients evaluated on mini-batches are used as a replacement. In order to reduce the high vari…
We provide a new theory for nodewise regression when the residuals from a fitted factor model are used. We apply our results to the analysis of the consistency of Sharpe ratio estimators when there are many assets in a portfolio. We allow for an increasing number of assets as well as time observations of the portfolio.…
We analyze the variance of Fisher information estimators in deep learning models.
Novel estimator reduces diffusion model variance.
The bias-variance tradeoff tells us that as model complexity increases, bias falls and variances increases, leading to a U-shaped test error curve. However, recent empirical results with over-parameterized neural networks are marked by a striking absence of the classic U-shaped test error curve: test error keeps decrea…
In this paper, we consider the optimal portfolio liquidation problem under the dynamic mean-variance criterion and derive time-consistent solutions in three important models. We give adapted optimal strategies under a reconsidered mean-variance subject at any point in time. We get explicit trading strategies in the bas…
Importance sampling (IS) is a common reweighting strategy for off-policy prediction in reinforcement learning. While it is consistent and unbiased, it can result in high variance updates to the weights for the value function. In this work, we explore a resampling strategy as an alternative to reweighting. We propose Im…
It is well known that mean-variance portfolio selection is a time-inconsistent optimal control problem in the sense that it does not satisfy Bellman's optimality principle and therefore the usual dynamic programming approach fails. We develop a time- consistent formulation of this problem, which is based on a local not…
Paper proposes a method to estimate variance reduction in DNN training using importance sampling.
New bin-wise scaling methods improve prediction uncertainty calibration for machine learning.
Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance tradeoffs. We theoretically show that, under some conditions, estimators such as MINE ex…
VRER selectively reuses past observations to reduce variance in policy optimization.
We propose and investigate new complementary methodologies for estimating predictive variance networks in regression neural networks. We derive a locally aware mini-batching scheme that result in sparse robust gradients, and show how to make unbiased weight updates to a variance network. Further, we formulate a heurist…
We develop generic and efficient importance sampling estimators for Monte Carlo evaluation of prices of single- and multi-asset European and path-dependent options in asset price models driven by Lévy processes, extending earlier works which focused on the Black-Scholes and continuous stochastic volatility models. Usin…
Machine learning reduces variance in online experiment results.
Paper introduces dynamic strategies for multi-period investment models.
MARS optimizes large model training by reducing variance, outperforming AdamW.
Estimates generalization gap for overparameterized models using Langevin approximation.
The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy gradient estimates for reliable policy updates. In this paper, we combine the followi…
Scaling laws in linear regression explain model performance improvements with size and data.
This paper considers the case of pricing discretely-sampled variance swaps under the class of equity-interest rate hybridization. Our modeling framework consists of the equity which follows the dynamics of the Heston stochastic volatility model, and the stochastic interest rate is driven by the Cox-Ingersoll-Ross (CIR)…
We study distributions of realized variance (squared realized volatility) and squared implied volatility, as represented by VIX and VXO indices. We find that Generalized Beta distribution provide the best fits. These fits are much more accurate for realized variance than for squared VIX and VXO -- possibly another indi…
In this paper, we propose a novel reinforcement- learning algorithm consisting in a stochastic variance-reduced version of policy gradient for solving Markov Decision Processes (MDPs). Stochastic variance-reduced gradient (SVRG) methods have proven to be very successful in supervised learning. However, their adaptation…
A novel k-NN method estimates conditional mean and variance efficiently.
Two derivations of PCA for distributional data.
Paper develops efficient mechanisms for estimating variance and covariance under differential privacy in the add-remove model.
Naive investors make riskier choices than optimal strategies in continuous-time finance.