A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.
CARV reduces compute cost for downstream pipelines using diffusion models.
Diamonds help compute volatility models efficiently.
Paper proposes diagnostics for error and variance estimation in randomized matrix computations.
Paper improves efficiency in matrix computations for Gaussian processes.
The recently proposed Unbiased Online Recurrent Optimization algorithm (UORO, arXiv:1702.05043) uses an unbiased approximation of RTRL to achieve fully online gradient-based learning in RNNs. In this work we analyze the variance of the gradient estimate computed by UORO, and propose several possible changes to the meth…
Paper proposes a method to estimate variance reduction in DNN training using importance sampling.
Unified method for MMD variance estimation improves accuracy and computational efficiency.
ES-Single uses ES to estimate gradients in unrolled graphs, reducing variance and improving performance.
U-statistics improve gradient estimation in importance-weighted variational inference.
Sparse matrices simplify computation of GP variances and likelihoods.
New method reduces variance in random coordinate descent for Langevin Monte Carlo.
We develop generic and efficient importance sampling estimators for Monte Carlo evaluation of prices of single- and multi-asset European and path-dependent options in asset price models driven by Lévy processes, extending earlier works which focused on the Black-Scholes and continuous stochastic volatility models. Usin…
Variance reduction (VR) methods boost the performance of stochastic gradient descent (SGD) by enabling the use of larger, constant stepsizes and preserving linear convergence rates. However, current variance reduced SGD methods require either high memory usage or an exact gradient computation (using the entire dataset)…
Estimates generalization gap for overparameterized models using Langevin approximation.
Stochastic gradient descent is the method of choice for large-scale machine learning problems, by virtue of its light complexity per iteration. However, it lags behind its non-stochastic counterparts with respect to the convergence rate, due to high variance introduced by the stochastic updates. The popular Stochastic …
New method reduces variance in estimating PL model expectations.
The maximum mean discrepancy (MMD) is a kernel-based distance between probability distributions useful in many applications (Gretton et al. 2012), bearing a simple estimator with pleasing computational and statistical properties. Being able to efficiently estimate the variance of this estimator is very helpful to vario…
It is well known that Markov chain Monte Carlo (MCMC) methods scale poorly with dataset size. A popular class of methods for solving this issue is stochastic gradient MCMC. These methods use a noisy estimate of the gradient of the log posterior, which reduces the per iteration computational cost of the algorithm. Despi…
Variance reduction methods such as SVRG and SpiderBoost use a mixture of large and small batch gradients to reduce the variance of stochastic gradients. Compared to SGD, these methods require at least double the number of operations per update to model parameters. To reduce the computational cost of these methods, we i…
This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over input dependent noise variance (heteroscedasticity) and input dependent signal varia…
The Black Box Variational Inference (Ranganath et al. (2014)) algorithm provides a universal method for Variational Inference, but taking advantage of special properties of the approximation family or of the target can improve the convergence speed significantly. For example, if the approximation family is a transforma…
Storchastic improves stochastic AD for complex models in RL and VI.
This work proposes using zero-variance control variates to reduce variance in pathwise gradient estimators for variational inference.
New method reduces variance in Bayesian inverse problems.
FPG uses fractional calculus for efficient reinforcement learning with long-term memory.
VarGrad reduces variance in ELBO gradient estimation for variational inference.
We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing framework shifts towards capturing the full posterior distribution on the latent variab…
New method improves convergence and reduces variance in noisy optimization problems.
A new method improves robustness and efficiency of Bayesian LOO-CV.
Stochastic gradient descent updates parameters with summation gradient computed from a random data batch. This summation will lead to unbalanced training process if the data we obtained is unbalanced. To address this issue, this paper takes the error variance and error mean both into consideration. The adaptively adjus…
New method forecasts time series with changing variances.
It is well known that the out-of-sample performance of Markowitz's mean-variance portfolio criterion can be negatively affected by estimation errors in the mean and covariance. In this paper we address the problem by regularizing the mean-variance objective function with a weighted elastic net penalty. We show that the…
We propose a sample efficient stochastic variance-reduced cubic regularization (Lite-SVRC) algorithm for finding the local minimum efficiently in nonconvex optimization. The proposed algorithm achieves a lower sample complexity of Hessian matrix computation than existing cubic regularization based methods. At the heart…
A new approach to VAEs tackles variance shrinkage using quantile regression.
The vast majority of works on option pricing operate on the assumption of risk neutral valuation, and consequently focus on the expected value of option returns, and do not consider risk parameters, such as variance. We show that it is possible to give explicit formulae for the variance of European option returns (vani…
We analyze the variance of Fisher information estimators in deep learning models.
SignSVRG improves SignSGD by reducing variance, achieving similar convergence rates.
Optimizes wide low-rank neural networks for reduced parameters and cost.
This paper investigates the use of multiple directions of stratification as a variance reduction technique for Monte Carlo simulations of path-dependent options driven by Gaussian vectors. The precision of the method depends on the choice of the directions of stratification and the allocation rule within each strata. S…
Stochastic gradient Markov Chain Monte Carlo (SG-MCMC) has been developed as a flexible family of scalable Bayesian sampling algorithms. However, there has been little theoretical analysis of the impact of minibatch size to the algorithm's convergence rate. In this paper, we prove that under a limited computational bud…
Enhances LMC for log-concave sampling, reducing computational cost.
This paper presents a multinomial method for option pricing when the underlying asset follows an exponential Variance Gamma process. The continuous time Variance Gamma process is approximated by a discrete time Markov chain with the same firsts four cumulants. This approach is particularly convenient for pricing Americ…
New method reduces variance in complex probabilistic model optimization.
Method estimates noise variance in Gaussian process regression.
Choosing appropriate step sizes is critical for reducing the computational cost of training large-scale neural network models. Mini-batch sub-sampling (MBSS) is often employed for computational tractability. However, MBSS introduces a sampling error, that can manifest as a bias or variance in a line search. This is bec…
Stochastic gradient algorithms estimate the gradient based on only one or a few samples and enjoy low computational cost per iteration. They have been widely used in large-scale optimization problems. However, stochastic gradient algorithms are usually slow to converge and achieve sub-linear convergence rates, due to t…
Stochastic Gradient Descent (SGD) is a workhorse in machine learning, yet its slow convergence can be a computational bottleneck. Variance reduction techniques such as SAG, SVRG and SAGA have been proposed to overcome this weakness, achieving linear convergence. However, these methods are either based on computations o…