Paper introduces MCSD, a method for uncertainty estimation in deep learning.
problem Need for reliable uncertainty quantification in deep neural networks.
method Theoretical connection to variational inference and empirical benchmarking of MCSD.
result MCSD achieves competitive predictive accuracy and improves uncertainty ranking.
seMCD computes depth functions with statistical guarantees using sequential Monte Carlo.
problem Computing depth functions is computationally challenging, especially in high dimensions.
method Sequential Monte Carlo methodology with theoretical and empirical guarantees.
result The seMCD method provides accurate depth approximations with fewer samples than traditional methods.
The thesis examines stochastic calculus in option pricing with logistic models and numerical methods.
problem Exploring the application of stochastic calculus in option pricing.
method Monte-Carlo Simulation and machine learning algorithms.
result Insights from Peter Carr and Lorenzo Torricelli's convex duality in continuous models.
Recent advances in bandit tools and techniques for sequential learning are steadily enabling new applications and are promising the resolution of a range of challenging related problems. We study the game tree search problem, where the goal is to quickly identify the optimal move in a given game tree by sequentially sa…
Gradient-based Monte Carlo sampling algorithms, like Langevin dynamics and Hamiltonian Monte Carlo, are important methods for Bayesian inference. In large-scale settings, full-gradients are not affordable and thus stochastic gradients evaluated on mini-batches are used as a replacement. In order to reduce the high vari…
New method corrects bias in stochastic gradient samplers.
problem Bias in stochastic gradient samplers.
method Gradient-Guided Monte Carlo with stochastic gradients.
result Corrected sampler yields nonzero acceptance probabilities.
Quantum algorithm speeds up financial option pricing.
problem Optimizing stopping times in stochastic processes for finance.
method Combines quantum computing techniques with LSM for optimal stopping.
result Achieves nearly quadratic speedup in runtime.
A new transformer model uses Monte Carlo methods for sequence prediction.
problem Predicting sequences from observations with uncertainty.
method Integrates Monte Carlo methods into a transformer architecture to model stochastic sequences.
result Proposes a generative model with predictive distributions.
Developed scalable Monte Carlo method for VIX option pricing.
problem VIX option pricing in stochastic Volterra rough volatility models with non-Markovian vol-of-vol.
method Infinite dimensional Markovian representation to devise scalable least squares Monte Carlo.
result Efficient VIX option pricing method for generalized models.
New estimator reduces nested expectation estimation costs.
problem Estimating repeatedly nested expectations is computationally expensive.
method Recursive Estimator for Arbitrary Depth (READ) using randomized multilevel Monte Carlo.
result Optimal computational cost of O(ε^(-2)) for every fixed D.
Quantum method improves CVaR evaluation under correlated fields.
problem Accurately evaluating CVaR in high-dimensional, correlated material uncertainty.
method Quantum-enhanced inference framework using stabilized IQAE.
result Quantum method achieves lower oracle complexity than classical methods.
Quantum computing techniques applied to Monte Carlo simulations in finance.
problem Efficiently simulating quantum algorithms for financial modeling.
method Introduces quantum computing basics, amplitude estimation, and Grover's algorithm for unstructured search.
result Demonstrates quantum approaches to Monte Carlo integration and counting in finance.
This paper develops scalable control variates for Monte Carlo methods using stochastic optimization.
problem Reducing variance in Monte Carlo estimators for large-scale problems.
method Control variates based on Stein operators, optimized through stochastic optimization.
result Novel theoretical results and empirical validations show effective variance reduction.
Bayesian inference using stochastic neural networks ensembles.
problem Approximating Bayesian posterior distributions.
method Formulate stochastic ensembles of neural networks, train with variational inference, and evaluate using Monte Carlo dropout.
result Stochastic ensembles provide more accurate posterior estimates than other methods.
Proposes a method to reduce parallel complexity of MLMC in SGD.
problem Poor scalability of MLMC in SGD on parallel platforms.
method Proposes a delayed MLMC gradient estimator to reduce parallel complexity.
result Proves reduction in average parallel complexity per iteration at the cost of slightly worse convergence rate.
RQMC improves optimization in variational Bayes problems.
problem Optimizing variational Bayes problems with noisy objective functions.
method Use of randomized quasi-Monte Carlo (RQMC) sampling with stochastic L-BFGS.
result RQMC can significantly speed up optimization and find better parameter values.
Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time discretizations and performs poorly if there is a mismatch between the spatial geo…
A new tamed stochastic gradient Hamiltonian Monte Carlo algorithm for superlinearly growing stochastic gradients.
problem Sampling and stochastic optimization problems with superlinearly growing stochastic gradients.
method Tamed Stochastic Gradient Hamiltonian Monte Carlo (tSGHMC) algorithm.
result Established a non-asymptotic error bound in Wasserstein-2 distance with a convergence rate of 1/4. New insights into variational inference using Monte Carlo estimates.
problem Improving variational bounds in latent variable models.
method Analyzing properties of Monte Carlo estimates and their impact on variational gaps.
result Negative correlation reduces variational gaps, contrary to intuition.
Adapts Monte Carlo method to price π-options related to maximum drawdown.
problem Pricing π-options in volatile market conditions.
method Monte Carlo algorithm with simulated price tree.
result Algorithm produces bounds converging to true price with tree depth.
Quantum computing offers a quadratic speedup for estimating non-linear functionals.
problem Estimating non-linear functionals of probability distributions.
method Proposes a quantum-inside-quantum Monte Carlo algorithm for a broad class of non-linear estimation problems.
result Achieves a quadratic speedup for non-linear estimation problems, including nested conditional expectations and stochastic optimization.
New algorithm reduces overfitting in neural networks.
problem Overfitting in neural networks.
method Integrates SMC with SGHMC for mini-batch sampling.
result SMCSGHMC outperforms SGD and deep ensembles.
New method improves sampling efficiency in complex stochastic systems.
problem Sampling efficiency in nonconvex stochastic gradient cases.
method Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo.
result Quantitative Gaussian concentration bounds and convergence rates established.
In this paper we propose and study a family of continuous wavelets on general domains, and a corresponding stochastic discretization that we call Monte Carlo wavelets. First, using tools from the theory of reproducing kernel Hilbert spaces and associated integral operators, we define a family of continuous wavelets by …
The paper examines how the angle between inputs in ReLU networks decreases with depth, impacting training.
problem Depth degeneracy in neural networks, leading to constant function behavior on initialization.
method Combinatorial expansions and Monte Carlo experiments to analyze the angle between inputs in ReLU networks of increasing depth.
result The angle between inputs in ReLU networks decreases exponentially with depth, leading to constant function behavior on initialization.
GPU speeds up Monte Carlo simulations for large time steps.
problem Slow convergence and inaccurate solutions with large time steps in Monte Carlo simulations.
method Generalizes the Seven League scheme for GPU acceleration.
result Significantly improved computational speed.
New estimator for digital options using path splitting and MLMC.
problem Estimating digital options with stochastic differential equations.
method Repeated path splitting, Multilevel Monte Carlo (MLMC).
result Estimator complexity similar to MLMC for Lipschitz payoffs.
Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in general performing exact inference requires all of the data to be processed at eac…
YOASOVI improves stochastic VI for large models with fast, self-correcting sampling.
problem Efficiently performing stochastic Variational Inference on large Bayesian models.
method YOASOVI uses acceptance sampling to draw only one sample per iteration, improving convergence speed and accuracy.
result YOASOVI converges faster and more accurately than regular Monte Carlo and Quasi-Monte Carlo methods.
New algorithms improve sampling from Bayesian deep learning models.
problem Sampling from the posterior of deep neural networks is inefficient.
method Adaptive SGMCMC algorithms with biased drift.
result Proposed algorithms significantly outperform existing methods.
The hybrid Monte Carlo (HMC) algorithm is used for Bayesian analysis of the generalized autoregressive conditional heteroscedasticity (GARCH) model. The HMC algorithm is one of Markov chain Monte Carlo (MCMC) algorithms and it updates all parameters at once. We demonstrate that how the HMC reproduces the GARCH paramete…
Stochastic Gradient Hamiltonian Monte Carlo (SGHMC) is a momentum version of stochastic gradient descent with properly injected Gaussian noise to find a global minimum. In this paper, non-asymptotic convergence analysis of SGHMC is given in the context of non-convex optimization, where subsampling techniques are used o…
Proposes new Monte Carlo methods for calibrating local volatility models with stochastic components.
problem Calibrating local volatility models with stochastic drift and diffusion.
method Developed Monte Carlo algorithms for three models: local volatility with stochastic interest rates, stochastic local volatility with deterministic interest rates, and stochastic local volatility with stochastic interest rates.
result Conditions for the existence of local volatility given European option prices, stochastic interest rate model parameters, and correlations.
This paper extends AD techniques to Monte Carlo processes for efficient derivative calculation.
problem Obtaining derivatives of expectation values in Monte Carlo processes.
method Two approaches: reweighting and Hamiltonian extension of HMC.
result Hamiltonian approach as a change of variables simplifies variance reduction.
Paper proposes an unbiased optimization method for Bayesian experimental design.
problem Maximizing expected information gain in Bayesian experimental design.
method Randomized multilevel Monte Carlo (MLMC) method combined with stochastic gradient descent.
result An unbiased estimator for the gradient of expected information gain.
New SMC samplers improve stochastic optimisation efficiency.
problem Optimizing functions with intractable gradients in machine learning and statistics.
method Sequential Monte Carlo (SMC) samplers for stochastic optimisation.
result Significant computational gains achieved with SMC approximations.
We introduce a stacking version of the Monte Carlo algorithm in the context of option pricing. Introduced recently for aeronautic computations, this simple technique, in the spirit of current machine learning ideas, learns control variates by approximating Monte Carlo draws with some specified function. We describe the…
Study compares MC and QMC methods for pricing and risk analysis in a hyperbolic local volatility model.
problem Derivative pricing and risk analysis in a hyperbolic local volatility model.
method Application of Monte Carlo and Quasi Monte Carlo methods for pricing and risk analysis.
result Quasi Monte Carlo methods show superior performance in high-dimensional integration for derivative pricing and risk analysis.
New algorithms improve sampling from complex distributions.
problem Sampling from complex probability distributions efficiently.
method Regime-switching Langevin dynamics and Monte Carlo algorithms.
result Convergence guarantees and iteration complexities provided.
CRAFT improves on existing methods for sampling complex distributions.
problem Sampling from complex probability distributions.
method Combines SMC with variational inference using normalizing flows.
result Improves on Annealed Flow Transport Monte Carlo and MCMC-based Stochastic Normalizing Flows.
Develops a multilevel Monte Carlo framework with dropout for efficient uncertainty quantification.
problem Efficiently quantify uncertainty in complex models using dropout.
method Integrates multilevel Monte Carlo with Monte Carlo dropout, creating coupled estimators to reduce variance.
result Demonstrates significant variance reduction and efficiency gains over single-level Monte Carlo dropout.
Conventional Monte Carlo simulations are stochastic in the sense that the acceptance of a trial move is decided by comparing a computed acceptance probability with a random number, uniformly distributed between 0 and 1. Here we consider the case that the weight determining the acceptance probability itself is fluctuati…
Improved multilevel scheme for value-at-risk computation.
problem Discontinuity in Heaviside function affects value-at-risk computation.
method Adaptive multilevel stochastic approximation to mitigate discontinuity.
result Best complexity improved to O(ε−2∣lnε∣25). Study on interest rate model with jumps, proving strong convergence in simulations.
problem Analytical solutions for complex interest rate models with jumps are difficult.
method Employed truncated Euler-Maruyama techniques to prove strong convergence.
result Justified strong convergence for Monte Carlo calibration and valuation.
Efficient hybrid method for pricing barrier options with stochastic volatility.
problem Valuation of barrier options on assets with stochastic volatility.
method Combining Monte Carlo simulation and semi-analytical heat potential method.
result Our method provides better accuracy and is orders of magnitude faster than existing methods.
Deep learning accelerates Monte Carlo SDE simulations with large time steps.
problem Accurate simulation of SDEs with large time steps.
method Polynomial chaos expansion with neural network learned stochastic collocation points.
result Data-driven scheme achieves strong convergence in Monte Carlo simulations.
New method samples from time-integrated stochastic bridges using neural networks.
problem Sampling from time-integrated stochastic bridges with high accuracy and speed.
method Polynomial chaos expansion and artificial neural networks.
result Robust, data-driven Monte Carlo sampling with thousands of samples in milliseconds.
Develops methods to simulate option prices for a specific stochastic volatility model.
problem No method exists to compute option prices numerically for a non-martingale jump-type model.
method Develops two Monte Carlo simulation methods under change of measure.
result Conducts numerical experiments to validate the developed methods.