This paper uses SDEs to analyze GANs training and long-run behavior.
problem Understanding the training process and long-run behavior of GANs.
method Established SDE approximations for GANs training and analyzed long-run behavior via invariant measures.
result The long-run behavior of GANs training can be studied via the invariant measures of its SDE approximations.
The paper clarifies the approximation of SGD with Ito SDEs for finite learning rates.
problem Theoretical justification and experimental verification of the Ito SDE approximation for finite learning rates in SGD.
method An efficient simulation algorithm SVAG and a necessary condition test for the SDE approximation.
result The Ito SDE approximation can meaningfully capture training and generalization properties of deep nets with finite learning rates.
This paper bridges the gap between ODE and SDE in diffusion models using Fokker-Planck equations.
problem Empirical evidence shows that ODE-based samples from score-based diffusion models are inferior to SDE-based samples.
method The paper rigorously describes dynamics and approximations in training score-based diffusion models, linking them to Fokker-Planck equations.
result Adding a regularisation term based on the Fokker-Planck residual can close the gap between ODE- and SDE-induced distributions.
Simulation-free VI closes the approximation gap in latent SDEs
problem Recovering dynamical systems from noisy observations
method Helmholtz-SDE
result Recovers dynamics more faithfully than prior methods
GANs can approximate SDEs for large time steps.
problem Approximating SDEs for large time steps using GANs.
method Proposed a conditional GAN architecture to enable strong approximation of SDEs.
result Supervised GAN outperformed standard GAN and other schemes in strong error.
We are interested in strong approximations of one-dimensional SDEs which have non-Lipschitz coefficients and which take values in a domain. Under a set of general assumptions we derive an implicit scheme that preserves the domain of the SDEs and is strongly convergent with rate one. Moreover, we show that this general …
Efficiently infers latent SDEs with scalable memory and time costs.
problem Inference of latent SDEs with high time and memory complexity.
method Amortized reparametrization of expectations under linear SDEs, coupled with efficient gradient approximation.
result Achieves similar performance to adjoint sensitivities with fewer model evaluations.
SDE Matching eliminates simulation for training Latent SDEs, achieving similar performance.
problem Training Latent SDEs with adjoint sensitivity methods is computationally expensive and limited.
method SDE Matching, inspired by Score- and Flow Matching, eliminates simulation for training Latent SDEs.
result SDE Matching achieves performance comparable to adjoint sensitivity methods while reducing computational complexity.
Deep learning estimates time-varying Markov model parameters.
problem Estimating time-dependent parameters in Markov models.
method Reframes parameter estimation as an optimization problem using maximum likelihood.
result Real solution close to SDE with neural network-derived parameters under specific conditions.
SING improves state inference in latent SDE models for better drift function estimation.
problem Intractable posterior inference in latent SDE models.
method Natural gradient variational inference.
result SING provides faster and more reliable inference in latent SDE models.
A new machine learning method solves high-dimensional Kolmogorov PDEs efficiently.
problem Solving high-dimensional Kolmogorov PDEs and SDEs.
method Stochastic weighted minimization and stochastic gradient descent with Malliavin weights.
result Accurate approximation of high-dimensional Kolmogorov PDEs and SDEs without curse of dimensionality.
In this article we develop a method for the strong approximation of stochastic differential equations (SDEs) driven by Lévy processes or general semimartingales. The main ingredients of our method is the perturbation of the SDE and the Taylor expansion of the resulting parameterized curve. We apply this method to devel…
We develop a variational framework for SDEs driven by fractional noise.
problem Capturing long-term dependencies in SDEs driven by fractional noise.
method Markov approximation of fractional Brownian motion, variational inference, neural networks.
result Efficient variational inference of posterior path measures for neural-SDEs.
Stochastic differential equations (SDEs) and the Kolmogorov partial differential equations (PDEs) associated to them have been widely used in models from engineering, finance, and the natural sciences. In particular, SDEs and Kolmogorov PDEs, respectively, are highly employed in models for the approximative pricing of …
We define two new notions of projection of a stochastic differential equation (SDE) onto a submanifold: the Ito-vector and Ito-jet projections. This allows one to systematically develop low dimensional approximations to high dimensional SDEs using differential geometric techniques. The approach generalizes the notion o…
New geometric SDEs and discretizations on Riemannian manifolds with error bounds.
problem Modeling diffusion processes on Riemannian manifolds with geometric SDEs.
method Introduced a new construction of geometric SDEs and provided non-asymptotic error bounds.
result First non-asymptotic error bound for geometric Euler-Murayama discretization.
Develops optimal low-dimensional approximations to high-dimensional SDEs.
problem Approximating solutions to high-dimensional SDEs in a low-dimensional space.
method Introduces Ito-vector and Ito-jet projections for optimal approximation.
result Optimal projection filters yield better approximations than Stratonovich projection.
New method learns SDEs without integrators, speeding up computation.
problem Computational expense in learning SDEs using neural networks.
method Importance-sampling estimator for SDEs, leveraging parallelism.
result Lower-variance gradient estimates and massive computation time reductions.
Neural SDEs reduce variance in stochastic simulations.
problem Efficiency of Monte Carlo simulations in finance.
method Use neural SDEs with control variates parameterized by neural networks.
result Prove optimality conditions for variance reduction in SDEs with infinite activity.
New method speeds up SDE inference by matching moments to FPK equation.
problem Efficiency of sampling schemes in high-dimensional SDEs.
method Direct approximation of Fokker-Planck-Kolmogorov equation by matching moments.
result Fast, scalable inference in high-dimensional latent spaces.
We developed efficient methods to compute gradients for Neural SDEs, improving training speed and accuracy.
problem Training Neural SDEs requires accurate and efficient computation of gradients, which is challenging due to the complexity of SDEs.
method We introduced a reversible Heun method for solving backwards-in-time SDEs and a Brownian Interval for sampling and reconstructing Brownian motion.
result Our methods significantly improve training speed and accuracy for Neural SDEs, outperforming state-of-the-art techniques.
We introduce stochastic normalizing flows, an extension of continuous normalizing flows for maximum likelihood estimation and variational inference (VI) using stochastic differential equations (SDEs). Using the theory of rough paths, the underlying Brownian motion is treated as a latent variable and approximated, enabl…
Method learns latent SDEs from high-dimensional time series.
problem Learning latent stochastic differential equations from time series data.
method Self-supervised learning with variational autoencoders and Euler-Maruyama approximation.
result Can recover SDE coefficients and latent variables up to isometry with infinite data.
Paper proposes a weak approximation of reflection coupling for non-convex optimization.
problem Non-convex optimization problems with different drift terms.
method Proposes an approximate reflection coupling (ARC) for stochastic differential equations (SDEs).
result ARC converges weakly to the reflection coupling and can be applied to non-convex optimization.
Proposes a method for approximating transition densities of SDEs driven by gamma processes.
problem Calculating transition densities for SDEs driven by gamma processes.
method Taylor-type approximation and conditional expectation of multiple stochastic integrals.
result Efficiency of the proposed method demonstrated through numerical tests.
Neural models price financial options without assuming underlying price forms.
problem Pricing financial options under flexible price processes.
method Apply neural SDEs as universal approximators, use Wasserstein distance for training.
result Error in option prices bounded by Wasserstein distance used for training.
HA-SME models SGD dynamics with Hessian info for better escaping behaviors.
problem Capturing the escaping behaviors of SGD from stationary points.
method HA-SME, a novel SDE with Hessian info in drift and diffusion.
result HA-SME achieves best approximation error and recovers SGD dynamics for quadratics.
DSB approximates SB problem for faster generative modeling.
problem Fast generation from complex data distributions.
method Entropy-regularized optimal transport on path spaces.
result DSB yields faster convergence to data distribution.
New deep learning architecture learns martingales efficiently.
problem Efficiently learning martingales in financial derivatives pricing.
method High-order weak approximation algorithms of Runge-Kutta type.
result Deep neural networks based on this architecture learn martingales effectively.
Bayesian neural SDEs calibrate financial models robustly.
problem Calibrating financial models using neural SDEs for robustness.
method Bayesian framework with prior and likelihood, global approximation theorem, Langevin algorithm.
result Robust bounds on implied volatility surface learned from historical and option data.
We consider assets for which price Xt and squared volatility Yt are jointly driven by Heston joint stochastic differential equations (SDEs). When the parameters of these SDEs are estimated from N sub-sampled data (XnT,YnT), estimation errors do impact the classical option pricing PDEs. We estimate thes…
Study shows convergence rates for BSDEs approximated by compound Poisson processes.
problem Analyzing convergence rates of BSDEs driven by Lévy processes.
method Approximating Lévy processes by compound Poisson processes and studying BSDEs.
result Optimal convergence rates derived for BSDEs in L2-norm and Wasserstein distance. Combines neural networks with SDEs for robust pricing and hedging.
problem Inadequate financial models lead to undetected and unquantifiable risks.
method Neural SDEs integrating machine learning and classical SDEs.
result Robust bounds for derivative prices and hedging strategies.
Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are missing in current Neural ODE networks. In this paper, we propose a new continuous ne…
Novel method for SDE calibration from sparse data using neural flows.
problem Calibrating SDEs from sparse, noisy observations.
method Characterization of posterior SDE using neural networks trained to solve a PDE with multiplicative updates.
result Significant improvement in scalability and accuracy compared to classical methods.
This work provides a semi-analytic approximation method for decoupled forwardbackward SDEs (FBSDEs) with jumps. In particular, we construct an asymptotic expansion method for FBSDEs driven by the random Poisson measures with σ-finite compensators as well as the standard Brownian motions around the small-variance limit …
Novel weak MLMC scheme for Lévy-driven SDEs, applied to financial derivatives pricing.
problem Approximating solutions to Lévy-driven SDEs for financial derivatives pricing.
method Weak multilevel Monte-Carlo scheme with state space discretization of Lévy processes.
result Efficient approximation of financial derivatives pricing models.
Neural networks estimate SDEs with jump noise using a Tamed-Milstein scheme.
problem Estimating drift and diffusion functions in SDEs with jump noise.
method Tamed-Milstein scheme with neural networks as non-parametric approximators.
result Flexible estimation of complex nonlinear dynamics in systems with state-dependent noise.
Training-free model learns SDE dynamics without training, accelerating parameter studies.
problem High computational cost of simulating parameter-dependent SDEs.
method Training-free conditional diffusion model with joint kernel-weighted Monte Carlo estimator.
result Accurate approximation of conditional distributions across varying parameter values.
We consider the approximation of stochastic differential equations (SDEs) with non-Lipschitz drift or diffusion coefficients. We present a modified explicit Euler-Maruyama discretisation scheme that allows us to prove strong convergence, with a rate. Under some regularity and integrability conditions, we obtain the opt…
GANs analyzed for performance and training issues.
problem Performance and training issues of GANs.
method SDE approximations for training GANs.
result Improved understanding of GANs through analytical perspectives.
Corrects local error estimates for UBU integrator in SDEs, improving complexity guarantees.
problem Improper local error estimates in UBU integrator for SDEs.
method Reconciles theory with practice by correcting local error estimates.
result Stronger assumptions needed for O(d1/4ε−1/2) steps in Wasserstein-2 distance. Develops a nonparametric model for arbitrage-free pricing of illiquid derivatives.
problem Modeling joint dynamics of liquid vanilla options for arbitrage-free pricing of illiquid derivatives.
method Derives a state space for prices respecting underlying financial constraints using neural networks and imposes constraints to preserve no-arbitrage conditions.
result Neural SDE models are guaranteed to satisfy a set of linear inequalities and validated with numerical experiments.
In this paper we introduce a new multilevel Monte Carlo (MLMC) estimator for multi-dimensional SDEs driven by Brownian motions. Giles has previously shown that if we combine a numerical approximation with strong order of convergence O(Δt) with MLMC we can reduce the computational complexity to estimate expected value…
AdjointDEIS simplifies diffusion model optimization.
problem Optimizing diffusion models with respect to a differentiable metric.
method Novel bespoke ODE solvers for continuous adjoint equations.
result Continuous adjoint equations simplify to a simple ODE, improving efficiency.
New framework for Bayesian inference using neural Schrödinger-Föllmer flows.
problem Approximate Bayesian inference in large datasets.
method Stochastic control, Schrödinger bridges, SDE-based models.
result Advocates stochastic control as a finite time and low variance alternative to SGLD.
New model solves complex SDEs with high-dimensional spatial and stochastic spaces.
problem Solving SDEs with high-dimensional spatial and stochastic spaces.
method Physics-informed deep generative model (sPI-GeM) combining PI-BasisNet and PI-GeM.
result Scalable solution for high-dimensional SDE problems.
Develops a deterministic method to approximate NSDEs for better uncertainty quantification.
problem Computational infeasibility of obtaining well-calibrated uncertainty from NSDEs.
method Bidimensional moment matching algorithm for approximating NSDE transition kernel.
result Deterministic approximation improves uncertainty calibration and prediction accuracy.