Differentiable programming aids in solving differential equations and their sensitivities.
problem Computing gradients of numerical solutions of differential equations.
method Review of existing techniques and mathematical foundations.
result Established a coherent framework for combining differential equations with data-driven approaches.
Proposes a method to train neural networks that solve differential equations faster.
problem Training neural networks that solve differential equations becomes computationally expensive.
method Introduces a differentiable surrogate for numerical solver time cost using higher-order derivatives.
result Trains models that are faster to solve while maintaining nearly the same accuracy.
FBSJNN solves PIDEs and FBSDEJs with deep learning, offering theoretical and numerical efficiency.
problem Solving Partial Integro-Differential Equations and Forward-Backward Stochastic Differential Equations with Jumps.
method FBSJNN framework using a single neural network for both solution approximation and non-local integral.
result FBSJNN achieves numerical solutions with a relative error of 10−3, demonstrating efficiency. Study efficient numerical methods for American basket options.
problem Valuation of American basket options.
method Partial differential complementarity problems (PDCPs) and efficient discretization.
result Approximations of American basket options are close and converge favourably.
Probabilistic numerics expands numerical tasks with black box methods.
problem Difficult conditioning of random variables in numerical tasks.
method Construct probabilistic numerical methods based on final outputs, extrapolating limiting quantities.
result Higher orders of convergence achieved in various numerical tasks.
We propose a new method for the numerical solution of backward stochastic differential equations (BSDEs) which finds its roots in Fourier analysis. The method consists of an Euler time discretization of the BSDE with certain conditional expectations expressed in terms of Fourier transforms and computed using the fast F…
This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic partial differential equations and forward-backward stochastic differential equat…
In this paper, we introduce a large class of convergent numerical methods, based on (linear) basis function regression technique, to approximate the solution to a forward-backward stochastic differential equation with jumps (FBSDEJ hereafter). Numerical experiment shows good applicability of the proposed method.
Paper introduces a differentiable regularizer for condition number to improve neural network stability.
problem Maintaining numerical stability in neural networks to ensure reliable and performant models.
method Introduces a novel differentiable regularizer for the condition number of weight matrices.
result Derives a differentiable formula for the gradient of the regularizer, promoting matrices with low condition numbers.
Unified framework for Gaussian process methods in differential equations.
problem Fragmented approaches to Gaussian process methods in differential equations.
method Unified Bayesian perspective integrating differential equation constraints.
result Consolidation of existing methods and foundation for future research.
Develops numerical methods for PDEs on hypergraphs and networks.
problem Solving PDEs on complex geometric structures like hypergraphs and networks.
method Hybrid finite element methods, focusing on hybrid discontinuous Galerkin methods.
result Derives numerical approximations for PDEs on hypergraphs and networks.
Study uses neural networks to solve complex equations efficiently.
problem Solving parametric partial differential equations.
method Machine learning and deep neural networks.
result Performance of the model is independent of parameter space dimension.
New method discovers symmetries in differential equations from data.
problem Directly identifying Lie symmetries from scattered data without explicit equations.
method Numerical scheme using manifold learning and linear system construction.
result Accuracy and robustness demonstrated in various differential equations.
Study on Wasserstein distance for numerical approximations of stochastic differential equations.
problem Estimating the Wasserstein distance between stochastic differential equation distributions and their numerical approximations.
method Unified framework for analyzing different integrators and a novel splitting method for underdamped Langevin dynamics.
result A novel splitting method for underdamped Langevin dynamics with optimal complexity.
Study evaluates and compares numerical differentiation methods on three case studies.
problem Evaluating and comparing numerical differentiation methods for efficiency.
method Forward, Backward, and Centered Finite-Difference methods applied at two levels of precision.
result Different methods perform differently across case studies, with varying levels of computational cost and accuracy.
Improves privacy amplification by shuffling for differential privacy.
problem Enhancing privacy guarantees in systems with anonymous data contributions.
method Theoretical and numerical analysis of Rényi differential privacy parameters and privacy amplification by shuffling.
result First asymptotically optimal analysis of Rényi differential privacy parameters for shuffled outputs.
Probabilistic method combines space and time uncertainties in PDEs.
problem Separate treatment of space and time in PDE solvers obscures interactions and error quantification.
method Gaussian process interpretation of finite difference methods interacting with probabilistic ODE solvers.
result Joint quantification of space- and time-uncertainty possible without sacrificing ODE solver performance.
Prob-GParareal adds uncertainty quantification to PinT solvers for differential equations.
problem Uncertainty in numerical solutions of differential equations.
method Prob-GParareal uses Gaussian processes to model Parareal correction function, providing probabilistic forecasts.
result Prob-GParareal yields accurate and robust probabilistic forecasts on various ODE systems.
In the 80's H. Masur and W. Veech defined two numerical invariants of strata of abelian differentials: the volume and the Siegel-Veech constant. Based on numerical experiments, A. Eskin and A. Zorich proposed a series of conjectures for the large genus asymptotics of these invariants. By a careful analysis of the asymp…
In this paper we propose a new kind of high order numerical scheme for backward stochastic differential equations(BSDEs). Unlike the traditional θ-scheme, we reduce truncation errors by taking θ carefully for every subinterval according to the characteristics of integrands. We give error estimates of this nonlinear…
We apply results of Malliavin-Thalmaier-Watanabe for strong and weak Taylor expansions of solutions of perturbed stochastic differential equations (SDEs). In particular, we work out weight expressions for the Taylor coefficients of the expansion. The results are applied to LIBOR market models in order to deal with the …
Study methods to recover unknown processes in PDEs from data.
problem Identifying unknown processes in time-dependent PDEs using observational data.
method Theoretical analysis and numerical approaches including Galerkin and collocation algorithms.
result The Galerkin algorithm is more suitable for practical situations with noisy data.
Numerical experiments support conjecture about opers and nonabelian Hodge.
problem Testing predictions of Gaiotto-Moore-Neitzke and Gaiotto conjectures.
method Numerical experiments on polynomial holomorphic differentials.
result Supports conjectural formulas for Stokes data and Hitchin metric tensor.
Neural networks solve SPDEs using Wiener chaos expansion.
problem Solving stochastic partial differential equations (SPDEs) numerically.
method Using neural networks in the truncated Wiener chaos expansion.
result Approximation rates for learning SPDE solutions with noise.
We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes, by construction, are designed to deal with cases where: (1) all we observe are …
Fenrir uses probabilistic numerics to simplify solving initial value problems.
problem Solving initial value problems in ordinary differential equations.
method Probabilistic numerics and Gauss--Markov regression.
result The method simplifies parameter estimation in ODEs, making it easier and more robust.
Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for solving forward and inverse problems associated with partial differential equati…
We deliver a call to arms for probabilistic numerical methods: algorithms for numerical tasks, including linear algebra, integration, optimization and solving differential equations, that return uncertainties in their calculations. Such uncertainties, arising from the loss of precision induced by numerical calculation …
Deep learning solves high-dimensional PDEs efficiently.
problem Solving high-dimensional Kolmogorov PDEs numerically.
method Reformulating as a statistical learning problem using Feynman-Kac formula.
result Single neural network learns entire family of PDEs.
New method combines ODE solvers with Bayesian inference for efficient model training.
problem Combining ODE solvers with Bayesian inference for efficient model training.
method Probabilistic state space model using extended Kalman filter for joint inference from differential equations and data.
result Efficient approximate Bayesian inference on latent force and ODE solution.
GPU speeds up Monte Carlo simulations for large time steps.
problem Slow convergence and inaccurate solutions with large time steps in Monte Carlo simulations.
method Generalizes the Seven League scheme for GPU acceleration.
result Significantly improved computational speed.
The paper improves ODE solvers by integrating diverse information types.
problem Improving accuracy and physical meaningfulness of ODE solutions.
method Leveraging probabilistic solvers to include second-order information and physical conservation laws.
result Solutions become more accurate and physically meaningful with additional information.
Automatic differentiation is involved for long in applied mathematics as an alternative to finite difference to improve the accuracy of numerical computation of derivatives. Each time a numerical minimization is involved, automatic differentiation can be used. In between formal derivation and standard numerical schemes…
New ADANNs improve PDE approximations.
problem Approximating operators for parametric PDEs.
method Custom ANN architectures and initialization schemes.
result ADANNs significantly outperform existing methods.
We propose a new algorithm for solving parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) in high dimension, by making an analogy between the BSDE and reinforcement learning with the gradient of the solution playing the role of the policy function, and the loss functi…
DEQGAN uses GANs to solve differential equations without supervision.
problem Solving differential equations with neural networks.
method Generative Adversarial Networks (GANs) to learn the loss function.
result DEQGAN achieves lower mean squared errors and competitive solution accuracy compared to traditional methods.
We propose a numerical algorithm for backward stochastic differential equations based on time discretization and trigonometric wavelets. This method combines the effectiveness of Fourier-based methods and the simplicity of a wavelet-based formula, resulting in an algorithm that is both accurate and easy to implement. F…
PNDEs project neural dynamics onto constraint manifolds, improving accuracy and stability.
problem Learning dynamics from data without violating known constraints.
method Projecting the learned vector field onto the tangent space of the constraint manifold.
result PNDEs outperform existing methods in learning constrained dynamical systems.
This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional construction and employs least-squares functionals as loss functions to determine para…
Efficiently solves high-dimensional ODEs with probabilistic methods.
problem Solving high-dimensional ODEs with uncertainty quantification.
method Probabilistic numerical algorithm based on independence assumptions or Kronecker structure.
result Efficient probabilistic solutions for ODEs with millions of dimensions.
We introduce a novel numerical approach for a class of stochastic dynamic programs which arise as discretizations of backward stochastic differential equations or semi-linear partial differential equations. Solving such dynamic programs numerically requires the approximation of nested conditional expectations, i.e., it…
A new algorithm solves high-dimensional nonlinear BSDEs using deep learning.
problem Solving high-dimensional nonlinear backward stochastic differential equations (BSDEs).
method Backward differential deep learning, reformulating BSDEs as differential deep learning problems, using Malliavin calculus, discretizing integrals with Euler-Maruyama method, approximating processes with DNNs, backwardly optimizing DNN parameters.
result The proposed algorithm efficiently approximates solutions and their derivatives for high-dimensional BSDEs.
CoLA automates efficient numerical linear algebra for complex matrix structures.
problem Efficiently solving large-scale linear algebra problems with complex matrix structures.
method Combining linear operator abstraction with compositional dispatch rules.
result Automatic and efficient numerical algorithms for various linear algebra operations.
New method uses tensor trains for efficient PDE approximation.
problem High-dimensional PDEs and the curse of dimensionality.
method Tensor trains and backward stochastic differential equations for parabolic PDEs.
result Achieves a favorable trade-off between accuracy and computational efficiency.
New methods improve deep learning for solving linear PDEs.
problem Efficiently solving high-dimensional linear PDEs using deep learning.
method Rigorous investigation of gradient estimators for SDE-based variational formulations.
result Novel methods provide substantial performance improvements.
A new method speeds up option pricing under Heston's stochastic volatility model.
problem Speeding up option pricing under the Heston model.
method Iterative splitting method applied to a two-dimensional PDE.
result The iterative splitting method provides more accurate option prices and Greeks compared to traditional methods.
We introduce a new strategy designed to help physicists discover hidden laws governing dynamical systems. We propose to use machine learning automatic differentiation libraries to develop hybrid numerical models that combine components based on prior physical knowledge with components based on neural networks. In these…
In our work, we bridge deep neural network design with numerical differential equations. We show that many effective networks, such as ResNet, PolyNet, FractalNet and RevNet, can be interpreted as different numerical discretizations of differential equations. This finding brings us a brand new perspective on the design…