SING improves state inference in latent SDE models for better drift function estimation.
problem Intractable posterior inference in latent SDE models.
method Natural gradient variational inference.
result SING provides faster and more reliable inference in latent SDE models.
New method speeds up SDE inference by matching moments to FPK equation.
problem Efficiency of sampling schemes in high-dimensional SDEs.
method Direct approximation of Fokker-Planck-Kolmogorov equation by matching moments.
result Fast, scalable inference in high-dimensional latent spaces.
Efficiently infers latent SDEs with scalable memory and time costs.
problem Inference of latent SDEs with high time and memory complexity.
method Amortized reparametrization of expectations under linear SDEs, coupled with efficient gradient approximation.
result Achieves similar performance to adjoint sensitivities with fewer model evaluations.
Simulation-free VI closes the approximation gap in latent SDEs
problem Recovering dynamical systems from noisy observations
method Helmholtz-SDE
result Recovers dynamics more faithfully than prior methods
Stochastic normalizing flows use SDEs for efficient training and sampling.
problem Efficient maximum likelihood estimation and variational inference.
method Continuous normalizing flows extended with stochastic differential equations (SDEs) and rough path theory.
result Stochastic normalizing flows enable efficient training and sampling from complex distributions.
We develop a variational framework for SDEs driven by fractional noise.
problem Capturing long-term dependencies in SDEs driven by fractional noise.
method Markov approximation of fractional Brownian motion, variational inference, neural networks.
result Efficient variational inference of posterior path measures for neural-SDEs.
The paper identifies generators of linear SDEs with noise types.
problem Identifying the generator of linear SDEs from their solution distribution.
method Deriving sufficient and necessary conditions for additive noise, and sufficient conditions for multiplicative noise.
result Generic conditions for identifying the generator of linear SDEs with both types of noise.
New method for Bayesian inference of Lévy-driven SDEs with jumps.
problem Bayesian inference for Lévy-driven SDEs is challenging due to discontinuities and heavy tails.
method Neural exponential tilting framework for variational inference.
result Accurately captures jump dynamics and reliable posterior inference in heavy-tailed regimes.
Novel method for SDE calibration from sparse data using neural flows.
problem Calibrating SDEs from sparse, noisy observations.
method Characterization of posterior SDE using neural networks trained to solve a PDE with multiplicative updates.
result Significant improvement in scalability and accuracy compared to classical methods.
New method identifies drift and diffusivity from SDE marginals.
problem Challenging task to identify drift and diffusion from SDE population dynamics.
method Proposes nn-APPEX, a Schrodinger Bridge-based inference method.
result Gradient-flow drift and Brownian diffusivity jointly identifiable from marginals.
ISALT uses inference to simulate SDEs with large time-steps, improving efficiency.
problem Efficiently simulating ergodic SDEs with large time-steps.
method Inference-based schemes adaptive to large time-steps (ISALT) from data.
result ISALT achieves significant time reduction and optimal accuracy.
A new framework models uncertainty in structured temporal data using SDEs and neural networks.
problem Uncertainty quantification in machine learning applications involving structured and temporal data.
method Integrates stochastic differential equations (SDEs) with deep generative models in a variational autoencoder framework.
result Improves uncertainty quantification in machine learning applications involving structured and temporal data.
New framework for Bayesian inference using neural Schrödinger-Föllmer flows.
problem Approximate Bayesian inference in large datasets.
method Stochastic control, Schrödinger bridges, SDE-based models.
result Advocates stochastic control as a finite time and low variance alternative to SGLD.
Proposes methods to include distributional information in MV-SDEs for better modeling of interacting particle systems.
problem Modeling the behavior of an infinite number of interacting particles with distributional information.
method Semi-parametric methods and estimators for MV-SDEs.
result Explicitly including distributional dependence improves performance in modeling temporal data with interaction.
NSFs learn SDE transition laws for efficient sampling.
problem Efficiently sampling between arbitrary time points in SDEs.
method Conditional normalising flows with architectural constraints.
result Up to two orders of magnitude speed-ups at large time gaps.
SCOTCH learns system structure from irregular time series using neural SDEs.
problem Learning system structure from irregular time series data.
method SCOTCH uses neural stochastic differential equations (SDE) with variational inference.
result SCOTCH improves structure learning performance on synthetic and real-world datasets.
New algorithm infers trajectories from partial observations using optimal transport.
problem Inferring trajectories from partial observations of coupled systems.
method Extends MFL algorithm to latent SDEs using observable state space models and partial observations.
result Experiments show significant outperformance over latent-free baseline.
TCNF models SDEs using time deformation of Brownian motion.
problem Modeling SDEs with existing methods.
method Time-changed normalizing flows (TCNF) based on time deformation of Brownian motion.
result Improved modeling of SDEs, including Ornstein-Uhlenbeck process.
Study improves parameter estimation for SDEs driven by Levy noise.
problem Challenges in estimating parameters of SDEs with non-Gaussian noises.
method Introduces PEnet, a CNN-LSTM model for efficient parameter estimation.
result PEnet offers superior accuracy and adaptability for various SDE scenarios.
The paper develops CI tests for causal discovery in SDEs.
problem Inferring causal structure from stochastic dynamical systems.
method Developed CI constraints and a CI test for SDEs.
result Proposed CI test outperforms existing methods.
Neural Diffusion Intensity Models simplify Cox processes inference.
problem Intractable nonparametric estimation and posterior inference of latent stochastic intensity in Cox processes.
method Variational framework using neural SDEs, with theoretical guarantee of ELBO maximization coinciding with maximum likelihood estimation.
result Accurate recovery of latent intensity dynamics and posterior paths with significant speedup.
Itô maps provide a method for any-step SDE integration.
problem Stochastic dynamics
method Itô map formulation
result Empirical results on synthetic and image-generation benchmarks
This paper studies Thompson sampling's arm-pull dynamics and inference, revealing key differences from UCB algorithms.
problem Understanding the precise arm-pull dynamics in Thompson sampling algorithms.
method Developed new approaches to analyze the arm-pull count process and noise processes, including inverse process and reparametrization methods.
result Arm-pull count is asymptotically deterministic only for suboptimal or unique optimal arms, revealing a unifying principle of stability.
In deep latent Gaussian models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small independent Gaussian perturbation. This work considers the diffusion limit of suc…
SigMA uses signatures and attention to estimate parameters in fBm-driven SDEs.
problem Estimating parameters in SDEs driven by fBm is challenging due to non-Markovian and semimartingale issues.
method SigMA integrates path signatures with multi-head self-attention, using convolutional and MLP layers.
result SigMA outperforms other methods in accuracy, robustness, and model compactness.
Develops a nonparametric model for arbitrage-free pricing of illiquid derivatives.
problem Modeling joint dynamics of liquid vanilla options for arbitrage-free pricing of illiquid derivatives.
method Derives a state space for prices respecting underlying financial constraints using neural networks and imposes constraints to preserve no-arbitrage conditions.
result Neural SDE models are guaranteed to satisfy a set of linear inequalities and validated with numerical experiments.
New method DDVI improves posterior inference for deep Gaussian processes.
problem Inference of inducing points in DGPs is challenging and biased.
method DDVI uses denoising diffusion SDE and score matching for posterior approximation.
result Empirically shows DDVI outperforms baseline methods in inducing point inference.
New method learns SDEs with structured noise from data.
problem Learning SDEs with structured noise from data.
method Nonparametric framework for drift and diffusion terms.
result Accurately infers low-dimensional interaction kernels.
Unified framework for SDMs and GANs with improved sampling and quality.
problem Limitations of SDMs and GANs in achieving fast sampling and high sample quality.
method Introducing a novel SDE named DiffFlow to describe the learning dynamics of SDMs and GANs, and proving the asymptotic optimality and maximal likelihood training scheme.
result Unified framework allows smooth transition between SDMs and GANs with flexible trade-off between sample quality and speed.
SDE Matching eliminates simulation for training Latent SDEs, achieving similar performance.
problem Training Latent SDEs with adjoint sensitivity methods is computationally expensive and limited.
method SDE Matching, inspired by Score- and Flow Matching, eliminates simulation for training Latent SDEs.
result SDE Matching achieves performance comparable to adjoint sensitivity methods while reducing computational complexity.
PMM uses Bayesian inference to generate data from noisy approximations.
problem Creating flexible generative models for various data types.
method Bayesian inference and conjugate pairs of distributions.
result PMM achieves performance competitive with existing generative models.
New SDEs use G-Brownian motion, extending mean-field models.
problem Extending mean-field models to new types of stochastic processes.
method Introduced G-SDEs with coefficients dependent on current state and solution as random variable. result Validated new SDE framework for complex stochastic systems.
GraphBSI generates graphs by refining a belief in continuous space, outperforming existing models.
problem Generating discrete, unordered graph data is challenging for traditional models.
method GraphBSI uses Bayesian Sample Inference (BSI) to iteratively refine a belief over graph distribution parameters.
result GraphBSI outperforms existing one-shot graph generative models on molecular and synthetic graph generation benchmarks.
A new framework using kernel packets overcomes limitations of state space models for multi-dimensional data.
problem Computational limitations of Gaussian process regression in large-scale applications.
method Kernel packet approach, identifying KPs via forward and backward state space representations.
result Exact, memory-efficient inference with linear-time training and logarithmic/predictive time.
Sig-DEG speeds up diffusion models by distilling them into faster approximations.
problem Computational intensity of diffusion models at inference time.
method Signature-based differential equation generation to summarize Brownian motion.
result Sig-DEG reduces inference steps by an order of magnitude while maintaining generation quality.
New method for efficient conditional sampling from diffusion models.
problem Efficient conditional simulation from diffusion models.
method Explicit forward-backward bridging to express conditional simulation as an inference problem.
result Principled particle Gibbs and pseudo-marginal samplers for conditional distribution.
Study on the smoothness of solutions to a specific type of stochastic differential equation.
problem Regularity of solutions to mean-field G-SDEs. method Analysis of first and second order Fréchet differentiability in the random initial condition.
result Established the Fréchet differentiability of the solution and specified the corresponding equations.
New SDE model for continuous-time reinforcement learning.
problem Modeling exploration in continuous-time reinforcement learning.
method Introduced grid-sampling SDE as a proxy model.
result Wellposedness of the SDE in the presence of jumps.
This paper uses SDEs to analyze GANs training and long-run behavior.
problem Understanding the training process and long-run behavior of GANs.
method Established SDE approximations for GANs training and analyzed long-run behavior via invariant measures.
result The long-run behavior of GANs training can be studied via the invariant measures of its SDE approximations.
Monte Carlo sampling for Bayesian posterior inference is a common approach used in machine learning. The Markov Chain Monte Carlo procedures that are used are often discrete-time analogues of associated stochastic differential equations (SDEs). These SDEs are guaranteed to leave invariant the required posterior distrib…
New method estimates SDE parameters efficiently using WCE and SGD.
problem Parameter estimation for stochastic differential equations.
method Wiener Chaos Expansion and Stochastic Gradient Descent.
result Accurate parameter recovery from noisy observations.
Method learns dynamics from noisy partial observations.
problem Reconstructing stochastic dynamical systems from indirect noisy data.
method Amortized path generation method for nonlinear stochastic filtering.
result Learned conditional path generator quantifies uncertainty.
Neural networks estimate SDEs with jump noise using a Tamed-Milstein scheme.
problem Estimating drift and diffusion functions in SDEs with jump noise.
method Tamed-Milstein scheme with neural networks as non-parametric approximators.
result Flexible estimation of complex nonlinear dynamics in systems with state-dependent noise.
Sig-SDE model integrates signatures with SDEs for financial data.
problem Calibrating models to exotic financial products with non-linear dependencies.
method Integrating signatures from stochastic analysis with neural SDEs.
result Sig-SDE provides theoretical guarantees for convergence.
New method learns SDEs without integrators, speeding up computation.
problem Computational expense in learning SDEs using neural networks.
method Importance-sampling estimator for SDEs, leveraging parallelism.
result Lower-variance gradient estimates and massive computation time reductions.
We explain how Itô Stochastic Differential Equations (SDEs) on manifolds may be defined using 2-jets of smooth functions. We show how this relationship can be interpreted in terms of a convergent numerical scheme. We show how jets can be used to derive graphical representations of Itô SDEs. We show how jets can be used…
Proposes neural SDEs with change points for better time series modeling.
problem Restrictions in modeling time series with distributional shift.
method Generative adversarial networks (GANs) for SDEs and change point detection.
result Jointly learns change points and SDE model parameters.
New geometric SDEs and discretizations on Riemannian manifolds with error bounds.
problem Modeling diffusion processes on Riemannian manifolds with geometric SDEs.
method Introduced a new construction of geometric SDEs and provided non-asymptotic error bounds.
result First non-asymptotic error bound for geometric Euler-Murayama discretization.