This paper tackles infinite-dimensional diffusion bridge simulation using operator learning.
problem Challenges in simulating diffusion bridges for modeling natural data due to intractable drift terms and continuous data representations.
method Merges score matching techniques with operator learning to directly learn infinite-dimensional bridges.
result Demonstrates high efficacy in simulating diffusion bridges for various applications, including real-world biological data.
Infinite-dimensional diffusion models tackle generative tasks for complex data.
problem Challenges in applying diffusion models to infinite-dimensional data.
method Directly formulate diffusion-based generative models in infinite dimensions.
result Developed guidelines for designing infinite-dimensional diffusion models.
Infinite-dimensional SBDMs improve image generation across multiple resolutions.
problem Efficient image generation at high resolutions and across different levels.
method Developed SBDMs in infinite-dimensional setting, using trace class operators and operator networks.
result Improved efficiency and generalization across resolution levels.
FDPs generalize diffusion models to function spaces, enabling efficient image generation.
problem Efficiently generating images from continuous data.
method Introducing FDPs with new mathematical frameworks and training objectives.
result FDPs achieve high-quality image generation with fewer parameters.
Derives PF-ODE for infinite-dimensional functions, improving function generation tasks.
problem Efficient inference in infinite-dimensional diffusion models.
method Derives PF-ODE in infinite-dimensional function spaces.
result Reduces function evaluations while maintaining sample quality.
Adjoint sampler targets infinite-dimensional function spaces for efficient sampling.
problem Limited theory and algorithms for sampling infinite-dimensional function spaces.
method Adjoint Sampler for infinite-dimensional function spaces based on stochastic maximum principle.
result FAS achieves superior performance in synthetic and real systems.
Infinite dimensional measure-valued processes modeled as polynomial diffusions.
problem Modeling term structure in energy markets using measure-valued polynomial diffusions.
method Introduced measure-valued polynomial diffusions, derived moment formulas, and characterized infinitesimal generators.
result Recovery of measure-valued affine diffusions as a special case.
We extend diffusion models to function spaces and introduce a new method for sampling from posterior distributions.
problem Sampling from posterior distributions in infinite-dimensional function spaces using diffusion models.
method Infinite-dimensional extension of Doob's h-transform, Supervised Guidance Training for efficient sampling. result We prove that diffusion models can be conditioned to sample from posterior distributions and introduce a simulation-free score matching objective.
Paper introduces infinite-dimensional generative models using Doob's h-transform.
problem Defining generative models in infinite dimensions.
method Using Doob's h-transform to force a reference diffusion towards a target distribution.
result The forced process can be approximated by minimising a score-matching objective.
This paper conditions non-linear infinite-dimensional diffusion processes.
problem Conditioning non-linear and infinite-dimensional diffusion processes.
method Infinite-dimensional Girsanov's theorem to condition function-valued stochastic processes.
result Conditioning of non-linear infinite-dimensional diffusion processes is achieved.
We introduce cylindrical projections to simulate infinite-dimensional occupation flows of diffusions.
problem Computational intractability of infinite-dimensional occupation flows of diffusions.
method Introduce cylindrical projections to approximate the occupation flow via a finite-dimensional system.
result Strong convergence of cylindrical projections to the initial process with derived rates.
Method solves Bayesian inverse problems in function space without assuming log-concavity.
problem Bayesian inverse problems in infinite-dimensional nonlinear settings.
method Score-based diffusion models as a prior, Langevin-type MCMC on function spaces.
result Provable convergence bound for posterior sampling, dependent on score approximation.
Review of diffusion models for SBI in non-ideal data scenarios.
problem Inference of parameters from complex simulation outputs with intractable likelihoods.
method Diffusion models for likelihood-free inference, addressing model misspecification, unstructured observations, and missing data.
result Improved robustness and efficiency in SBI methods for non-ideal data scenarios.
Abstract: Generalizes SGMs to infinite-dimensional Hilbertian setting.
problem Difficulties in extending SGMs to infinite-dimensional settings.
method Uses Gamma and Malliavin Calculus, Dirichlet forms, Wiener chaoses, and time-reversal formula.
result Generalized SGMs to Hilbertian setting with finite-dimensional entropic convergence bounds.
Starting from a sequence of independent Wright-Fisher diffusion processes on [0,1], we construct a class of reversible infinite dimensional diffusion processes on $\DD_\infty:= \{{\bf x}\in Let $MbeacompleteRiemnnianmanifoldandμthedistributionofthediffusionprocessgeneratedby\ff 1 2\DD+ZwhereZ$…
New method modifies diffusions for singular rewards.
problem Handling singular rewards in diffusions.
method Malliavin calculus for non-differentiable rewards.
result Stable and reliable training of diffusions.
New method for Bayesian inference in infinite dimensions using SDMs.
problem Bayesian inference in infinite-dimensional function spaces.
method Amortized conditional score-based diffusion models (SDMs).
result Validated approach for large-scale, discretization-invariant Bayesian inference.
This paper derives a diffusion approximation for a sequence of discrete-time one-sided limit order book models with non-linear state dependent order arrival and cancellation dynamics. The discrete time sequences are specified in terms of an R+-valued best bid price process and an Lloc2-valued volume process. …
A new method optimizes diffusion models for fine-tuning tasks efficiently.
problem Optimizing diffusion models for downstream tasks using nested bilevel structures.
method Formalizes the challenge as a generative bilevel optimization problem and introduces a first-order bilevel framework.
result Our method outperforms existing fine-tuning and hyperparameter search baselines.
Study of LQ MFGs in infinite-dimensional Hilbert spaces.
problem Mean field games in infinite-dimensional settings with stochastic dynamics.
method Analysis of coupled semilinear infinite-dimensional stochastic evolution equations, development of Nash equilibrium.
result Characterization of unique Nash equilibrium in the limit of many agents.
In mathematical Finance calculating the Greeks by Malliavin weights has proved to be a numerically satisfactory procedure for finite-dimensional Itô-diffusions. The existence of Malliavin weights relies on absolute continuity of laws of the projected diffusion process and a sufficiently regular density. In this article…
Extends diffusion models to non-Euclidean spaces with geometric priors.
problem Difficulties in natural sciences with symmetries and non-Euclidean data.
method Constructs a noising process and neural network equivariant to symmetry group, approximates score function.
result Model can generate complex scalar and vector fields on synthetic and real-world data.
This work bridges stochastic interpolants to infinite-dimensional Hilbert spaces.
problem Limited flexibility in generating arbitrary distributions for function-valued data.
method Establishes a rigorous framework for stochastic interpolants in infinite-dimensional Hilbert spaces.
result Achieves state-of-the-art results in conditional generation for complex PDE-based benchmarks.
Diffusion Maps improves on Functional PCA for non-linear functional data.
problem Functional PCA's linear manifold assumption fails for non-linear functional data.
method Extends Diffusion Maps to functional data and compares it to Functional PCA.
result Diffusion Maps outperforms Functional PCA in non-linear functional data analysis.
Riemannian stochastic gradient descent approximates a diffusion process called Riemannian stochastic modified flow.
problem Improving convergence rate of Riemannian stochastic gradient descent.
method Using stochastic differential geometry, the paper shows RSGD can be approximated by the Riemannian stochastic modified flow (RSMF).
result RSGD can be approximated by the solution to the RSMF driven by an infinite-dimensional Wiener process, increasing the order of approximation.
We introduce a class of probability measure-valued diffusions, coined polynomial, of which the well-known Fleming--Viot process is a particular example. The defining property of finite dimensional polynomial processes considered by Cuchiero et al. (2012) and Filipovic and Larsson (2016) is transferred to this infinite …
FunDPS improves PDE solution recovery from sparse data.
problem Recovering whole solutions from sparse or noisy measurements in PDEs.
method Function-space diffusion model with gradient-based guidance.
result FunDPS achieves 32% accuracy improvement over state-of-the-art methods.
We present the method of moments approach to pricing barrier-type options when the underlying is modelled by a general class of jump diffusions. By general principles the option prices are linked to certain infinite dimensional linear programming problems. Subsequently approximating those systems by finite dimensional …
The paper studies stochastic optimization on matrices and its limits as dimensions grow.
problem Optimizing functions on large symmetric matrices using stochastic gradient descent.
method Deterministic limits of random curves on matrices, using graphons and stochastic differential equations.
result The limit is a gradient flow on graphons, extending classical McKean-Vlasov limits.
We study the forward price dynamics in commodity markets realized as a process with values in a Hilbert space of absolutely continuous functions defined by Filipović. The forward dynamics are defined as the mild solution of a certain stochastic partial differential equation driven by an infinite dimensional Lévy proces…
This work extends diffusion models to function space for better generative modeling.
problem Limited applicability of diffusion models to functional data domains.
method Introduces Denoising Diffusion Operators (DDOs) for training diffusion models in function space.
result Demonstrates accurate function-valued generation at fixed cost.
UCoS avoids forward model evaluations in sampling for large-scale linear inverse problems.
problem Efficient sampling from posterior distributions in large-scale linear inverse problems.
method UCoS approach that learns a task-dependent score function offline and uses affine transformations to derive the conditional score.
result UCoS eliminates the need for forward model evaluations during sampling, making it more efficient.
The model uses signatures to accurately calibrate SPX and VIX options without jumps or rough volatility.
problem Joint calibration of SPX and VIX options without jumps or rough volatility.
method The approach uses a stochastic volatility model with signatures of polynomial diffusions to price and calibrate SPX and VIX options.
result Highly accurate calibration results for SPX and VIX options without adding jumps or rough volatility.
In this paper we derive a scaling limit for an infinite dimensional limit order book model driven by Hawkes random measures. The dynamics of the incoming order flow is allowed to depend on the current market price as well as on a volume indicator. With our choice of scaling the dynamics converges to a coupled SDE-ODE s…
MF-PID uses interacting samples to efficiently transport probability mass.
problem Efficiently transporting probability mass in generative models.
method Introducing Mean-Field Path-Integral Diffusion (MF-PID) where samples become interacting agents.
result MF-PID achieves 19-24% reductions in control energy for demand-response control of energy systems.
Bayesian nonparametric models get better posterior estimates via SPDE methods.
problem Estimating posterior distributions in nonparametric Bayesian models.
method Extending diffusion methods to SPDEs on Hilbert spaces for posterior contraction and Laplace approximation.
result Derivation of posterior contraction rates and finite-sample Bernstein von Mises results.
Most Finsler metrics have infinite-dimensional holonomy groups.
problem Understanding the holonomy groups of Finsler metrics.
method Analyzing the set of Finsler metrics on a manifold.
result An open dense subset of Finsler metrics have infinite-dimensional holonomy groups.
Study on infinite-dimensional Heisenberg groups using hypoelliptic heat kernels.
problem Properties of hypoelliptic heat kernels on infinite-dimensional reduced Heisenberg groups.
method Construction and study of hypoelliptic heat kernels on infinite-dimensional reduced Heisenberg groups.
result Hypoelliptic logarithmic Sobolev inequalities on the space.
This paper analyzes MCMC algorithms on large graphs using Dirichlet forms.
problem Analyzing the behavior of MCMC algorithms in high-dimensional problems.
method Utilizes Mosco convergence of Dirichlet forms to study RWM algorithm on large graphs.
result Demonstrates the advantages of Dirichlet form approach over standard diffusion methods.
Neural operators correct PDE residuals to improve BIP solutions.
problem Reducing error in infinite-dimensional Bayesian inverse problems with neural operators.
method Error correction using PDE residuals to improve neural operator approximation.
result Trained neural operators with error correction achieve a quadratic reduction in approximation error.
The paper reformulates U-Nets as wavelet-based models and applies this to hierarchical VAEs.
problem Theoretical understanding and regularization properties of U-Nets and their relationship to wavelets.
method Formulating a multi-resolution framework to identify U-Nets as finite-dimensional truncations of infinite-dimensional models, proving average pooling corresponds to projection, and identifying HVAEs as discretizations of multi-resolution diffusion processes.
result HVAEs learn a time representation allowing for improved parameter efficiency through weight-sharing.
Derives scaling limits and fluctuations for SGD in high dimensions.
problem Understanding SGD behavior in high-dimensional settings with varying noise levels.
method Interacting particle system approach, treating SGD iterates as such, with covariance structure considered.
result Precise three-step phase transition observed in SGD behavior: ballistic, diffusive, then random.
Smooth structures on infinite dimensional Grassmannians and non-commutative cross-ratios.
problem Smooth structures on infinite dimensional Grassmannians and non-commutative cross-ratios.
method Analyzing and expanding the notion of non-commutative cross-ratios, proving their smoothness.
result Smoothness of non-commutative cross-ratios.
Proves uniqueness of embedding complex manifold into infinite-dimensional space.
problem Balanced embedding of non-compact complex manifold into infinite-dimensional projective space.
method Fine estimates of asymptotics of a balanced embedding.
result Uniqueness of embedding proven.
A scalable algorithm approximates Bayesian posteriors in RKHS with improved efficiency.
problem Scalable inference for Bayes posteriors in infinite-dimensional spaces.
method Approximate Langevin diffusion projection onto first M components, using law of total probability and sufficiency assumption.
result The method recovers SVGP as a special case and is provably close to optimal for convex and Lipschitz continuous likelihoods.
The paper extends Cartan development to infinite dimensional Lie groups.
problem Generalizing Cartan development to infinite dimensional Lie groups.
method Generalization of Cartan development to infinite dimensional manifolds and Lie groups.
result The tangent mapping of a Cartan development is another Cartan development.
The paper explores infinite-dimensional nonholonomic and vakonomic systems.
problem Understanding dynamics of infinite-dimensional systems with constraints.
method Visualizing and revisiting classical and new examples of nonholonomic and vakonomic systems.
result Infinite-dimensional systems exhibit both nonholonomic and vakonomic dynamics.
Adaptive operator learning reduces costs in Bayesian inverse problems.
problem Reducing computational costs in Bayesian inverse problems governed by PDEs.
method Adaptive operator learning framework that gradually reduces modeling error.
result The approach significantly reduces computational costs while maintaining inversion accuracy.