This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
Improved hypothesis testing and change-point detection using diffusion-based methods.
problem Limited power of score-based hypothesis tests and change-point detection.
method Extending score-based Fisher divergence to diffusion-divergence by multiplying score functions with a matrix-valued function or weight matrix.
result Theoretical quantification and demonstration of optimal performance of diffusion-based algorithms.
New model learns graph spectra accurately, outperforming existing methods.
problem Graph diffusion models struggle to distinguish certain graph families and their spectra.
method Leveraged random matrix theory to analytically extract spectral properties, introducing Dyson Diffusion Model.
result Dyson Diffusion Model learns graph spectra accurately and outperforms existing models.
This paper is a further extension of the method proposed in Itkin, 2014 as applied to another set of jump-diffusion models: Inverse Normal Gaussian, Hyperbolic and Meixner. To solve the corresponding PIDEs we accomplish few steps. First, a second-order operator splitting on financial processes (diffusion and jumps) is …
Diffusion models' consistency across splits explained by random matrix theory.
problem Consistency of diffusion models trained on non-overlapping subsets.
method Random matrix theory framework to quantify dataset effects on denoiser and sampling map.
result The theory explains and predicts cross-split disagreement in diffusion models.
Develops polynomial diffusion models for multi-factor commodity futures dynamics.
problem Modeling futures prices using latent state variables for short and long-term stochastic factors.
method Polynomial diffusion models to incorporate non-linear effects, two filtering methods for estimation.
result Accurate estimation of futures prices despite parameter identification issues in polynomial diffusion models.
We propose a new, unified approach to solving jump-diffusion partial integro-differential equations (PIDEs) that often appear in mathematical finance. Our method consists of the following steps. First, a second-order operator splitting on financial processes (diffusion and jumps) is applied to these PIDEs. To solve the…
We study the small-time fluctuations for diffusion processes which are conditioned by their initial and final positions, under the assumptions that the diffusivity has a sub-Riemannian structure and that the drift vector field lies in the span of the sub-Riemannian structure. In the case where the endpoints agree and t…
The paper connects Riemannian Gaussian distributions to random matrix theory and diffusion kernels.
problem Analyzing Riemannian Gaussian distributions on symmetric spaces.
method Analytical computation of marginals using orthogonal and skew orthogonal polynomials, and diffusion kernels.
result Riemannian Gaussian distributions are random matrix types, and their probability density functions can be computed analytically.
We address the problem of likelihood based inference for correlated diffusion processes using Markov chain Monte Carlo (MCMC) techniques. Such a task presents two interesting problems. First, the construction of the MCMC scheme should ensure that the correlation coefficients are updated subject to the positive definite…
We develop continuous time Markov chain (CTMC) approximation of one-dimensional diffusions with a lower sticky boundary. Approximate solutions to the action of the Feynman-Kac operator associated with a sticky diffusion and first passage probabilities are obtained using matrix exponentials. We show how to compute matri…
Study on determinants of unitary Brownian motion and their asymptotic laws.
problem Understanding determinants of unitary Brownian motion and their behavior over time.
method Using Stiefel fibration and skew-product decomposition of the Stiefel Brownian motion.
result Prove asymptotic laws for determinants of block entries of unitary Brownian motion.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
Graph diffusion processes approximate manifold heat semigroups using graph transition matrices.
problem Approximating manifold heat semigroups from graph data under low regularity conditions.
method Iterating graph transition matrix P to approximate Qt=etΔ, bounding error in ∞-norm. result Convergence rates O(N−2/(d+6)) for manifold heat semigroup approximation, valid for in-sample and out-of-sample. Transformers interpreted as probabilistic Laplacian Eigenmaps steps.
problem Improving transformer performance through probabilistic interpretation.
method Probabilistic Laplacian Eigenmaps model derivation and graph diffusion step.
result Subtracting identity from attention matrix improves transformer performance.
Adaptive algorithm improves convergence rate of Langevin dynamics.
problem Improving convergence rate of Langevin dynamics.
method Adaptive non-reversible stochastic gradient Langevin dynamics algorithm.
result Improved convergence rate of the algorithm.
DM uses semigroup property to tune diffusion time for better data analysis.
problem Difficulty in tuning diffusion time for optimal data analysis.
method Proposes a semigroup criterion to select diffusion time.
result Effective and robust method for picking diffusion time.
A quantum state generation method that respects physical constraints.
problem Generating quantum states with complex-valued Hermitian, positive semi-definite, and trace one properties.
method Mirror diffusion model with von Neumann entropy to enforce structural constraints.
result Demonstrated effective generation of quantum states with conditional guidance.
New method improves sampling from high-dimensional target densities.
problem Sampling from high-dimensional target densities using Monte Carlo algorithms.
method Extends Metropolis-Adjusted Langevin Diffusion algorithm with random precondition matrix modeling.
result Significantly improves performance and computational efficiency over standard MCMC methods.
Survey of Laplacian-based methods for data dimensionality reduction and embedding.
problem Efficiently reducing high-dimensional data to lower dimensions while preserving important features and structures.
method Laplacian-based methods including spectral clustering, Laplacian eigenmap, locality preserving projection, graph embedding, and diffusion map.
result Comprehensive overview of various optimization variants and applications of Laplacian-based techniques.
Quaternionic Brownian motion on flag manifold linked to sphere diffusion.
problem Modeling quaternionic stochastic areas on quaternionic flag manifolds.
method Relating quaternionic Brownian motion to symplectic Brownian motion and using radial dynamics.
result Quaternionic stochastic areas follow a multivariate normal distribution.
AdaCAD improves semi-supervised classification by focusing on intra-class nodes.
problem Improving semi-supervised classification by addressing inter-class connections in graphs.
method AdaCAD uses a class-attentive diffusion process to adaptively aggregate nodes based on their class similarity.
result AdaCAD significantly outperforms state-of-the-art methods in semi-supervised classification.
We study Langevin diffusion for nonconvex functions with manifold structure.
problem Sampling from distributions with nonconvex functions and manifolds of equal probability.
method Prove mixing time bounds for Langevin diffusion using manifold geometry, specialize to matrix factorization problems.
result Langevin diffusion mixes rapidly on manifolds of equal probability in nonconvex functions.
High-dimensional curved diffusions show abrupt convergence at a critical time.
problem Understanding abrupt convergence in high-dimensional curved diffusions.
method Functional inequalities and spectral rigidity.
result Abrupt convergence (cutoff) occurs in high dimensions, linked to spectral rigidity.
Study provides error estimates for approximating game options with diffusion asset prices.
problem Approximating fair prices of game options with diffusion asset prices.
method Error estimates for discrete approximations of diffusion processes, applied to game options.
result Effective tool for computing fair prices of game options in multi-asset markets.
Due to recent explosion of text data, researchers have been overwhelmed by ever-increasing volume of articles produced by different research communities. Various scholarly search websites, citation recommendation engines, and research databases have been created to simplify the text search tasks. However, it is still d…
NSGLD improves SGLD for non-convex optimization problems.
problem Optimizing non-convex objectives efficiently.
method Introducing non-reversible SGLD by adding an anti-symmetric matrix to the drift term of the Langevin diffusion.
result NSGLD converges faster to the same stationary distribution with non-asymptotic guarantees.
Improved language models using ratio-matching and KL divergence.
problem Efficiently modeling discrete data with diffusion models.
method Introduced new theorems and a novel CTMC transition-rate matrix for ratio-matching and KL divergence.
result 10-15% improvement in perplexity and faster training steps.
Improved graph-based multiclass classification for multilayer data.
problem Efficient classification of multilayer data with limited labeled examples.
method Generalized diffuse interface methods applied to multilayer graphs, using spectral decomposition and fast matrix-vector products.
result Highly scalable and efficient classification for large, high-dimensional data sets.
Unified framework for pricing various debt securities.
problem Pricing of different types of debt securities under general short-rate processes.
method Unifying framework using continuous-time Markov chain approximations and bi-dimensional diffusion processes.
result Closed-form matrix expressions and efficient algorithms for pricing various debt securities.
Improved diffusion map enhances manifold regularization for semi-supervised learning.
problem Limited performance of manifold regularization models in capturing global structure.
method Enhanced diffusion map with improved label propagation function.
result Proposed method improves manifold regularization model's performance.
Improved graph neural network bounds using graph diffusion matrix.
problem Empirical performance of graph neural networks on real-world graphs.
method Unified model of graph neural networks, focusing on feature diffusion matrix stability.
result Generalization bounds scale with largest singular value of feature diffusion matrix, smaller than prior bounds.
GDMaps reduces high-dimensional data to lower dimensions for better classification.
problem High-dimensional data classification and representation.
method Grassmannian Diffusion Maps technique for nonlinear dimensionality reduction.
result GDMaps effectively identifies intrinsic subspace structures in high-dimensional data.
DDCD uses diffusion models to learn causal structures from noisy data.
problem Scalability and stability issues in high-dimensional causal structure learning.
method Adaptive k-hop acyclicity constraint and denoising score matching objective of diffusion models.
result DDCD achieves competitive performance on synthetic and real-world data.
A new approach improves numerical tabular data imputation by addressing diffusion models' limitations.
problem Inaccurate and difficult training in numerical tabular data imputation.
method Kernelized Negative Entropy-regularized Wasserstein gradient flow Imputation (KnewImp) based on Wasserstein gradient flow (WGF) framework.
result KnewImp significantly outperforms existing methods in numerical tabular data imputation.
We study the problem of computing the matrix exponential of a block triangular matrix in a peculiar way: Block column by block column, from left to right. The need for such an evaluation scheme arises naturally in the context of option pricing in polynomial diffusion models. In this setting a discretization process pro…
The stability and robustness of compact schemes for parabolic PDEs are analyzed.
problem Stability and robustness of compact schemes for solving parabolic PDEs.
method Compact spatial discretization, Crank-Nicolson temporal discretization, eigenvalue analysis of amplification matrix.
result An upper bound on the condition number of the amplification matrix is derived, showing stability.
A new method estimates SDEs using occupation kernels.
problem Learning multivariate stochastic differential equations (SDEs).
method Two-step procedure: estimate drift, then diffusion. Occupation kernels used in RKHS.
result Validated on simulated and real-world data.
The estimation of covariance matrices of gene expressions has many applications in cancer systems biology. Many gene expression studies, however, are hampered by low sample size and it has therefore become popular to increase sample size by collecting gene expression data across studies. Motivated by the traditional me…
Study on games with degenerate diffusion matrices, proving value existence and convergence.
problem Zero-sum games between singular controller and stopper with degenerate diffusion.
method Probabilistic approach using parameterized approximations, convergence analysis.
result Existence of value and optimal stopping times for the game with degenerate dynamics.
Optimal preconditioning improves Langevin sampling efficiency.
problem Improving sampling efficiency in high-dimensional target distributions.
method Optimal preconditioning using Fisher information, applied to MALA.
result Adaptive MCMC scheme significantly outperforms other methods.
Improved sampling for Diffusion Models by accounting for covariance.
problem Sampling quality degradation in few-step Diffusion Models.
method Covariance-aware sampler using Tweedie's formula and Fourier-space decomposition.
result Consistently superior samples compared to state-of-the-art samplers.
We consider the estimation of integrated covariance (ICV) matrices of high dimensional diffusion processes based on high frequency observations. We start by studying the most commonly used estimator, the realized covariance (RCV) matrix. We show that in the high dimensional case when the dimension p and the observati…
New method learns diffusion transition density for Bayesian inference.
problem Bayesian inference on diffusions with inaccessible boundaries.
method Neural Galerkin framework to solve FP equation with Dirac mass.
result Approximates likelihood function for efficient posterior sampling.
Stochastic gradient descent (SGD) is a key ingredient in the training of deep neural networks and yet its geometrical significance appears elusive. We study a deterministic model in which the trajectories of our dynamical systems are described via geodesics of a family of metrics arising from the diffusion matrix. Thes…
New method simulates sticky boundaries in multidimensional diffusions.
problem Simulating sticky boundaries in multidimensional diffusions.
method Approximate sticky diffusion by a Markov chain, using either finite difference or matching local moments.
result Validates both construction methods for first-order simulation schemes.
Incomplete financial markets are considered, defined by a multi-dimensional non-homogeneous diffusion process, being the direct sum of an Itô process (the price process), and another non-homogeneous diffusion process (the exogenous process, representing exogenous stochastic sources). The drift and the diffusion matrix …
A new diffusion sampling method combines Krylov subspace and diffusion models for faster and more efficient inverse problems.
problem Efficiently solving large-scale inverse problems in high-performance computing.
method Proposes a novel diffusion sampling strategy that integrates Krylov subspace methods with diffusion models.
result Demonstrates significant speedup (80x faster inference time) and improved reconstruction quality on real-world medical imaging problems.