New method solves linear inverse problems using diffusion models.
problem Linear inverse problems in various domains.
method Posterior sampling with latent diffusion models.
result Provable sample recovery in linear models, outperforming previous methods.
Unified diffusive bounds for non-linear parabolic equations.
problem Proving diffusive upper bounds for parabolic equations.
method Simple exponential deformation argument.
result Unified diffusive upper bounds for a wide class of non-linear parabolic equations.
Theoretical justification for image inpainting using diffusion models.
problem Improving sample recovery in image inpainting without retraining.
method Analysis of RePaint algorithm and proposing RePaint + ^+ + to correct misalignment. result RePaint + ^+ + algorithm provably recovers the true sample with linear convergence. New method uses diffusion models for Bayesian inverse problems.
problem Solving Bayesian inverse problems with linear-Gaussian models.
method Decoupled Diffusion Sequential Monte Carlo (DDSMC) method.
result Asymptotically exact solution demonstrated on various data types.
NDMs enable non-linear transformations in diffusion models for better generative tasks.
problem Limited to linear transformations, diffusion models struggle with generative tasks.
method Presented NDMs that allow time-dependent non-linear transformations.
result NDMs outperform conventional diffusion models in likelihood and sample quality.
Diffusion models generate data with Gaussian Universality, matching linear model test errors.
problem Analyzing the performance of models trained on synthetic data generated by diffusion models.
method Investigates Gaussian Universality for data distributions generated via diffusion models, matching test errors of linear models trained on synthetic data to Gaussian Mixture models.
result The test error of a linear model trained on diffusion-generated data matches the test error of a linear model trained on Gaussian Mixture data with matching means and covariances per class.
RePS improves diffusion models for solving inverse problems efficiently.
problem Solving inverse problems with incomplete or noisy measurements.
method Restart for Posterior Sampling (RePS) using pre-trained diffusion models.
result RePS achieves faster convergence and superior reconstruction quality.
New method guides pretrained diffusion models without additional training.
problem Guidance methods for diffusion models often require extra training or are task-specific.
method Variational Control using Diffusion Trajectory Matching (DTM)
result Achieves state-of-the-art results on various problems.
A new algorithm improves posterior sampling for linear inverse problems.
problem Efficiently sampling from posterior distributions in noisy linear inverse problems.
method Proposes \pddim, a DDIM-type sampler that separately samples along singular directions of the measurement operator.
result The method converges to the Bayesian posterior conditioned on the measurements.
New method speeds up diffusion models inference to sub-linear time.
problem Efficient inference of diffusion models for high-dimensional data.
method Parallel sampling with Picard iterations within blocks.
result Achieves sub-linear time complexity of O ~ ( p o l y log d ) \widetilde{\mathcal{O}}(\mathrm{poly} \log d) O ( poly log d ) . A fast method approximates likelihood scores for noisy linear inverse problems.
problem Solving noisy linear inverse problems efficiently.
method Proposes a simple closed-form approximation to the likelihood score for diffusion and flow-based models.
result Significantly faster than baseline methods while maintaining competitive or better reconstruction performances.
Diffusion models converge linearly to complex data manifolds.
problem Sampling from high-dimensional complex data distributions.
method Score-matching generative models with novel integration scheme.
result Linear convergence in KL divergence to intrinsic dimension d d d . Develops polynomial diffusion models for multi-factor commodity futures dynamics.
problem Modeling futures prices using latent state variables for short and long-term stochastic factors.
method Polynomial diffusion models to incorporate non-linear effects, two filtering methods for estimation.
result Accurate estimation of futures prices despite parameter identification issues in polynomial diffusion models.
This paper conditions non-linear infinite-dimensional diffusion processes.
problem Conditioning non-linear and infinite-dimensional diffusion processes.
method Infinite-dimensional Girsanov's theorem to condition function-valued stochastic processes.
result Conditioning of non-linear infinite-dimensional diffusion processes is achieved.
New method for fast inference in diffusion models.
problem Intractable probabilistic inference in diffusion models.
method Variational Gaussian Process, exponential family description, convex optimization.
result Improved fast algorithm for learning model parameters.
GF-Net learns Green's functions for linear reaction-diffusion equations.
problem Learning Green's functions for linear reaction-diffusion equations on arbitrary domains.
method GF-Net, a neural network, learns Green's functions in an unsupervised manner using physics-informed approach and symmetry.
result GF-Net efficiently solves linear reaction-diffusion equations under various boundary conditions and sources.
Diffusion means converge to extrinsic means for long times on spheres.
problem Understanding the long-time behavior of diffusion means on manifolds.
method Introduced diffusion means as a parameterized family of location statistics on manifolds, and analyzed their convergence to extrinsic means for long times.
result For real projective spaces and connected compact symmetric spaces, the long-time limit of diffusion means is conjectured to be the extrinsic mean in the isometric embedding.
Paper uses RL and diffusion models to solve Bayesian inverse problems.
problem Bayesian inverse problems with latent biases.
method Relative Trajectory Balance (RTB) for RL, conditional diffusion models, off-policy backtracking exploration.
result RTB improves diffusion model posteriors for inverse problems.
Diffusion models tackle noisy inverse problems with posterior sampling.
problem Efficiently solving general noisy inverse problems.
method Approximation of posterior sampling for diffusion models.
result Diffusion models can handle various noise statistics and nonlinear problems.
Diffusion Maps improves on Functional PCA for non-linear functional data.
problem Functional PCA's linear manifold assumption fails for non-linear functional data.
method Extends Diffusion Maps to functional data and compares it to Functional PCA.
result Diffusion Maps outperforms Functional PCA in non-linear functional data analysis.
Automated denoising score matching handles nonlinear diffusion processes.
problem Nonlinear diffusion processes limit generative modeling and property estimation.
method Local-DSM using local increments and Taylor expansions.
result Tractable training and score estimation for nonlinear diffusion processes.
This work connects diffusion models to power iteration, revealing how low frequencies emerge earlier.
problem Understanding the generation process of diffusion models and their relation to power iteration.
method Examined the linear case of diffusion models, connecting them to the spiked covariance model and power iteration.
result Linear diffusion models converge to the leading eigenvector, similar to power iteration.
Diffusion models generalize better with hierarchical data structure and regularization.
problem Understanding generalization in diffusion models with finite data.
method Analyzing diffusion models through data covariance spectra and developing a theoretical framework based on linear neural networks.
result Generalization in diffusion models improves with hierarchical data structure and regularization.
First, classes of Markov processes that scale exactly with a Hurst exponent H are derived in closed form. A special case of one class is the Tsallis density, advertised elsewhere as nonlinear diffusion or diffusion with nonlinear feedback. But the Tsallis model is only one of a very large class of linear diffusion with…
Identifies smooth curves for financial models.
problem Consistent term structures with flexible diffusion.
method Analyzes manifolds of curves for Heath-Jarrow-Morton models.
result Term structures cannot be affine but must be linear-rational.
Diffusion maps are an emerging data-driven technique for non-linear dimensionality reduction, which are especially useful for the analysis of coherent structures and nonlinear embeddings of dynamical systems. However, the computational complexity of the diffusion maps algorithm scales with the number of observations. T…
New method identifies SDE drift and diffusion from temporal data.
problem Learning SDE parameters from temporal data, especially in noisy or incomplete data.
method Entropy-regularized optimal transport, APPEX algorithm.
result Can almost always recover drift and diffusion from temporal marginals.
Study shows how diffusion models learn on low-dimensional manifolds.
problem Learning efficiency of diffusion models on manifolds.
method Analyzes denoising score matching with random feature neural networks.
result Sample complexity scales linearly with intrinsic dimension, not ambient dimension.
Decomposing market impact into diffusive components
problem Market impact scaling
method Decomposing impact into realized and counterfactual returns
result Implication of square-root law in information-neutral regime
New bounds show diffusion models converge nearly linearly in data dimension.
problem Improving convergence bounds for diffusion models.
method Refined discretization of reverse SDE using stochastic localization.
result Linear convergence in data dimension with logarithmic factors.
Diffusion models' consistency across splits explained by random matrix theory.
problem Consistency of diffusion models trained on non-overlapping subsets.
method Random matrix theory framework to quantify dataset effects on denoiser and sampling map.
result The theory explains and predicts cross-split disagreement in diffusion models.
In this article, a compact finite difference method is proposed for pricing European and American options under jump-diffusion models. Partial integro-differential equation and linear complementary problem governing European and American options respectively are discretized using Crank-Nicolson Leap-Frog scheme. In pro…
We present new extensions to a method for constructing several families of solvable one-dimensional time-homogeneous diffusions whose transition densities are obtainable in analytically closed-form. Our approach is based on a dual application of the so-called diffusion canonical transformation method that combines smoo…
Develops new bounds for deterministic samplers in diffusion models.
problem Analyzing deterministic samplers in diffusion generative models.
method Operational interpretation of deterministic sampling; restoration and degradation steps.
result First polynomial convergence bounds for DDIM-type samplers.
Method infers parameters in complex diffusion processes.
problem Parameter inference in high-dimensional, non-linear diffusion processes.
method Differentiable score matching to approximate diffusion bridges, used in an importance sampler.
result Numerically stable framework for parameter inference and diffusion mean estimation.
Automates learning of multivariate diffusions for generative models.
problem Lack of automated methods for choosing and optimizing diffusion processes in generative models.
method Develops a recipe to maximize likelihood without model-specific analysis, parameterizes diffusion for target noise, and optimizes the inference diffusion process.
result Automatic search over all linear diffusions for generative models.
Improved generative models for rare events using nonlinear diffusion.
problem Challenges in modeling rare conditional distributions with linear diffusion models.
method Adapting data representation and forward scheme for nonlinear drift term.
result Significant improvement in capturing extreme tail events.
Study on policy gradient for stochastic bandits using diffusion approximation.
problem Improving policy gradient methods for stochastic bandits with optimal regret bounds.
method Continuous-time diffusion approximation of policy gradient with learning rate analysis.
result Proved optimal regret bound of O ( k log ( k ) log ( n ) / η ) O(k \log(k) \log(n) / η) O ( k log ( k ) log ( n ) / η ) for η = O ( Δ 2 / log ( n ) ) η= O(Δ^2/\log(n)) η = O ( Δ 2 / log ( n )) . Paper analyzes latent space geometry in generative models using Fisher information.
problem Understanding the structure of latent spaces in generative models.
method Reconstructs Fisher information metric from generated samples and posterior distribution.
result Reveals fractal structure and abrupt changes in Fisher metric at phase boundaries.
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
problem Understanding the learning dynamics of diffusion models.
method Empirical observations and theoretical analysis of diffusion models and denoisers.
result Diffusion models learn simple statistics (pair-wise correlations) at linear sample complexity, while higher-order statistics (e.g., fourth cumulant) require cubic sample complexity.
Study shows how to control jump-diffusion processes with stable feedback controls in reinforcement learning.
problem Control jump-diffusion processes with unknown coefficients in reinforcement learning.
method Lipschitz continuous optimal feedback controls, stability analysis of forward-backward SDEs, least-squares algorithm.
result Achieves O ( N ln N ) O(\sqrt{N\ln N}) O ( N ln N ) regret for linear-convex learning problems with jumps. Iterative tilting fine-tunes diffusion models for reward-tilted distributions.
problem Fine-tuning diffusion models for reward-tilted distributions.
method Decomposes large reward tilts into smaller, tractable tilts via first-order Taylor expansion, avoiding backpropagation.
result Validated on a two-dimensional Gaussian mixture, achieving exact closed-form solutions.
We investigate which jump-diffusion models are convexity preserving. The study of convexity preserving models is motivated by monotonicity results for such models in the volatility and in the jump parameters. We give a necessary condition for convexity to be preserved in several-dimensional jump-diffusion models. This …
This paper improves diffusion models for low-dimensional data.
problem Theoretical foundations of diffusion models are lacking for low-dimensional data.
method Score approximation, estimation, and distribution recovery of diffusion models on low-dimensional data.
result Sample complexity bounds for distribution estimation using diffusion models are provided.
Discrete diffusion models improve text and image inference.
problem Challenges in posterior sampling with discrete diffusion models.
method Anchored Posterior Sampling (APS) with quantized expectation and anchored remasking.
result APS achieves state-of-the-art performance on various tasks.
A new diffusion sampling method combines Krylov subspace and diffusion models for faster and more efficient inverse problems.
problem Efficiently solving large-scale inverse problems in high-performance computing.
method Proposes a novel diffusion sampling strategy that integrates Krylov subspace methods with diffusion models.
result Demonstrates significant speedup (80x faster inference time) and improved reconstruction quality on real-world medical imaging problems.
Proposes efficient sampling methods for solving linear inverse problems.
problem Solving linear inverse problems with computational efficiency and accuracy.
method Higher-order Langevin diffusion with pre-conditioning and annealing.
result Provable sampling from posterior distributions with accelerated convergence.
StrADiff separates sources from mixtures without labels, using structured priors.
problem Blind source separation of linear and nonlinear mixtures without labeled data.
method Structured Source-Wise Adaptive Diffusion Framework with Gaussian process priors.
result StrADiff can recover latent source trajectories in an unsupervised manner, especially stable in linear mixtures.