DYffusion improves diffusion models for spatiotemporal forecasting.
problem Challenges in generating stable and accurate forecasts for dynamic data.
method Leverages temporal dynamics in data, directly coupling it with diffusion steps.
result Improves computational efficiency and performs competitively on complex dynamics.
Rolling Diffusion improves video prediction by progressively corrupting frames based on their temporal position.
problem Improving video prediction accuracy by accounting for temporal dynamics.
method A sliding window denoising process that assigns more noise to frames that appear later in a sequence.
result Rolling Diffusion outperforms standard diffusion models in tasks with complex temporal dynamics.
Combines deep state space models with diffusion models for better forecasting and capturing latent dynamics
problem Forecasting and capturing latent dynamics in time series
method DDSSM: Diffusion-driven state space model
result Empirically outperforms state-of-the-art deep SSM
AdaPID optimizes diffusion-based samplers by dynamically adjusting schedules.
problem Optimizing the intermediate-time dynamics in diffusion-based samplers.
method Develops a time-varying stiffness schedule using Piece-Wise-Constant (PWC) parametrizations and a hierarchical refinement approach.
result QoS-driven PWC schedules consistently improve sampling fidelity and accuracy.
Study of diffusion annealed Langevin dynamics for generative models.
problem Theoretical efficiency of score-based diffusion processes.
method Rigorous construction and analysis of diffusion processes with Poincaré and logarithmic Sobolev inequalities.
result Improvement in efficiency of diffusion processes through Poincaré and logarithmic Sobolev inequalities.
Paper defends diffusion models from membership inference attacks using Langevin dynamics.
problem Defending diffusion models against membership inference attacks.
method Uses critically-damped higher-order Langevin dynamics with auxiliary variables.
result Demonstrates improved resistance to membership inference attacks through theoretical investigation and validation.
Proposes LDIDPs for efficient sequential data generation from latent dynamical models.
problem Challenges in generating high-fidelity sequential samples from latent dynamical models.
method Utilizes implicit diffusion processes to sample from latent dynamical processes.
result Demonstrates accurate learning of dynamics and efficient generation of high-quality sequential data.
Analyzes how class imbalance and heterogeneity affect diffusion model learning dynamics.
problem Understanding how class imbalance and heterogeneity impact the learning dynamics of diffusion models.
method Developed a high-dimensional analytical framework to study class-dependent learning in score-based diffusion models.
result Class variance is the primary determinant of learning order, favoring higher-variance classes; centroid geometry plays a secondary role.
New method learns diffusion bridges for rare events.
problem Simulating rare events in diffusion processes.
method Iterative online learning based on self-consistency.
result Strong performance in various empirical settings.
Diffusion models learn balanced data representations, unlike classification models.
problem Understanding feature learning in diffusion models.
method Proposed a feature learning framework to analyze diffusion models' training dynamics.
result Diffusion models encourage learning balanced and comprehensive representations.
Paper develops models for better HFT and algorithmic trading.
problem Inaccurate LOB dynamics in financial markets.
method Semi-Markov and Hawkes jump-diffusion models for LOB dynamics.
result Improved trading strategies through precise model application.
Generative diffusion models are analyzed for their information dynamics.
problem Lack of a unified theoretical understanding of generative diffusion models.
method Integrated perspective connecting information-theoretic, dynamical, and thermodynamic aspects.
result Generative bandwidth is directly governed by the divergence of the score function's vector field.
Predicts solar dynamics with diffusion models, improving long-range dependencies.
problem Predicting solar dynamics with limited observable data.
method Multiscale inference scheme for diffusion models.
result Improved long-range predictions with reduced bias.
Develops polynomial diffusion models for multi-factor commodity futures dynamics.
problem Modeling futures prices using latent state variables for short and long-term stochastic factors.
method Polynomial diffusion models to incorporate non-linear effects, two filtering methods for estimation.
result Accurate estimation of futures prices despite parameter identification issues in polynomial diffusion models.
New model learns graph spectra accurately, outperforming existing methods.
problem Graph diffusion models struggle to distinguish certain graph families and their spectra.
method Leveraged random matrix theory to analytically extract spectral properties, introducing Dyson Diffusion Model.
result Dyson Diffusion Model learns graph spectra accurately and outperforms existing models.
A new particle filter uses diffusion models to improve state estimation from noisy data.
problem Sequentially estimating the state of a dynamical system from noisy and incomplete observations.
method Uses a diffusion model to simulate and predict system dynamics, incorporating noisy observations to refine predicted states.
result An unbiased particle filtering method that rigorously fuses observational data with diffusion model simulations.
A new method de-randomizes MCMC dynamics using the Stein operator.
problem Estimating complex target distributions in Bayesian inference.
method De-randomized kernel-based particle samplers that discretize the fiber-gradient Hamiltonian flow.
result GSVGD de-randomizes complex MCMC dynamics, maintaining high sample quality.
Efficient methods accelerate diffusion model sampling.
problem Slow sample generation in diffusion models.
method Conjugate Integrators and Splitting Integrators.
result Hybrid method achieves best FID scores.
We consider Lagrangian coherent structures (LCSs) as the boundaries of material subsets whose advective evolution is metastable under weak diffusion. For their detection, we first transform the Eulerian advection-diffusion equation to Lagrangian coordinates, in which it takes the form of a time-dependent diffusion or h…
ERDM integrates rolling forecasts with diffusion models for complex dynamics.
problem Forecasting complex dynamics with rolling forecasts and diffusion models.
method Adapting EDM components for rolling forecasts, introducing novel loss weighting, efficient initialization, and hybrid architecture.
result ERDM outperforms diffusion-based baselines in 2D Navier-Stokes simulations and ERA5 weather forecasting.
Combining diffusion models with Langevin dynamics improves posterior sampling efficiency.
problem Sampling from noisy posterior distributions efficiently.
method Annealed Langevin dynamics combined with diffusion models.
result Achieves posterior sampling in polynomial time with a weaker score error bound.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
A new neural network approach for diffusion on networks.
problem Inference and estimation of diffusion on network structures.
method Neural mean-field dynamics derived from Mori-Zwanzig formalism, approximated by learnable time convolution operators.
result Significantly outperforms existing approaches in accuracy and efficiency.
DEMOTE uses neural diffusion-reaction processes to capture temporal dynamics in sparse tensor data.
problem Sparse and temporally associated tensor data with limited structural knowledge.
method Develops a neural diffusion-reaction process to estimate dynamic embeddings for tensor modes.
result Captures both commonalities and personalities in evolving tensor entries.
New method improves quality and efficiency of generative models by using smaller diffusion times.
problem Lack of theoretical understanding of diffusion time T in score-based diffusion models.
method Introduce an auxiliary model to bridge the gap between ideal and simulated dynamics, followed by reverse diffusion.
result Empirical results show competitive performance in image data compared to state-of-the-art models.
This paper examines how Higher-Order Langevin Dynamics reduces memorization in diffusion models.
problem Memorization of training samples in diffusion models, violating copyright and privacy.
method Introduces Higher-Order Langevin Dynamics (HOLD) to regularize diffusion model trajectories.
result The dynamics of the data variable in HOLD are governed by a low-pass-filtered version of the learned score function, with smoothness increasing with model order.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
Study explores efficient continual learning of diffusion models.
problem Efficiently reusing computation in training diffusion models as data evolves.
method Benchmarked and analyzed CL methods for Denoising Diffusion Probabilistic Models (DDPMs).
result Experience replay with reduced rehearsal coefficient shows strong performance.
Poisson Midpoint Method improves Langevin Dynamics for diffusion models.
problem Slow convergence of LMC in diffusion models requiring many small steps.
method Poisson Midpoint Method approximates LMC with larger steps, proving quadratic speed up.
result Poisson Midpoint Method maintains quality of DDPM with fewer calls.
Diffusion models simulate molecular dynamics with adjustable accuracy.
problem Simulating molecular dynamics with high accuracy and efficiency.
method Diffusion models as Euler-Maruyama integrators for Langevin dynamics, learning forces from static snapshots.
result Diffusion models generate molecular trajectories with temporal correlations similar to MD simulations.
Unified framework for constrained diffusion models on nonconvex sets with efficient landing mechanism.
problem Efficiently modeling generative models under nonconvex constraints.
method Unified framework with overdamped and underdamped dynamics, landing mechanism.
result Significantly reduces computational cost while maintaining sample quality.
New method bypasses time-reversal for diffusion-based generative models.
problem Diffusion-based generative models require time-reversal, limiting flexibility.
method Constructs diffusion processes without time-reversal through mixtures of diffusion bridges.
result Exact transport without time-reversal, greater flexibility in dynamics.
Proposes a new method for constrained generative modeling using Langevin dynamics.
problem Challenges in satisfying underlying constraints with score-based generative models.
method Uses kinetic Langevin dynamics with specular reflection to model constraints.
result Demonstrates efficient numerical samplers with optimal convergence rates.
New model tackles complex spatio-temporal causal inference with dynamic confounders and functional data.
problem Complex spatio-temporal dynamics and unmeasured confounders hinder causal inference.
method PFD-BDCM, a unified generative framework for spatio-temporal dependencies, functional data, and dynamic confounding.
result PFD-BDCM outperforms existing methods across observational, interventional, and counterfactual queries.
Accelerates convergence in global non-convex optimization with reversible diffusion.
problem Global non-convex optimization challenges.
method Utilizes reversible diffusion processes with adaptive diffusion coefficients.
result Accelerated convergence with reduced discretization error.
High-quality image synthesis with diffusion models, achieving state-of-the-art FID score.
problem Generating high-quality images from latent variables.
method Training diffusion probabilistic models with a weighted variational bound, inspired by denoising score matching and Langevin dynamics.
result State-of-the-art FID score of 3.17 on CIFAR10 dataset.
ELM combines machine learning and feature engineering for anomalous diffusion detection.
problem Quantitative characterization of anomalous diffusion from single trajectories.
method Extreme Learning Machine (ELM) combined with feature engineering.
result ELM achieves satisfactory performance in AnDi challenge tasks.
New method models covariates and responses without parametric assumptions using manifold learning.
problem Losing explanatory power for responses in standard factor models applied to covariates alone.
method Anisotropic diffusion maps for learning low-dimensional embeddings.
result Kalman filtering in diffusion-map coordinates improves joint covariate-response prediction.
Enhances option pricing with fractional order Black-Scholes-Merton model.
problem Improving precision and authenticity of option pricing.
method Integrates fractional order Black-Scholes-Merton with neural networks.
result Improves accuracy in capturing complex diffusion dynamics and memory effects.
Stabilizes complex systems using diffusion models trained on Lyapunov functions.
problem Generating stabilizing controllers for complex dynamical systems.
method Trains a diffusion model on pairs of asymptotically stable vector fields and their Lyapunov functions to identify the closest stable field and adjust control functions.
result Efficient and rapid stabilization of unseen systems, showcasing generalizability.
Neural Flow Diffusion Models improve diffusion models by learning flexible forward processes.
problem Fixed forward processes in diffusion models complicate reverse processes and increase inference costs.
method Introduces NFDM, a framework supporting flexible forward processes and a novel parameterization technique.
result Demonstrates strong performance in likelihood estimation and learning generative dynamics.
SDIFT generates full-field dynamics from sparse, irregular data.
problem Modeling and reconstructing physical dynamics from sparse, off-grid observations.
method SDIFT uses a functional Tucker model and sequential diffusion for generating full-field evolution from irregular sparse observations.
result Significant improvements in reconstruction accuracy and computational efficiency compared to state-of-the-art approaches.
Generative diffusion models forecast implied vol surfaces without arbitrage issues.
problem Forecasting arbitrage-free implied volatility surfaces using historical data with path-dependent dynamics.
method Generative diffusion model (DDPM) with conditional training on market variables, including EWMAs and returns. Dynamic penalty scheme based on SNR to enforce arbitrage-free surfaces.
result Superior performance in volatility forecasting compared to existing methods.
CDS combines PT and diffusion for efficient sampling from multimodal distributions.
problem Sampling from unnormalized multimodal distributions efficiently.
method Conditional Diffusion Sampling (CDS) using Conditional Interpolants and Parallel Tempering.
result CDS achieves a superior trade-off between sample quality and density evaluation cost.
RL for jump-diffusions applies to financial portfolio selection and option hedging.
problem Optimizing control in systems with jump-diffusion dynamics.
method Entropy-regularized exploratory control with stochastic policies, using existing diffusion algorithms with modifications.
result RL algorithms and parameterizations are invariant to jumps in jump-diffusion systems.
This paper analyzes how diffusion models learn and generalize concepts.
problem Learning and generalizing concepts in compositional data-generating processes.
method Introduced a structured identity mapping (SIM) task to analyze neural network learning dynamics.
result SIM task captures key empirical observations on compositional generalization.
Derives continuum model from discrete ε-graphs with connectivity functional.
problem Modeling diffusion in networks with varying connectivity.
method Energy-based continuum limit derivation, neural-network reconstruction of connectivity.
result Error between discrete and continuum energies is O(ε), valid even with fluctuations. Solving statistical learning problems often involves nonconvex optimization. Despite the empirical success of nonconvex statistical optimization methods, their global dynamics, especially convergence to the desirable local minima, remain less well understood in theory. In this paper, we propose a new analytic paradigm …