Paper introduces new methods for modeling categorical data.
problem Training generative models on categorical data like text and segmentation.
method Argmax Flows and Multinomial Diffusion models.
result Models outperform existing methods in log-likelihood.
This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
New method uses diffusion models to solve inverse problems.
problem Solving ill-posed inverse problems with powerful priors.
method Formulate posterior sampling as a regularized Wasserstein gradient flow in latent space.
result Demonstrates improved performance on standard benchmarks.
Flow Matching enables robust training of CNFs with various probability paths.
problem Training Continuous Normalizing Flows (CNFs) at large scales.
method Flow Matching (FM) is a simulation-free approach for training CNFs by regressing vector fields of conditional probability paths.
result Flow Matching with diffusion paths yields more robust and stable training compared to diffusion-based methods.
Existence of translating solutions shown for curve diffusion flow.
problem Existence of translating solutions for curve diffusion flow.
method Higher order curve shortening flow approach.
result Properly immersed translating solutions exist.
Efficiently solves inverse problems with diffusion and flow models in just a few steps.
problem Solving inverse problems like super-resolution, inpainting, or deblurring using diffusion or flow models.
method Conditional Conjugate Integrators framework that projects inverse problem dynamics into a more amenable space for sampling.
result Generates high-quality samples in as few as 5 conditional sampling steps, outperforming competing methods.
GLASS Flows improves flow and diffusion model performance by optimizing sampling efficiency.
problem Efficiency bottleneck in sampling Markov transitions for flow and diffusion models.
method Introduces GLASS Flows, a new sampling paradigm that simulates a 'flow matching model within a flow matching model' to sample Markov transitions efficiently.
result Eliminates the trade-off between stochastic evolution and efficiency in large-scale text-to-image models.
Neural Flow Diffusion Models improve diffusion models by learning flexible forward processes.
problem Fixed forward processes in diffusion models complicate reverse processes and increase inference costs.
method Introduces NFDM, a framework supporting flexible forward processes and a novel parameterization technique.
result Demonstrates strong performance in likelihood estimation and learning generative dynamics.
Study shows diffused interface flows to single diffused balls over time.
problem Volume-preserving mean curvature flow in Euclidean space.
method Diffused interface version, exponential convergence proof.
result Exponential convergence to single diffused balls.
The study examines how shallow neural nets converge to training samples or manifold points during diffusion.
problem Understanding when and how shallow neural nets converge to training samples or manifold points during diffusion.
method Analysis of shallow ReLU neural network denoisers trained with minimal ℓ 2 \ell^2 ℓ 2 norm, comparing score flow and diffusion flow. result Probability flow converges to training points, sums of training points, or manifold points, depending on the diffusion time scheduler.
New method for estimating diffusion model densities without solving flows.
problem Estimating log densities from diffusion models efficiently.
method Monte Carlo path integral estimation, avoiding flow solving.
result Significantly more scalable and efficient density estimation.
The paper justifies time-dependent loss reweighting schemes for flow matching and diffusion models.
problem Theoretical justification for time-dependent loss reweighting schemes in flow matching and diffusion models.
method Clarifies that the loss can depend on both time and state, and shows theoretical justification for time-dependent loss weighting schemes.
result Time-dependent loss weighting schemes are theoretically justified for Generator Matching and Edit Flows.
New diffusion models capture heavy-tailed distributions better.
problem Diffusion models struggle with rare or extreme events in heavy-tailed distributions.
method Repurposed diffusion framework using multivariate Student-t distributions, tailored perturbation kernel, and γ γ γ -divergence. result Our models generate rare and extreme events more effectively than standard diffusion models.
Smooth convergence shown for curve diffusion flows.
problem Embeddedness and global existence of curves.
method Exponentially fast convergence established.
result Smooth convergence for curve diffusion flows.
Novel alignment framework for text-to-image generation using diffusion models and flow matching.
problem Improving text-to-image generation with minimal computational resources.
method Proposes a novel alignment framework that decomposes the score function into pre-trained score plus a conditional expectation of the reward.
result Achieves comparable performance to finetuning-based models with reduced computational cost.
LFM learns a sequence of smaller models to generate data from noise.
problem Learning continuous, invertible flows between distributions.
method Stepwise Local Flow Matching (LFM) model, matching diffusion processes up to time-step size.
result LFM achieves competitive generative performance compared to Flow Matching.
New error bounds for flow matching methods using deterministic sampling.
problem Improving the accuracy of flow matching methods for generating probability distributions.
method Derived error bounds for flow matching methods under deterministic sampling conditions.
result Presented error bounds for flow matching methods using L 2 L^2 L 2 loss and regularity conditions. Classifies solitons for surface diffusion flow of graphs.
problem Classifying solitons for surface diffusion flow of graphs.
method Classifies solitons including equilibria, self-similar solutions, and travelling waves.
result Classified solitons for surface diffusion flow of entire graphs.
Surface diffusion and mean curvature flows converge to stable critical sets in flat tori.
problem Stability of surface diffusion and mean curvature flows in flat tori.
method Existence and convergence of flows starting close to stable critical sets, proven for all times.
result Flows converge exponentially fast to stable critical sets in flat tori.
Improved NPE with conditional diffusions and summary networks.
problem Approximating complex posterior distributions efficiently and accurately.
method Conditional diffusions coupled with high-capacity summary networks.
result Conditional diffusions offer improved stability, accuracy, and faster training times.
Generative models tackle incompressible fluid flows by enforcing divergence-free constraints.
problem Simulating incompressible fluid flows with generative models.
method Score-based diffusion models with divergence-free constraint.
result Models can reproduce Kolmogorov turbulence characteristics.
We introduce cylindrical projections to simulate infinite-dimensional occupation flows of diffusions.
problem Computational intractability of infinite-dimensional occupation flows of diffusions.
method Introduce cylindrical projections to approximate the occupation flow via a finite-dimensional system.
result Strong convergence of cylindrical projections to the initial process with derived rates.
New method learns discrete graph diffusion via free-energy gradient flows.
problem Challenges in translating continuous diffusion models to discrete spaces.
method Proposes a novel computational approach using a specific metric on the simplex.
result Recover the underlying functional for various graph classes.
Language Rectified Flow improves diffusion language generation by simplifying complex steps.
problem Complexity in diffusion language models limits their implementation in NLP applications.
method Reformulates probabilistic flow models to learn neural ODE models for efficient domain transfer.
result Consistently outperforms baselines on fine-grained control tasks and text editing.
Sharp Lipschitz bounds for flow-matching and diffusion models with optimal sampling rates.
problem Establishing optimal Lipschitz regularity for flow-matching and diffusion models.
method Sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores.
result Achieves optimal sampling rate of d / N \sqrt{d}/N d / N for Euler-type samplers in dimension d d d . New theory improves diffusion model convergence for generating data.
problem Improving convergence of diffusion models for data generation.
method Developed a non-asymptotic convergence theory for probability flow ODEs.
result Proves d / ε d/\varepsilon d / ε iterations suffice for approximating target distributions. New method speeds up generative modeling without requiring diffusion steps.
problem Improving the speed and efficiency of generative modeling techniques.
method Probability flow ODE with a corrector step, achieving better dimension dependence.
result Better dimension dependence ( O ( d ) O(\sqrt{d}) O ( d ) vs. O ( d ) O(d) O ( d ) , assuming smoothness of the data distribution). New algorithm trains latent diffusion models using interacting particles.
problem Training latent diffusion models efficiently and accurately.
method Reformulate training as minimizing a free energy functional, then approximate with interacting particles.
result The new algorithm outperforms previous methods in experiments.
The paper improves the probability flow ODE sampler for faster sampling of natural images.
problem Improving the convergence rate of the probability flow ODE sampler.
method Adapting the probability flow ODE sampler to exploit intrinsic low-dimensional structures in natural image data.
result Achieves a dimension-free convergence rate of O ( k / T ) O(k/T) O ( k / T ) in total variation distance, improving upon existing results. New jellyfish found in various flows.
problem Existence of geometrically distinct shapes in flows.
method Analyzing elastic, curve diffusion, and ideal flows.
result Infinitely many distinct shapes discovered.
A simplified tutorial on diffusion models for beginners.
problem Educating technical audiences on diffusion models.
method Simplified mathematical explanations and heuristic derivations.
result Accessible algorithms for diffusion models.
Unified framework for training diffusion and flow models to sample from target distributions.
problem Training diffusion and flow models to sample from target distributions defined by exponential tilting.
method Unified framework combining stochastic optimal control and non-equilibrium thermodynamics perspectives.
result Unified bias-variance decompositions and theoretical support for adjoint-based methods.
Graph neural network using Beltrami flow for feature and topology evolution.
problem Efficient feature learning and topology evolution on graphs.
method Discretized Beltrami flow applied to graph neural networks with positional encodings.
result Achieves state-of-the-art results on various benchmarks.
Bi-Lipschitz flows approximate a wide range of distributions.
problem Characterizing the expressivity of bi-Lipschitz normalizing flows.
method Linking score regularity to transport map bi-Lipschitzness via probability flow ODE.
result Gaussian pullbacks induced by bi-Lipschitz variance-preserving transport maps are L 1 L^1 L 1 -dense among all probability densities. Adjoint Matching improves flow and diffusion models with reward fine-tuning.
problem Improving generative models with reward fine-tuning.
method Casting reward fine-tuning as stochastic optimal control (SOC) and enforcing a specific noise schedule.
result Adjoint Matching outperforms existing SOC algorithms.
StAD predicts divergence of diffusion and flow models without Jacobian computation.
problem Computing likelihood from diffusion and flow models is computationally expensive.
method Introduces StAD, a distillation method to predict divergence using Langevin-Stein operator.
result StAD predicts divergence with competitive variance and speed compared to existing methods.
Maximum likelihood training improves the performance of score-based diffusion models.
problem Training score-based diffusion models with maximum likelihood.
method Trained by minimizing a weighted combination of score matching losses, with a specific weighting scheme that bounds negative log-likelihood.
result Maximum likelihood training improves the log-likelihood of score-based diffusion models across multiple datasets.
Improved KL bounds and Wasserstein guarantees for diffusion flow matching under minimal conditions.
problem Theoretical convergence properties of Brownian motion based diffusion flow matching.
method Refined analysis under Kullback-Leibler and 2-Wasserstein distances.
result State-of-the-art scaling in KL convergence bounds under minimal conditions.
New method learns diffusion transition density for Bayesian inference.
problem Bayesian inference on diffusions with inaccessible boundaries.
method Neural Galerkin framework to solve FP equation with Dirac mass.
result Approximates likelihood function for efficient posterior sampling.
New method identifies drift and diffusivity from SDE marginals.
problem Challenging task to identify drift and diffusion from SDE population dynamics.
method Proposes nn-APPEX, a Schrodinger Bridge-based inference method.
result Gradient-flow drift and Brownian diffusivity jointly identifiable from marginals.
We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of implicit Euler steps that follow the gradients of a particular free energy functional.…
In this article we investigate the dynamics of special solutions to the surface diffusion flow of idealised ribbons. This equation reduces to studying the curve diffusion flow for the profile curve of the ribbon. We provide: (1) a complete classification of stationary solutions; (2) qualitative results on shrinkers, tr…
New method converts and optimizes sampling schedules for generative models.
problem Optimizing sampling schedules for generative models like flows and diffusions.
method Unified framework for stochastic interpolants, including point mass schedules.
result Demonstrated efficient generation of images with fewer steps.
CTM improves diffusion model sampling quality with efficient ODE traversal.
problem Lack of natural trade-off between sample quality and speed in consistency models.
method CTM trains a neural network to output scores and traverse ODE trajectories efficiently.
result CTM achieves state-of-the-art FIDs and improves sample quality with increased computational budget.
A new flow optimizes synthetic data alignment for generative modeling.
problem Optimizing synthetic data to match target distributions.
method Score difference (SD) flow to reduce KL divergence.
result SD flow provides a theoretical link between generative models.
This paper provides guarantees for DFM models using KL divergence.
problem Ensuring generative models match target distributions efficiently.
method Using KL divergence and Brownian motion bridge for generative models.
result Non-asymptotic guarantees for DFM models under specific conditions.
A new method for normalizing flows using stochastic interpolants simplifies likelihood estimation and improves efficiency.
problem Efficient and scalable likelihood estimation for complex probability distributions.
method Inference of velocity field from time-dependent density interpolating between base and target densities.
result Simplified quadratic loss for velocity estimation, leading to faster and more efficient training.
Improved language generation with faster sampling speed.
problem Speed and coherence issues in autoregressive language models.
method Introduces Neural Flow Diffusion Models (NFDM) for discrete state spaces.
result Substantially reduces likelihood gap with autoregressive models.