Existence of translating solutions shown for curve diffusion flow.
problem Existence of translating solutions for curve diffusion flow.
method Higher order curve shortening flow approach.
result Properly immersed translating solutions exist.
Study shows diffused interface flows to single diffused balls over time.
problem Volume-preserving mean curvature flow in Euclidean space.
method Diffused interface version, exponential convergence proof.
result Exponential convergence to single diffused balls.
Paper introduces new methods for modeling categorical data.
problem Training generative models on categorical data like text and segmentation.
method Argmax Flows and Multinomial Diffusion models.
result Models outperform existing methods in log-likelihood.
Smooth convergence shown for curve diffusion flows.
problem Embeddedness and global existence of curves.
method Exponentially fast convergence established.
result Smooth convergence for curve diffusion flows.
This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
Classifies solitons for surface diffusion flow of graphs.
problem Classifying solitons for surface diffusion flow of graphs.
method Classifies solitons including equilibria, self-similar solutions, and travelling waves.
result Classified solitons for surface diffusion flow of entire graphs.
Surface diffusion and mean curvature flows converge to stable critical sets in flat tori.
problem Stability of surface diffusion and mean curvature flows in flat tori.
method Existence and convergence of flows starting close to stable critical sets, proven for all times.
result Flows converge exponentially fast to stable critical sets in flat tori.
New method uses diffusion models to solve inverse problems.
problem Solving ill-posed inverse problems with powerful priors.
method Formulate posterior sampling as a regularized Wasserstein gradient flow in latent space.
result Demonstrates improved performance on standard benchmarks.
Flow Matching enables robust training of CNFs with various probability paths.
problem Training Continuous Normalizing Flows (CNFs) at large scales.
method Flow Matching (FM) is a simulation-free approach for training CNFs by regressing vector fields of conditional probability paths.
result Flow Matching with diffusion paths yields more robust and stable training compared to diffusion-based methods.
New jellyfish found in various flows.
problem Existence of geometrically distinct shapes in flows.
method Analyzing elastic, curve diffusion, and ideal flows.
result Infinitely many distinct shapes discovered.
Efficiently solves inverse problems with diffusion and flow models in just a few steps.
problem Solving inverse problems like super-resolution, inpainting, or deblurring using diffusion or flow models.
method Conditional Conjugate Integrators framework that projects inverse problem dynamics into a more amenable space for sampling.
result Generates high-quality samples in as few as 5 conditional sampling steps, outperforming competing methods.
GLASS Flows improves flow and diffusion model performance by optimizing sampling efficiency.
problem Efficiency bottleneck in sampling Markov transitions for flow and diffusion models.
method Introduces GLASS Flows, a new sampling paradigm that simulates a 'flow matching model within a flow matching model' to sample Markov transitions efficiently.
result Eliminates the trade-off between stochastic evolution and efficiency in large-scale text-to-image models.
New method identifies drift and diffusivity from SDE marginals.
problem Challenging task to identify drift and diffusion from SDE population dynamics.
method Proposes nn-APPEX, a Schrodinger Bridge-based inference method.
result Gradient-flow drift and Brownian diffusivity jointly identifiable from marginals.
The study examines how shallow neural nets converge to training samples or manifold points during diffusion.
problem Understanding when and how shallow neural nets converge to training samples or manifold points during diffusion.
method Analysis of shallow ReLU neural network denoisers trained with minimal ℓ 2 \ell^2 ℓ 2 norm, comparing score flow and diffusion flow. result Probability flow converges to training points, sums of training points, or manifold points, depending on the diffusion time scheduler.
We present a novel approximate inference method for diffusion processes, based on the Wasserstein gradient flow formulation of the diffusion. In this formulation, the time-dependent density of the diffusion is derived as the limit of implicit Euler steps that follow the gradients of a particular free energy functional.…
Neural Flow Diffusion Models improve diffusion models by learning flexible forward processes.
problem Fixed forward processes in diffusion models complicate reverse processes and increase inference costs.
method Introduces NFDM, a framework supporting flexible forward processes and a novel parameterization technique.
result Demonstrates strong performance in likelihood estimation and learning generative dynamics.
In this article we investigate the dynamics of special solutions to the surface diffusion flow of idealised ribbons. This equation reduces to studying the curve diffusion flow for the profile curve of the ribbon. We provide: (1) a complete classification of stationary solutions; (2) qualitative results on shrinkers, tr…
We introduce cylindrical projections to simulate infinite-dimensional occupation flows of diffusions.
problem Computational intractability of infinite-dimensional occupation flows of diffusions.
method Introduce cylindrical projections to approximate the occupation flow via a finite-dimensional system.
result Strong convergence of cylindrical projections to the initial process with derived rates.
New method for estimating diffusion model densities without solving flows.
problem Estimating log densities from diffusion models efficiently.
method Monte Carlo path integral estimation, avoiding flow solving.
result Significantly more scalable and efficient density estimation.
The paper justifies time-dependent loss reweighting schemes for flow matching and diffusion models.
problem Theoretical justification for time-dependent loss reweighting schemes in flow matching and diffusion models.
method Clarifies that the loss can depend on both time and state, and shows theoretical justification for time-dependent loss weighting schemes.
result Time-dependent loss weighting schemes are theoretically justified for Generator Matching and Edit Flows.
New method learns discrete graph diffusion via free-energy gradient flows.
problem Challenges in translating continuous diffusion models to discrete spaces.
method Proposes a novel computational approach using a specific metric on the simplex.
result Recover the underlying functional for various graph classes.
Improved NPE with conditional diffusions and summary networks.
problem Approximating complex posterior distributions efficiently and accurately.
method Conditional diffusions coupled with high-capacity summary networks.
result Conditional diffusions offer improved stability, accuracy, and faster training times.
New diffusion models capture heavy-tailed distributions better.
problem Diffusion models struggle with rare or extreme events in heavy-tailed distributions.
method Repurposed diffusion framework using multivariate Student-t distributions, tailored perturbation kernel, and γ γ γ -divergence. result Our models generate rare and extreme events more effectively than standard diffusion models.
Bi-Lipschitz flows approximate a wide range of distributions.
problem Characterizing the expressivity of bi-Lipschitz normalizing flows.
method Linking score regularity to transport map bi-Lipschitzness via probability flow ODE.
result Gaussian pullbacks induced by bi-Lipschitz variance-preserving transport maps are L 1 L^1 L 1 -dense among all probability densities. Curve diffusion flow straightens curves with endpoints on intersecting lines.
problem Straightening open curves with endpoints on intersecting lines.
method Curve diffusion flow with mixed boundary conditions.
result The curve converges to a circular arc of the same length.
New error bounds for flow matching methods using deterministic sampling.
problem Improving the accuracy of flow matching methods for generating probability distributions.
method Derived error bounds for flow matching methods under deterministic sampling conditions.
result Presented error bounds for flow matching methods using L 2 L^2 L 2 loss and regularity conditions. Novel alignment framework for text-to-image generation using diffusion models and flow matching.
problem Improving text-to-image generation with minimal computational resources.
method Proposes a novel alignment framework that decomposes the score function into pre-trained score plus a conditional expectation of the reward.
result Achieves comparable performance to finetuning-based models with reduced computational cost.
We prove a blow-up criterion in terms of an L 2 L_2 L 2 -bound of the curvature for solutions to the curve diffusion flow if the maximal time of existence is finite. In our setting, we consider an evolving family of curves driven by curve diffusion flow, which has free boundary points supported on a line. The evolving curve h…
Language Rectified Flow improves diffusion language generation by simplifying complex steps.
problem Complexity in diffusion language models limits their implementation in NLP applications.
method Reformulates probabilistic flow models to learn neural ODE models for efficient domain transfer.
result Consistently outperforms baselines on fine-grained control tasks and text editing.
Generative models tackle incompressible fluid flows by enforcing divergence-free constraints.
problem Simulating incompressible fluid flows with generative models.
method Score-based diffusion models with divergence-free constraint.
result Models can reproduce Kolmogorov turbulence characteristics.
LFM learns a sequence of smaller models to generate data from noise.
problem Learning continuous, invertible flows between distributions.
method Stepwise Local Flow Matching (LFM) model, matching diffusion processes up to time-step size.
result LFM achieves competitive generative performance compared to Flow Matching.
Sharp Lipschitz bounds for flow-matching and diffusion models with optimal sampling rates.
problem Establishing optimal Lipschitz regularity for flow-matching and diffusion models.
method Sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores.
result Achieves optimal sampling rate of d / N \sqrt{d}/N d / N for Euler-type samplers in dimension d d d . Riemannian stochastic gradient descent approximates a diffusion process called Riemannian stochastic modified flow.
problem Improving convergence rate of Riemannian stochastic gradient descent.
method Using stochastic differential geometry, the paper shows RSGD can be approximated by the Riemannian stochastic modified flow (RSMF).
result RSGD can be approximated by the solution to the RSMF driven by an infinite-dimensional Wiener process, increasing the order of approximation.
The paper improves the probability flow ODE sampler for faster sampling of natural images.
problem Improving the convergence rate of the probability flow ODE sampler.
method Adapting the probability flow ODE sampler to exploit intrinsic low-dimensional structures in natural image data.
result Achieves a dimension-free convergence rate of O ( k / T ) O(k/T) O ( k / T ) in total variation distance, improving upon existing results. New method learns diffusion transition density for Bayesian inference.
problem Bayesian inference on diffusions with inaccessible boundaries.
method Neural Galerkin framework to solve FP equation with Dirac mass.
result Approximates likelihood function for efficient posterior sampling.
New theory improves diffusion model convergence for generating data.
problem Improving convergence of diffusion models for data generation.
method Developed a non-asymptotic convergence theory for probability flow ODEs.
result Proves d / ε d/\varepsilon d / ε iterations suffice for approximating target distributions. Analyzed geometric and diffusion properties of a coupled system.
problem Qualitative behavior of a geometric evolution coupled with diffusion.
method Mean curvature flow scaled with diffusion equation analysis.
result Surface area strictly decreases, but solutions can exist infinitely.
Study on curve diffusion flows with scale-critical curvature term.
problem Analyzing stability of curve diffusion flows with scale-critical curvature.
method Introduced and studied a one-parameter family of curve diffusion flows with a scale-critical cubic curvature term. Analyzed dynamical stability of homothetic circles using variational methods.
result Established that any small perturbation of an ω ω ω -fold circle monotonically approaches the unit ω ω ω -circle after rescaling, translation, and reparametrisation. New method speeds up generative modeling without requiring diffusion steps.
problem Improving the speed and efficiency of generative modeling techniques.
method Probability flow ODE with a corrector step, achieving better dimension dependence.
result Better dimension dependence ( O ( d ) O(\sqrt{d}) O ( d ) vs. O ( d ) O(d) O ( d ) , assuming smoothness of the data distribution). We consider closed immersed hypersurfaces in R 3 \R^3 R 3 and R 4 \R^4 R 4 evolving by a special class of constrained surface diffusion flows. This class of constrained flows includes the classical surface diffusion flow. In this paper we present a Lifespan Theorem for these flows, which gives a positive lower bound on the time fo…
Graph neural network using Beltrami flow for feature and topology evolution.
problem Efficient feature learning and topology evolution on graphs.
method Discretized Beltrami flow applied to graph neural networks with positional encodings.
result Achieves state-of-the-art results on various benchmarks.
Improved KL bounds and Wasserstein guarantees for diffusion flow matching under minimal conditions.
problem Theoretical convergence properties of Brownian motion based diffusion flow matching.
method Refined analysis under Kullback-Leibler and 2-Wasserstein distances.
result State-of-the-art scaling in KL convergence bounds under minimal conditions.
We study the phase field method for the volume preserving mean curvature flow. Given an initial C 1 C^1 C 1 hypersurface we proved the existence of the weak solution for the volume preserving mean curvature flow via the reaction diffusion equation with a nonlocal term. We also show the monotonicity formula and the density up…
New algorithm trains latent diffusion models using interacting particles.
problem Training latent diffusion models efficiently and accurately.
method Reformulate training as minimizing a free energy functional, then approximate with interacting particles.
result The new algorithm outperforms previous methods in experiments.
New formulas derived for scalar curvature in generalized Ricci flow.
problem Scalar curvature in generalized Ricci flow.
method Derivation of weighted scalar curvature monotonicity formulas and Perelman-type energy/entropy formulas.
result New convex Nash entropies and pseudolocality principles.
Unified framework for training diffusion and flow models to sample from target distributions.
problem Training diffusion and flow models to sample from target distributions defined by exponential tilting.
method Unified framework combining stochastic optimal control and non-equilibrium thermodynamics perspectives.
result Unified bias-variance decompositions and theoretical support for adjoint-based methods.
A simplified tutorial on diffusion models for beginners.
problem Educating technical audiences on diffusion models.
method Simplified mathematical explanations and heuristic derivations.
result Accessible algorithms for diffusion models.
Adjoint Matching improves flow and diffusion models with reward fine-tuning.
problem Improving generative models with reward fine-tuning.
method Casting reward fine-tuning as stochastic optimal control (SOC) and enforcing a specific noise schedule.
result Adjoint Matching outperforms existing SOC algorithms.