Unified framework for continuous-state discrete flow matching models.
problem Discrete generative modeling with continuous probabilities.
method Introducing α α α -Flow, a family of CS-DFM models based on information geometry. result Optimal flow matching loss for α α α -flow minimizes generalized kinetic energy. New method reduces discrete flow transitions, improving perplexity estimation.
problem Stochasticity in discrete paths makes rectification strategies ineffective.
method Dynamic-optimal-transport-like minimization objective with minibatch strategies.
result 32 times reduction in transitions for same perplexity.
Paper proposes a new generative model for discrete distributions using flows on submanifolds.
problem Discretization issues and complex statistical dependencies in discrete data.
method Continuous normalizing flows on factorizing discrete measures, geodesic flow matching.
result Efficient training and broad applicability demonstrated through experiments.
Exact guidance for discrete data improves posterior sampling efficiency.
problem Inefficient guidance for discrete data in posterior sampling.
method Derive exact transition rate for desired distribution given learned discrete flow matching model.
result Significantly improved efficiency with single forward pass per sampling step.
Branching Flows generates sequences of varying lengths using binary trees.
problem Generating sequences of unknown lengths or fixed elements.
method A generative modeling framework that evolves states over binary trees, controlling sequence length.
result Branching Flows can generate sequences of varying lengths and mix different types of state spaces.
Unified error analysis for discrete flow models.
problem Error analysis of discrete flow models.
method Stochastic calculus theory, Girsanov theorem, generator matching, uniformization.
result First error analysis for discrete flow models.
RFM uses tangent vector fields to match data on manifolds, analyzing TV convergence for Euler discretization.
problem Matching data on curved manifolds using flow-based models.
method Developed a nonasymptotic TV convergence analysis for RFM samplers using Euler discretization.
result Explicit bounds on TV convergence separating numerical discretization and learning errors.
Sharp Lipschitz bounds for flow-matching and diffusion models with optimal sampling rates.
problem Establishing optimal Lipschitz regularity for flow-matching and diffusion models.
method Sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores.
result Achieves optimal sampling rate of d / N \sqrt{d}/N d / N for Euler-type samplers in dimension d d d . SFM matches flows on statistical manifolds for better discrete generation.
problem Discrete generation on statistical manifolds with strong prior assumptions.
method Statistical Flow Matching (SFM) on manifold of categorical distributions using Fisher information metric.
result SFM achieves higher sampling quality and likelihood than other models.
DFMs enable flow-based models for multimodal discrete and continuous data.
problem Combining discrete and continuous data for generative models.
method Discrete Flow Models (DFMs) using Continuous Time Markov Chains.
result DFMs achieve state-of-the-art co-design performance for protein structure and sequence generation.
DFM models are analyzed for generating distributions with provable convergence.
problem Training DFM models to generate distributions that match true data.
method Theoretical analysis decomposes error into approximation and estimation errors.
result DFM models converge to true data distribution as training set size increases.
The paper justifies time-dependent loss reweighting schemes for flow matching and diffusion models.
problem Theoretical justification for time-dependent loss reweighting schemes in flow matching and diffusion models.
method Clarifies that the loss can depend on both time and state, and shows theoretical justification for time-dependent loss weighting schemes.
result Time-dependent loss weighting schemes are theoretically justified for Generator Matching and Edit Flows.
Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete random variables such as text, but directly applying normalizing flows to discret…
Flow Annealing Posterior Sampling unifies stochastic-process regression and PDE inverse problems.
problem Function-space posterior sampling for stochastic processes and inverse problems.
method Flow Annealing Posterior Sampling (FAPS) using pretrained function-space flow-matching priors.
result Coherent posterior samples with accurate uncertainty quantification.
A new method for generative modeling of discrete data using geometric latent subspaces.
problem Learning generative models for discrete data with statistical dependencies.
method Geometric latent-subspace framework in exponential parameter space of product manifolds of categorical distributions.
result Low-dimensional latent space encodes statistical dependencies and accurately models high-dimensional discrete data.
Generative model for joint discrete distributions using randomized assignment flows.
problem Efficiently representing and sampling from complex joint distributions of discrete variables.
method Randomized assignment flows on the statistical submanifold of factorizing distributions.
result Our model can efficiently represent and sample from any target distribution and assess likelihood of unseen data points.
Improved KL bounds and Wasserstein guarantees for diffusion flow matching under minimal conditions.
problem Theoretical convergence properties of Brownian motion based diffusion flow matching.
method Refined analysis under Kullback-Leibler and 2-Wasserstein distances.
result State-of-the-art scaling in KL convergence bounds under minimal conditions.
NeuTSFlow models continuous functions behind time series forecasting.
problem Forecasting treats time series as discrete sequences, ignoring their continuous nature.
method NeuTSFlow uses Neural Operators to learn the transition between historical and future function families.
result NeuTSFlow outperforms traditional methods in forecasting accuracy and robustness.
A new method generates mixed-type features in tabular data with improved realism and accuracy.
problem Generating mixed-type features combining discrete and continuous data is challenging.
method A cascaded approach: first generates low-resolution categorical and coarse numerical features, then uses these in a high-resolution flow matching model.
result The model significantly improves detection scores, generating more realistic samples and capturing distributional details.
The aim of this paper is to develop a refinement of Forman's discrete Morse theory. To an acyclic partial matching μ μ μ on a finite regular CW complex X X X , Forman introduced a discrete analogue of gradient flows. Although Forman's gradient flow has been proved to be useful in practical computations of homology groups, i…
The paper constructs optimal confidence bands for kernel gradient flow estimators.
problem Estimating generalization error and constructing confidence bands for kernel gradient flows.
method Established convergence rates and constructed optimal confidence bands under capacity-source condition.
result Optimal confidence bands for kernel gradient flows have shrinkage rates close to minimax optimal rates.
Flow Matching models help generative models stay within the subspace of real data.
problem How do generative models stay within the subspace of real data?
method Flow Matching models using a learned velocity field to transform a simple prior into a complex target distribution.
result Generated samples memorize real data points and represent the sample data subspace exactly.
This paper improves the efficiency of generative models by optimizing the straightness of Rectified Flow.
problem Improving the efficiency of generative models by reducing discretization error.
method Introducing a novel Piecewise Straightness parameter, γ2,T, to optimize the straightness of Rectified Flow.
result Minimizing curvature in Rectified Flow models leads to high-fidelity, one-step sampling.
GraphBSI generates graphs by refining a belief in continuous space, outperforming existing models.
problem Generating discrete, unordered graph data is challenging for traditional models.
method GraphBSI uses Bayesian Sample Inference (BSI) to iteratively refine a belief over graph distribution parameters.
result GraphBSI outperforms existing one-shot graph generative models on molecular and synthetic graph generation benchmarks.
GENOT matches cells across data modalities using neural OT solvers.
problem Scalability, privacy, and out-of-sample estimation issues in traditional OT solvers.
method Learn stochastic maps, parameterize OT maps, relax mass conservation, integrate quadratic solvers.
result Demonstrates significant potential for enhancing therapeutic strategies.
Topological Flow Matching: A Generative Modeling Framework for Structured Spaces
problem Handling structured spaces in generative modeling
method Introducing topological flow matching
result Captures the structure of the underlying domain while preserving desirable properties
We introduce the discrete Einstein metrics as critical points of discrete energy on triangulated 3-manifolds, and study them by discrete curvature flow of second (fourth) order. We also study the convergence of the discrete curvature flow. Discrete curvature flow of second order is an analogue of smooth Ricci flow.
Flow matching KL divergence bound derived for smooth distributions.
problem Estimating smooth distributions efficiently.
method Deterministic upper bound on KL divergence derived from flow-matching loss.
result Flow matching achieves nearly minimax-optimal efficiency under TV distance.
Generative models learn latent process to match target distributions.
problem Training flow-matching models with auxiliary stochastic dynamics.
method Introduces latent process generator matching, treating generative state as a deterministic image of a Markov process.
result Learn generator of a stochastic process with same marginal distributions.
Proposes DAM for optimizing discrete generative models.
problem Challenges in optimizing discrete generative models.
method Discrete Adjoint Matching (DAM) for discrete state spaces.
result Demonstrates effectiveness on synthetic and mathematical reasoning tasks.
Closed-form flow matching yields similar performance to stochastic version, improving model performance.
problem Understanding why flow matching models generalize well.
method Empirical analysis and comparison of stochastic and closed-form flow matching losses.
result Closed-form flow matching can improve model performance.
While normalizing flows have led to significant advances in modeling high-dimensional continuous distributions, their applicability to discrete distributions remains unknown. In this paper, we show that flows can in fact be extended to discrete events---and under a simple change-of-variables formula not requiring log-d…
CatFlow uses variational flow matching for efficient graph generation.
problem Graph generation tasks, especially for categorical data.
method Variational flow matching for categorical data, computationally efficient.
result CatFlow achieves strong results on graph generation tasks.
In this paper, we introduce a parameterized discrete curvature ( α α α -curvature) for piecewise linear metrics on polyhedral surfaces, which is a generalization of the classical discrete curvature. A discrete uniformization theorem is established for the parameterized discrete curvature, which generalizes the discrete uni…
Flow Matching improves statistical guarantees through kernel density estimation.
problem Improving statistical guarantees for generative models.
method Connecting Flow Matching to kernel density estimation and verifying optimal rates of convergence.
result Flow Matching achieves optimal rates up to logarithmic factors for large networks and on lower-dimensional manifolds.
Novel framework combines tree-based discretization and ILP matching for causal inference.
problem Challenges in identifying causal relationships from observational data.
method Combines tree-based discretization and ILP matching for causal inference.
result Yields computational efficiency and less biased ATT estimates.
Paper proves higher-order flow matching preserves optimality in generative modeling.
problem Theoretical guarantees for higher-order flow matching in generative modeling.
method Neural network approximations with controlled depth, width, and sparsity.
result Proves worst case optimality for second-order flow matching.
RFM improves CNFs by adding a boundary constraint term and matching velocity fields.
problem Flow matching on constrained domains leads to unnatural samples.
method RFM adds a boundary constraint term and matches velocity fields in a simulation-free manner.
result RFM achieves comparable or better results on standard image benchmarks and produces high-quality samples.
Improved sampling efficiency for molecular systems using path gradients after Flow Matching.
problem Improving sampling efficiency for complex molecular systems.
method Hybrid approach combining Flow Matching and path gradients.
result Up to a threefold increase in sampling efficiency for molecular systems.
Study of Ricci flow on discrete surfaces of revolution with constant Gaussian curvature.
problem Understanding Ricci flow on discrete surfaces of revolution.
method Explicit parametrizations and Ricci flow analysis for discrete surfaces of revolution.
result Discrete surfaces of revolution approach constant Gaussian curvature under Ricci flow.
This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
Flow Matching enables robust training of CNFs with various probability paths.
problem Training Continuous Normalizing Flows (CNFs) at large scales.
method Flow Matching (FM) is a simulation-free approach for training CNFs by regressing vector fields of conditional probability paths.
result Flow Matching with diffusion paths yields more robust and stable training compared to diffusion-based methods.
IDF++ improves integer discrete flows for lossless compression.
problem Theoretical limitations of integer discrete flows for lossless compression.
method Investigated and improved integer discrete flows, addressing gradient bias and architecture modifications.
result Different architecture modifications improve integer discrete flows for lossless compression.
New error bounds for flow matching methods using deterministic sampling.
problem Improving the accuracy of flow matching methods for generating probability distributions.
method Derived error bounds for flow matching methods under deterministic sampling conditions.
result Presented error bounds for flow matching methods using L 2 L^2 L 2 loss and regularity conditions. LFM learns a sequence of smaller models to generate data from noise.
problem Learning continuous, invertible flows between distributions.
method Stepwise Local Flow Matching (LFM) model, matching diffusion processes up to time-step size.
result LFM achieves competitive generative performance compared to Flow Matching.
Flow matching adapts to manifold structures without diffusion.
problem Theoretical understanding of flow matching in manifold-supported settings.
method Flow matching with linear interpolation on smooth manifolds, analyzing velocity field and density estimator.
result Non-asymptotic convergence guarantee and statistical consistency of flow matching on manifolds.
Discrete Flow Maps bypass sequential prediction limits for parallel text generation.
problem Sequential autoregressive prediction limits large language model speed.
method Flow Maps compress generative trajectories into single-step mappings.
result Discrete Flow Maps surpass previous state-of-the-art results in discrete flow modeling.
The paper studies deformation of discrete conformal structures on surfaces using combinatorial curvature flows.
problem Finding piecewise constant curvature metrics on surfaces with prescribed combinatorial curvatures.
method Combinatorial curvature flows, including Ricci flow and Calabi flow, are applied to deform Glickenstein's discrete conformal structures.
result The solution of the combinatorial Ricci flow can be uniquely extended and converges exponentially fast for any initial value under certain conditions.