Generative model for condensed matter using Riemannian flow matching.
problem Sampling equilibrium distributions in condensed-phase systems.
method Riemannian flow matching to incorporate periodicity, using Hutchinson's trace estimator and cumulant expansion for bias correction.
result Highly accurate free energy estimates on monatomic ice without multistage estimators.
RG-VFM extends VFM to curved manifolds for better material and protein design.
problem Designing materials and proteins on curved manifolds.
method Riemannian Gaussian Variational Flow Matching (RG-VFM) for generative modeling on manifolds.
result RG-VFM more effectively captures manifold structure and improves performance.
RFM uses tangent vector fields to match data on manifolds, analyzing TV convergence for Euler discretization.
problem Matching data on curved manifolds using flow-based models.
method Developed a nonasymptotic TV convergence analysis for RFM samplers using Euler discretization.
result Explicit bounds on TV convergence separating numerical discretization and learning errors.
Unified framework for human motion generation on Riemannian manifolds.
problem Learning valid human motion in Euclidean spaces.
method Riemannian Motion Generation (RMG) on product manifolds, Riemannian flow matching.
result Achieves state-of-the-art FID (0.043) on HumanML3D and surpasses strong baselines on MotionMillion.
RFM simplifies generative modeling on complex geometries without simulation.
problem Training generative models on non-Euclidean geometries is challenging.
method Riemannian Flow Matching (RFM) constructs a premetric for efficient vector field computation.
result RFM achieves state-of-the-art performance on various non-Euclidean datasets.
This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
Study of integral flows on Riemannian manifolds with focus on blow-up profiles and concentration-compactness.
problem Analyzing nonlinear integral flows on Riemannian manifolds with specific focus on blow-up profiles and concentration-compactness.
method Investigation of a family of nonlinear integral flows involving Riesz potentials, focusing on the Hardy-Littlewood-Sobolev (HLS) subcritical and critical regimes.
result Established convergence on unit spheres and certain locally conformally flat manifolds for the dual Yamabe flow.
FlowMM models stable crystal structures efficiently.
problem Predicting and proposing stable crystalline structures.
method Riemannian Flow Matching generalized to crystal symmetries.
result 3x more efficient at finding stable materials.
M-FFF generates data on manifolds with fast sampling.
problem Sampling on arbitrary manifolds is computationally expensive.
method Optimizes a neural network via maximum likelihood on the manifold.
result Consistently matches or outperforms previous methods.
DiffeoCFM efficiently generates realistic brain connectivity matrices using pullback metrics.
problem Generating realistic brain connectivity matrices for population heterogeneity analysis.
method Conditional flow matching on matrix manifolds via pullback metrics induced by global diffeomorphisms.
result DiffeoCFM achieves state-of-the-art performance on large-scale fMRI and EEG datasets.
The paper generalizes rigidity results for contact Anosov flows with bunching assumption.
problem Rigidity of contact Anosov flows in higher dimensions.
method Application of matching functions technique with bunching assumption.
result If two contact Anosov flows are C0 conjugate, they are Cr conjugate for some r∈[1,2) or even C∞ conjugate under additional assumptions. Gu and Zhu have shown that Type-II Ricci flow singularities develop from nongeneric rotationally symmetric Riemannian metrics on Sm, for all m≥3. In this paper, we describe and provide plausibility arguments for a detailed asymptotic profile and rate of curvature blow-up that we predict such solutions exhibit.
FlowLLM uses LLMs and flow matching to efficiently generate novel materials.
problem Challenging material discovery due to vast chemical space.
method Combines LLMs and Riemannian flow matching to design novel crystalline materials.
result Significantly increases generation rate of stable materials and unique crystals.
We improve density-based distances using normalizing flows and score matching.
problem Inaccurate density estimates and poor convergence in graph-based methods for high-dimensional spaces.
method Learn densities with normalizing flows and refine geodesics with a score model.
result Improved density-based distances that scale to high dimensions and improve numerical stability.
SFM matches flows on statistical manifolds for better discrete generation.
problem Discrete generation on statistical manifolds with strong prior assumptions.
method Statistical Flow Matching (SFM) on manifold of categorical distributions using Fisher information metric.
result SFM achieves higher sampling quality and likelihood than other models.
MFM improves generative model interpolations by learning approximate geodesics on data manifolds.
problem Straight interpolations fail to capture dynamics on data manifolds.
method Metric Flow Matching (MFM) learns approximate geodesics by minimizing kinetic energy of a data-induced Riemannian metric.
result MFM outperforms Euclidean baselines, achieving SOTA on single-cell trajectory prediction.
Topological Flow Matching: A Generative Modeling Framework for Structured Spaces
problem Handling structured spaces in generative modeling
method Introducing topological flow matching
result Captures the structure of the underlying domain while preserving desirable properties
A new method for generative modeling of discrete data using geometric latent subspaces.
problem Learning generative models for discrete data with statistical dependencies.
method Geometric latent-subspace framework in exponential parameter space of product manifolds of categorical distributions.
result Low-dimensional latent space encodes statistical dependencies and accurately models high-dimensional discrete data.
PFM generates novel samples on data manifolds using pullback geometry.
problem Generating novel samples on complex data manifolds.
method Pullback Flow Matching framework leveraging pullback geometry and isometric learning.
result PFM achieves improved manifold learning and generative performance.
Flow matching KL divergence bound derived for smooth distributions.
problem Estimating smooth distributions efficiently.
method Deterministic upper bound on KL divergence derived from flow-matching loss.
result Flow matching achieves nearly minimax-optimal efficiency under TV distance.
Generative model learns from simpler distributions on Lie groups.
problem Learning from complex Lie group data.
method Substituting exponential curves for line segments on Lie groups.
result Simple, intrinsic, and fast implementation for generative modelling.
Closed-form flow matching yields similar performance to stochastic version, improving model performance.
problem Understanding why flow matching models generalize well.
method Empirical analysis and comparison of stochastic and closed-form flow matching losses.
result Closed-form flow matching can improve model performance.
CatFlow uses variational flow matching for efficient graph generation.
problem Graph generation tasks, especially for categorical data.
method Variational flow matching for categorical data, computationally efficient.
result CatFlow achieves strong results on graph generation tasks.
Flow Matching improves statistical guarantees through kernel density estimation.
problem Improving statistical guarantees for generative models.
method Connecting Flow Matching to kernel density estimation and verifying optimal rates of convergence.
result Flow Matching achieves optimal rates up to logarithmic factors for large networks and on lower-dimensional manifolds.
Paper proves higher-order flow matching preserves optimality in generative modeling.
problem Theoretical guarantees for higher-order flow matching in generative modeling.
method Neural network approximations with controlled depth, width, and sparsity.
result Proves worst case optimality for second-order flow matching.
RFM improves CNFs by adding a boundary constraint term and matching velocity fields.
problem Flow matching on constrained domains leads to unnatural samples.
method RFM adds a boundary constraint term and matches velocity fields in a simulation-free manner.
result RFM achieves comparable or better results on standard image benchmarks and produces high-quality samples.
Improved sampling efficiency for molecular systems using path gradients after Flow Matching.
problem Improving sampling efficiency for complex molecular systems.
method Hybrid approach combining Flow Matching and path gradients.
result Up to a threefold increase in sampling efficiency for molecular systems.
The paper justifies time-dependent loss reweighting schemes for flow matching and diffusion models.
problem Theoretical justification for time-dependent loss reweighting schemes in flow matching and diffusion models.
method Clarifies that the loss can depend on both time and state, and shows theoretical justification for time-dependent loss weighting schemes.
result Time-dependent loss weighting schemes are theoretically justified for Generator Matching and Edit Flows.
Flow Matching enables robust training of CNFs with various probability paths.
problem Training Continuous Normalizing Flows (CNFs) at large scales.
method Flow Matching (FM) is a simulation-free approach for training CNFs by regressing vector fields of conditional probability paths.
result Flow Matching with diffusion paths yields more robust and stable training compared to diffusion-based methods.
LFM learns a sequence of smaller models to generate data from noise.
problem Learning continuous, invertible flows between distributions.
method Stepwise Local Flow Matching (LFM) model, matching diffusion processes up to time-step size.
result LFM achieves competitive generative performance compared to Flow Matching.
New error bounds for flow matching methods using deterministic sampling.
problem Improving the accuracy of flow matching methods for generating probability distributions.
method Derived error bounds for flow matching methods under deterministic sampling conditions.
result Presented error bounds for flow matching methods using L2 loss and regularity conditions. Flow matching adapts to manifold structures without diffusion.
problem Theoretical understanding of flow matching in manifold-supported settings.
method Flow matching with linear interpolation on smooth manifolds, analyzing velocity field and density estimator.
result Non-asymptotic convergence guarantee and statistical consistency of flow matching on manifolds.
Unified framework for continuous-state discrete flow matching models.
problem Discrete generative modeling with continuous probabilities.
method Introducing α-Flow, a family of CS-DFM models based on information geometry. result Optimal flow matching loss for α-flow minimizes generalized kinetic energy. When maximum likelihood estimation is infeasible, one often turns to score matching, contrastive divergence, or minimum probability flow to obtain tractable parameter estimates. We provide a unifying perspective of these techniques as minimum Stein discrepancy estimators, and use this lens to design new diffusion kerne…
DFM simplifies CNF training without interpolants.
problem Efficiently training CNFs with computationally expensive ODE solving.
method DFM optimizes dual vector fields for bijective transformations.
result DFM outperforms CNF trained with FM or ML objectives.
CFMI improves missing data imputation across various data types and dimensions.
problem Imputing missing data in complex, high-dimensional datasets.
method Combines normalising flows, flow-matching, and shared conditional modelling.
result Outperforms traditional and modern imputation methods across multiple metrics.
A new method learns straight trajectories in one step for optimal flow matching.
problem Learning flows with straight trajectories for fast inference.
method Optimal Flow Matching (OFM) approach using convex functions for vector fields.
result Recovering straight OT displacements in just one FM step for quadratic transport.
GLASS Flows improves flow and diffusion model performance by optimizing sampling efficiency.
problem Efficiency bottleneck in sampling Markov transitions for flow and diffusion models.
method Introduces GLASS Flows, a new sampling paradigm that simulates a 'flow matching model within a flow matching model' to sample Markov transitions efficiently.
result Eliminates the trade-off between stochastic evolution and efficiency in large-scale text-to-image models.
Abstract notes on generative modeling techniques.
problem Improving generative modeling techniques.
method Connections between optimal transport and Schrödinger bridge, flow matching.
result Showed connections between mathematical principles and generative modeling techniques.
Improved image generation through iterative flow matching to reduce hallucinations.
problem Hallucinations in image generation models.
method Iterative flow matching to refine and correct paths in generative models.
result Enhanced generative modeling with reduced unrealistic images.
A new training method for efficient Boltzmann generators.
problem Training equivariant continuous normalizing flows (CNFs) is computationally expensive.
method Equivariant flow matching, based on optimal transport flow matching.
result Equivariant flow matching yields more efficient flows with shorter integration paths.
EnFF uses flows to speed up DA in high dimensions.
problem Efficiently assimilating noisy data in high-dimensional systems.
method Flow Matching (FM) for training-free, scalable data assimilation.
result EnFF accelerates DA with improved cost-accuracy tradeoffs and scalability.
The paper matches features in images using centro-affine invariants and heat flow.
problem Feature matching in images with invariant algorithms.
method Developed an invariant algorithm using centro-affine invariants and heat flow.
result The algorithm compares favorably with existing feature matching methods.
Flow matching improves synthetic data generation for tabular data.
problem Generating synthetic tabular data while preserving privacy.
method Flow matching (FM) and Variational FM for tabular data synthesis.
result FM outperforms diffusion baselines in tabular data synthesis.
CPFM integrates dimensionality reduction and reconstruction with flow networks.
problem Learning coupled continuous flows for data and embeddings.
method Coupled flow matching framework with Gromov-Wasserstein objective and dual-conditional flow network.
result CPFM preserves and recovers residual information in latent space.
Develops Hamiltonian Score Matching and Generative Flows for machine learning.
problem Estimating score functions and designing generative models.
method Introduces Hamiltonian velocity predictors (HVPs) for score matching and generative flows.
result Hamiltonian Generative Flows (HGFs) rival leading generative modeling techniques.
Improved flow matching using Gaussian processes for better sample quality.
problem Training continuous normalizing flows with reduced variance and flexibility.
method Extending conditional flow matching to streams modeled with Gaussian processes.
result Improved quality of generated samples with moderate computational cost.
We extend rectified flow to infinite-dimensional Hilbert space.
problem Extending rectified flow to infinite-dimensional spaces.
method Established a rigorous functional formulation using the superposition principle for continuity equations.
result Demonstrated superior performance compared to existing models.