GENOT matches cells across data modalities using neural OT solvers.
problem Scalability, privacy, and out-of-sample estimation issues in traditional OT solvers.
method Learn stochastic maps, parameterize OT maps, relax mass conservation, integrate quadratic solvers.
result Demonstrates significant potential for enhancing therapeutic strategies.
Neural solver computes Wasserstein geodesics and velocity fields efficiently.
problem Computing Wasserstein geodesics and velocity fields efficiently.
method Sample-based neural network approach to solve the minimax problem.
result Directly samples from target distribution and estimates velocity field.
New EOT solvers estimate both plans and maps efficiently.
problem Difficulty in tuning entropic regularization strength in EOT solvers.
method Time discretization and proper parameter scheduling to optimize EOT computation.
result ProgOT is faster and more robust, outperforming neural networks.
A practical algorithm improves approximate OT distances using quantization.
problem Substantial computational burden in computing OT distances for large samples.
method Introduces a quantization step to estimate OT distances between measures.
result The quantization step improves the performance of approximate solvers for entropy-regularized transport.
A new method combines energy-based models and entropy-regularized optimal transport.
problem Combining energy-based models and optimal transport for generative modeling.
method Energy-guided Entropic Neural Optimal Transport (E-ENT)
result Proves generalization bounds and validates scalability in image translation.
Meta Optimal Transport learns from past problems to solve similar OT problems faster.
problem Solving similar optimal transport problems repeatedly from scratch is inefficient.
method Amortized optimization to predict optimal transport maps from past solutions.
result Meta OT models can solve new problems faster than standard methods.
GeONet learns the Wasserstein geodesic without mesh discretization.
problem Computing the Wasserstein geodesic between complex data distributions.
method Mesh-invariant deep neural operator network that learns saddle point optimality conditions.
result GeONet achieves comparable accuracy to standard OT solvers with reduced computational cost.
New estimators for intrinsic dimension and Wasserstein distance improve OT accuracy.
problem Intrinsic dimension estimation and Wasserstein distance estimation in large-scale OT.
method Introduces novel estimators for intrinsic dimension and Wasserstein distance.
result Simple, tuning-free estimator of OT and fast intrinsic dimension estimator.
cuRegOT accelerates GPU-based entropic OT solving.
problem Slow convergence and high computational cost of optimal transport on GPUs.
method High-performance GPU solver with algorithmic and architectural optimizations.
result Significant speedups over state-of-the-art solvers.
DRAG decreases regularization to accelerate semi-discrete OT convergence.
problem Mitigating bias in semi-discrete OT problems with entropic regularization.
method DRAG: Decreasing Regularization Averaged Gradient, a stochastic gradient descent algorithm.
result DRAG achieves unbiased O ( 1 / t ) \mathcal{O}(1/t) O ( 1/ t ) sample and iteration complexity for OT cost and potential estimation, and O ( 1 / t ) \mathcal{O}(1/\sqrt{t}) O ( 1/ t ) rate for OT map. Riemannian Neural OT maps improve scalability on manifolds.
problem Challenges in extending neural OT to high-dimensional Riemannian manifolds.
method Introduces Riemannian Neural OT (RNOT) maps that avoid discretization and incorporate geometric structure.
result RNOT maps approximate Riemannian OT maps with sub-exponential complexity in the dimension.
Combines OT and PCA for DR, preserving clusters.
problem Analyzing high-dimensional data with global dependencies.
method Optimal transport (OT) for minimizing reconstruction error, combined with PCA.
result Effective preservation of high-dimensional clusters in embeddings.
Stochastic optimization improves semi-discrete OT map estimation with a minimax rate.
problem Empirical success of SGD in semi-discrete OT, but lack of theoretical guarantees.
method Averaged projected SGD with a minimax convergence rate of O(1/√n).
result SGD methods can estimate the OT map with a minimax convergence rate of O(1/√n).
Paper solves inverse optimal transport problem with convex optimization and neural network.
problem Learning the cost function for optimal transport from observed data.
method Unconstrained convex optimization, Sinkhorn-Knopp algorithm, and deep neural network parameterization.
result Novel framework avoids repeated OT solving, demonstrating efficiency and accuracy.
LOT improves optimal transport for large datasets.
problem Efficient optimal transport for large datasets.
method Low-rank optimal transport (LOT) restricts search to low-nonnegative rank couplings.
result LOT complements and improves upon entropic regularization.
A new method computes high-dimensional optimal transport using flow neural networks.
problem Computing optimal transport for high-dimensional data.
method Optimizing a flow model to minimize transport cost between two arbitrary distributions.
result Trained optimal transport flow enables downstream tasks like DRE and domain adaptation.
A JAX toolbox solves optimal transport problems for point clouds and histograms.
problem Optimal transport problems between point clouds and histograms.
method Automatic and custom reverse mode differentiation, vectorization, just-in-time compilation, and accelerators support.
result Solves a wide range of optimal transport problems including regularized OT, barycenters, Gromov-Wasserstein, and low-rank solvers.
Optimal transport (OT) theory can be informally described using the words of the French mathematician Gaspard Monge (1746-1818): A worker with a shovel in hand has to move a large pile of sand lying on a construction site. The goal of the worker is to erect with all that sand a target pile with a prescribed shape (for …
A new method for flow matching reduces computational costs and improves performance.
problem Efficiently matching flow models to target data distributions.
method Semidiscrete formulation of optimal transport (SD-OT) using SGD and maximum inner product search (MIPS).
result Semidiscrete FM (SD-FM) outperforms batch-OT and traditional flow matching methods.
Large Sinkhorn couplings improve flow models in data generation tasks.
problem Training flow models with optimal transport couplings.
method Using large batches of source and target points, and applying entropic regularization with a low ε \varepsilon ε . result Flow models perform better with large Sinkhorn couplings and low regularization.
OT-Flow uses optimal transport to improve CNFs for faster and more accurate density estimation.
problem Computational challenges in continuous normalizing flows.
method OT-Flow leverages optimal transport to regularize CNFs and uses exact trace computation.
result OT-Flow achieves competitive performance with one-fourth the number of weights and significant speedups.
Estimates optimal transport maps with known cost functions.
problem Ensuring optimal transport maps correspond to real-world usefulness.
method Differentiable neural ground costs with known Monge map forms.
result General approach for incorporating prior information.
Optimal Transport Graph Neural Networks (OT-GNN) improves graph embeddings by using optimal transport.
problem Graph Neural Networks (GNN) often lose structural or semantic information when aggregating node embeddings.
method Combines optimal transport (OT) with parametric graph models to compute graph embeddings from Wasserstein distances between node embeddings and prototype point clouds.
result OT-GNN outperforms popular methods on molecular property prediction tasks and produces smoother graph representations.
FVI method calculates bicausal OT with neural networks, outperforming other methods.
problem Computing bicausal optimal transport with adapted coupling structures.
method FVI method using multilayer neural networks to approximate value functions.
result FVI method outperforms linear programming and Sinkhorn methods in scalability.
Researchers develop neural optimal transport with Lagrangian costs for efficient computation.
problem Optimal transport between measures with Lagrangian costs for systems with geometric constraints.
method Neural network approach to compute geodesics and optimal transport maps efficiently.
result Efficient computation of geodesics and optimal transport maps without ODE solvers.
Neural framework for conditional OT maps learns from categorical and continuous variables.
problem Learning conditional optimal transport maps between complex distributions.
method Hypernetwork generates adaptive transport layer parameters based on conditioning variables.
result Our method outperforms simpler conditioning methods in comprehensive ablation studies.
A new method for conditional sampling using paired Wasserstein Autoencoders.
problem Conditional sampling from complex data distributions.
method Derive a novel loss function for Wasserstein Autoencoders to enable sampling from OT-type couplings.
result Learned cost-optimal transport maps and conditional sampling from an OT-type coupling.
Optimizes neural networks with blackbox solvers using Time-cost Regularization.
problem Improving neural network performance by integrating efficient solvers for complex problems.
method Optimizes both the primary loss function and the performance of the blackbox solver using Time-cost Regularization. Introduces a hyper-blackbox concept to learn blackbox parameters.
result Significant improvement in neural network performance through optimization of blackbox solvers.
Optimizes optimal transport distances using low-dimensional embeddings.
problem High computational cost of optimal transport distances in high dimensions.
method Approximate OT distances using 1-Lipschitz maps in a lower-dimensional space.
result Efficiently approximates optimal transport distances with lower computational cost.
New approach to sparse optimal transport for matching tokens with experts.
problem Sparse matching of tokens with experts in neural networks.
method Sparsity-constrained optimal transport with cardinality constraints.
result Solves nonconvex cardinality constraints with gradient methods.
This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two distributions. To that end, we propose a stochastic dual approach of regularize…
UNOT solves optimal transport problems efficiently using neural networks.
problem Computational expense in solving optimal transport problems.
method UNOT (Universal Neural Optimal Transport) uses Fourier Neural Operators to predict OT distances and plans accurately and efficiently.
result UNOT achieves up to 7.4x speedup over the Sinkhorn algorithm while maintaining accuracy.
Optimal transport kernels improve neural architecture search efficiency.
problem Comparing complex neural architectures similarity using Euclidean metric fails.
method Developed a novel discrepancy using tree-Wasserstein (TW) for neural architectures.
result TW-based approaches outperform other methods in sequential and parallel NAS.
New method for robustly estimating barycenters in data aggregation.
problem Outliers and noise in data measures hinder traditional OT barycenter estimation.
method Proposes a novel scalable approach using semi-unbalanced neural optimal transport.
result Demonstrates robustness to outliers and class imbalance.
The paper improves OT map estimation rates without strict assumptions.
problem Estimating optimal transport maps under practical conditions.
method Developed new convergence rates and scalable algorithms.
result Improved convergence rates for OT map estimation without restrictive assumptions.
Efficiently predicts optimal transport plans using sliced potentials.
problem Predicting optimal transport plans across multiple measure pairs efficiently.
method Regression-based and objective-based amortization strategies using sliced optimal transport potentials.
result Efficient and accurate prediction of optimal transport plans for various tasks.
A new neural topic model using optimal transport improves document representation and topic coherence.
problem Challenges in achieving good document representation and coherent/diverse topics in existing NTMs.
method Proposes a neural topic model via optimal transport, learning topic distribution by minimising OT distance to document word distributions.
result Significantly outperforms state-of-the-art NTMs on discovering coherent and diverse topics.
New ODE solvers improve training efficiency and accuracy.
problem Training Neural ODEs requires efficient and accurate gradient calculation.
method Presented algebraically reversible ODE solvers that are time and memory efficient, calculate exact gradients, and are numerically stable.
result Reversible solvers strictly improve upon previous architectures in efficiency and accuracy.
New method uses continuous OT for fairness, outperforming discrete OT.
problem Fairness issues in machine learning models.
method Stochastic-gradient fairness method based on continuous optimal transport.
result Continuous OT method outperforms discrete OT when data is limited.
Unified framework for optimal transport on curved spaces using neural potentials.
problem Optimal transport on curved Riemannian manifolds.
method Entropic RNOT combines entropic regularization with neural pullback parameterization.
result Unified framework recovers entropic optimal coupling in strong probabilistic metrics.
New method solves tree-structured Schrödinger Bridge problems.
problem Computing Schrödinger Bridge between tree-structured distributions.
method Iterative Markovian Fitting (IMF) procedure for tree-structured costs.
result Extends IMF to tree-structured Schrödinger Bridge problems.
Super-OT combines GANs and optimal transport for lineage tracing.
problem Lineage tracing in single-cell RNA-seq data.
method Supervised learning framework with GANs for optimal transport.
result Super-OT outperforms Waddington-OT in predicting cell differentiation outcomes.
A new robust Wasserstein distance is proposed to handle outliers in probability distributions.
problem Outliers in probability distributions make Wasserstein distances sensitive and impractical.
method Introduces a new outlier-robust Wasserstein distance W p ε \mathsf{W}_p^\varepsilon W p ε . result Achieves strong robust estimation guarantees under the Huber ε \varepsilon ε -contamination model. Protocol diagnoses neural HJB-PIDE solvers for Lévy jumps, revealing a missing factor in their importance-proposal density.
problem Neural PDE solvers can match scalar diagnostics but miscompute operators, leading to systematic errors.
method Five-step diagnostic protocol decomposes neural solve into components, compares them with independent reference solutions.
result Corrected a missing 1/2-mixture factor in the neural method's importance-proposal density, improving control accuracy.
MIP-GNN uses graph neural networks to predict variable biases for MIP solvers.
problem Improving combinatorial optimization through data-driven insights.
method Encoding MILP interactions as graphs, training a graph neural network to predict variable biases, and guiding the MIP solver with these predictions.
result Significant improvements in solving binary MILPs compared to default settings of state-of-the-art solvers.
Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be sub-optimal for specific classes of problems. In contrast to existing hand-craft…
Review of unbalanced OT, entropic regularization, and GW for robust data comparison.
problem Lack of robustness, high computational costs, and difficulty in handling distinct spaces in OT.
method Unbalanced OT, entropic regularization, Gromov-Wasserstein distance.
result Efficient geometric loss functions for data sciences.
Sliced-regularized OT improves transport plan accuracy.
problem Optimal transport (OT) approximation accuracy.
method Sliced-regularized optimal transport (SROT) formulation.
result SROT yields more accurate approximations of exact OT than entropic OT.