NOT learns optimal transport plans, kernel costs improve performance.
problem NOT algorithm learns non-optimal plans with weak quadratic costs.
method Introduced kernel weak quadratic costs to improve NOT's performance.
result Kernel costs provide improved theoretical and practical guarantees.
Paper introduces a neural network for consistent estimation of optimal transport maps.
problem Statistically consistent estimation of optimal transport maps between probability distributions.
method Lipschitz-constrained GAN penalized by quadratic transportation cost.
result The generator converges uniformly to the optimal transport map as sample size increases.
In this paper, we present a novel and principled approach to learn the optimal transport between two distributions, from samples. Guided by the optimal transport theory, we learn the optimal Kantorovich potential which induces the optimal transport map. This involves learning two convex functions, by solving a novel mi…
Neural framework for conditional OT maps learns from categorical and continuous variables.
problem Learning conditional optimal transport maps between complex distributions.
method Hypernetwork generates adaptive transport layer parameters based on conditioning variables.
result Our method outperforms simpler conditioning methods in comprehensive ablation studies.
The feature map obtained from the denoising autoencoder (DAE) is investigated by determining transportation dynamics of the DAE, which is a cornerstone for deep learning. Despite the rapid development in its application, deep neural networks remain analytically unexplained, because the feature maps are nested and param…
PLOT uses optimal transport to find neural site handles for causal abstraction.
problem Finding the relevant neural site for causal analysis is computationally challenging.
method PLOT employs optimal transport to localize causal variables from neural network outputs.
result PLOT efficiently finds intervention handles for causal abstraction in neural networks.
BM2 learns Schrödinger bridges using neural networks.
problem Learning dynamic transport maps between two distributions.
method Coupled Bridge Matching (BM2) with neural networks. result Preliminary theoretical analysis and numerical experiments show BM2's effectiveness. This paper presents a widely applicable approach to solving (multi-marginal, martingale) optimal transport and related problems via neural networks. The core idea is to penalize the optimization problem in its dual formulation and reduce it to a finite dimensional one which corresponds to optimizing a neural network wi…
HyCNNs improve convex function learning and optimal transport.
problem Learning and optimizing convex functions efficiently.
method Combining Maxout networks and ICNNs to create a new neural architecture.
result HyCNNs require fewer parameters and outperform existing methods in convex tasks.
Neural networks trained with backpropagation, the standard algorithm of deep learning which uses weight transport, are easily fooled by existing gradient-based adversarial attacks. This class of attacks are based on certain small perturbations of the inputs to make networks misclassify them. We show that less biologica…
A new method computes high-dimensional optimal transport using flow neural networks.
problem Computing optimal transport for high-dimensional data.
method Optimizing a flow model to minimize transport cost between two arbitrary distributions.
result Trained optimal transport flow enables downstream tasks like DRE and domain adaptation.
Neural optimal transport improves multivariate conformal prediction.
problem Multivariate quantile regression challenges and existing methods ignore joint distribution geometry.
method Combines neural optimal transport with amortized optimization for efficient training and faster inference.
result Constructs tighter and more informative predictive regions for multivariate conformal prediction.
New methods optimize transport and sampling for neural networks.
problem Designing effective training losses for neural networks.
method Optimal transport and stochastic optimal control through Schrödinger bridge problem.
result Valid training losses can be designed with numerical advantages.
New metric compares noisy neural trajectories using optimal transport.
problem Existing metrics fail to capture differences in noisy, dynamic neural responses.
method Proposed an optimal transport distance metric for Gaussian processes.
result Metric effectively compares neural dynamics in different systems.
UNOT solves optimal transport problems efficiently using neural networks.
problem Computational expense in solving optimal transport problems.
method UNOT (Universal Neural Optimal Transport) uses Fourier Neural Operators to predict OT distances and plans accurately and efficiently.
result UNOT achieves up to 7.4x speedup over the Sinkhorn algorithm while maintaining accuracy.
Optimal transport kernels improve neural architecture search efficiency.
problem Comparing complex neural architectures similarity using Euclidean metric fails.
method Developed a novel discrepancy using tree-Wasserstein (TW) for neural architectures.
result TW-based approaches outperform other methods in sequential and parallel NAS.
Optimal Transport Graph Neural Networks (OT-GNN) improves graph embeddings by using optimal transport.
problem Graph Neural Networks (GNN) often lose structural or semantic information when aggregating node embeddings.
method Combines optimal transport (OT) with parametric graph models to compute graph embeddings from Wasserstein distances between node embeddings and prototype point clouds.
result OT-GNN outperforms popular methods on molecular property prediction tasks and produces smoother graph representations.
A new method for optimal transport using neural ODEs that preserves marginal constraints.
problem Optimal transport between two continuous distributions with specific cost functions.
method Iterative construction of neural ODEs to minimize transport cost while preserving marginal constraints.
result Monotonic interior approach that decreases transport cost efficiently.
Generative modeling on metric graphs using neural optimal transport
problem Deep generative modeling for continuous probability distributions on metric graphs
method Embedding graph into smooth ambient space, solving entropic Kantorovich problem, projecting back onto graph
result Generator is graph-supported
Method learns conditional distributions using neural entropic optimal transport.
problem Challenges in learning multiple conditional distributions.
method Neural entropic optimal transport method with two networks and regularization.
result Effective learning of conditional distributions with limited samples.
Riemannian Neural OT maps improve scalability on manifolds.
problem Challenges in extending neural OT to high-dimensional Riemannian manifolds.
method Introduces Riemannian Neural OT (RNOT) maps that avoid discretization and incorporate geometric structure.
result RNOT maps approximate Riemannian OT maps with sub-exponential complexity in the dimension.
FEAT estimates free energy using adaptive transports.
problem Estimating free energy across scientific domains.
method Uses learned transports and stochastic interpolants.
result Provides consistent, minimum-variance estimators.
Researchers develop neural optimal transport with Lagrangian costs for efficient computation.
problem Optimal transport between measures with Lagrangian costs for systems with geometric constraints.
method Neural network approach to compute geodesics and optimal transport maps efficiently.
result Efficient computation of geodesics and optimal transport maps without ODE solvers.
Steerable neural ODEs on homogeneous spaces for equivariant feature dynamics.
problem Learning continuous-time equivariant dynamics of vector-valued features on homogeneous spaces.
method Introduces steerable neural ordinary differential equations on homogeneous spaces, interpreting features as sections of associated vector bundles over M. result Steerable NODEs are G-equivariant when the flow and connection are G-invariant, and they incorporate existing models. Neural Local Wasserstein Regression models distribution-on-distribution regression with flexible, localized transport maps.
problem Estimating distribution-on-distribution regression with global optimal transport maps or linearization limitations.
method Proposes Neural Local Wasserstein Regression, a flexible nonparametric framework using locally defined transport maps in Wasserstein space.
result Demonstrates effective capture of nonlinear and high-dimensional distributional relationships.
New learning algorithm improves neural network generalization.
problem High generalization performance despite over-parameterization.
method Viewed neural networks as dynamical systems, analyzing transport map efficiency.
result Found a low kinetic energy bias in network displacements, linked to generalization.
Neural solver computes Wasserstein geodesics and velocity fields efficiently.
problem Computing Wasserstein geodesics and velocity fields efficiently.
method Sample-based neural network approach to solve the minimax problem.
result Directly samples from target distribution and estimates velocity field.
This paper generalizes neural transport learning for free energy estimation in arbitrary state spaces.
problem Efficient estimation of free energy in various state spaces.
method Generalized neural transport learning approach for arbitrary state spaces.
result Validation of the proposed method's effectiveness and efficiency in diverse settings.
Paper solves inverse optimal transport problem with convex optimization and neural network.
problem Learning the cost function for optimal transport from observed data.
method Unconstrained convex optimization, Sinkhorn-Knopp algorithm, and deep neural network parameterization.
result Novel framework avoids repeated OT solving, demonstrating efficiency and accuracy.
Study MinMax methods for optimization problems, including optimal transport.
problem Optimization problems, especially optimal transport.
method MinMax framework, regularization, neural networks, approximation theorems.
result Justification of neural networks for solving optimization problems.
We compare several approaches to learn an Optimal Map, represented as a neural network, between probability distributions. The approaches fall into two categories: ``Heuristics'' and approaches with a more sound mathematical justification, motivated by the dual of the Kantorovitch problem. Among the algorithms we consi…
Optimal Transport enhances machine learning with new methods.
problem Comparing and manipulating probability distributions in machine learning.
method Probabilistic framework rooted in rich history and theory.
result New solutions in generative modeling and transfer learning.
The paper introduces a new method for risk measurement using weak optimal transport.
problem Risk measurement in insurance and financial contexts.
method Convex risk measures with weak optimal transport penalties, explicit representation via nonlinear transform, computational aspects, and approximations using neural networks.
result Explicit representation and computational methods for risk measures.
Unified framework for optimal transport on curved spaces using neural potentials.
problem Optimal transport on curved Riemannian manifolds.
method Entropic RNOT combines entropic regularization with neural pullback parameterization.
result Unified framework recovers entropic optimal coupling in strong probabilistic metrics.
The paper uses optimal transport to calibrate stochastic simulations.
problem Improper fidelity of stochastic simulators in scientific applications.
method Optimal transport theory applied to neural network corrections.
result Calibrated stochastic simulations improve fidelity to reality.
FVI method calculates bicausal OT with neural networks, outperforming other methods.
problem Computing bicausal optimal transport with adapted coupling structures.
method FVI method using multilayer neural networks to approximate value functions.
result FVI method outperforms linear programming and Sinkhorn methods in scalability.
A new neural topic model using optimal transport improves document representation and topic coherence.
problem Challenges in achieving good document representation and coherent/diverse topics in existing NTMs.
method Proposes a neural topic model via optimal transport, learning topic distribution by minimising OT distance to document word distributions.
result Significantly outperforms state-of-the-art NTMs on discovering coherent and diverse topics.
This paper proposes a convolutional neural network (CNN)-based method that learns traffic as images and predicts large-scale, network-wide traffic speed with a high accuracy. Spatiotemporal traffic dynamics are converted to images describing the time and space relations of traffic flow via a two-dimensional time-space …
Optimal transport strategy reduces gender bias in job recommendation systems.
problem Mitigating gender biases in AI-driven job recommendation systems.
method Model agnostic optimal transport strategy applied to multi-class neural networks.
result Reduced undesirable algorithmic biases in job recommendation tasks.
A neural network speeds up computation of Wasserstein barycenters by 60x.
problem Computing Wasserstein barycenters is computationally demanding.
method Trained a deep convolutional neural network to compute Wasserstein barycenters.
result Computational times reduced from milliseconds to seconds.
Unified framework for sampling from complex densities using PDEs and neural networks.
problem Sampling from complicated probability densities.
method Dynamical measure transport via PDEs and physics-informed neural networks (PINNs).
result Significantly better mode coverage and high accuracy in sampling.
Study uses neural networks to predict travel times for public transportation.
problem Inaccurate travel time predictions due to road traffic irregularities.
method Developed two neural network models (MLP and LSTM) using OD travel time matrix.
result Both models can make near-accurate predictions, but LSTM is more susceptible to noise.
Two neural network methods approximate conditional optimal transport for Bayesian inference.
problem Approximating conditional optimal transport for Bayesian inference in high dimensions.
method Neural network approximations of conditional optimal transport maps.
result Improved scalability and modeling choices for conditional sampling and density estimation.
Optimal Transport (OT) naturally arises in many machine learning applications, yet the heavy computational burden limits its wide-spread uses. To address the scalability issue, we propose an implicit generative learning-based framework called SPOT (Scalable Push-forward of Optimal Transport). Specifically, we approxima…
Unified methodology for estimating optimal transport maps in various function spaces.
problem Estimating the function T given samples from P and T♯P. method Unified methodology based on Poincaré inequality and smooth convex function gradient.
result Nearly sharp results in various settings, including normal distribution and neural networks.
TSC uses HMC and adaptive transport maps to optimize forward KL for variational inference.
problem Variational inference underestimates uncertainty when minimizing reverse KL.
method TSC uses Hamiltonian Monte Carlo and adaptive transport maps to optimize KL(p||q).
result TSC achieves competitive performance in training variational autoencoders on large-scale data.
1-Lipschitz neural networks produce clearer, more focused Saliency Maps for explainable AI.
problem Noisy and limited Saliency Maps from traditional neural networks.
method Dual loss of optimal transport problem for 1-Lipschitz neural networks.
result Saliency Maps from 1-Lipschitz networks are highly concentrated and less noisy, aligning with human explanations.
New approach to sparse optimal transport for matching tokens with experts.
problem Sparse matching of tokens with experts in neural networks.
method Sparsity-constrained optimal transport with cardinality constraints.
result Solves nonconvex cardinality constraints with gradient methods.