Novel approach learns optimal transport using convex neural networks.
problem Learning optimal transport between distributions from samples.
method Solving a minimax optimization to learn two convex functions, representing the optimal transport map.
result The approach finds optimal transport mappings that are independent of initialization and can handle discontinuous distributions.
NOT learns optimal transport plans, kernel costs improve performance.
problem NOT algorithm learns non-optimal plans with weak quadratic costs.
method Introduced kernel weak quadratic costs to improve NOT's performance.
result Kernel costs provide improved theoretical and practical guarantees.
Paper introduces a neural network for consistent estimation of optimal transport maps.
problem Statistically consistent estimation of optimal transport maps between probability distributions.
method Lipschitz-constrained GAN penalized by quadratic transportation cost.
result The generator converges uniformly to the optimal transport map as sample size increases.
Paper compares neural network approaches to Optimal Transport.
problem Learning Optimal Maps between probability distributions.
method Two categories of approaches: heuristic and math-justified. Novel approach involves dynamic flows and supervised learning.
result Novel approach involving dynamic flows and reductions of Optimal Transport to supervised learning.
Paper solves optimal transport with neural nets, also detects anomalies.
problem Optimal transport problems with twist conditions.
method Primal-dual algorithm for neural networks.
result Solves financial data generation and anomaly detection.
New neural networks without weight transport are more robust to adversarial attacks.
problem Existing neural networks are easily fooled by adversarial attacks.
method Trained neural networks using feedback alignment instead of weight transport.
result Neural networks without weight transport are significantly harder to fool (98% adversarial accuracy vs 0.03%).
Neural framework for conditional OT maps learns from categorical and continuous variables.
problem Learning conditional optimal transport maps between complex distributions.
method Hypernetwork generates adaptive transport layer parameters based on conditioning variables.
result Our method outperforms simpler conditioning methods in comprehensive ablation studies.
The feature map obtained from the denoising autoencoder (DAE) is investigated by determining transportation dynamics of the DAE, which is a cornerstone for deep learning. Despite the rapid development in its application, deep neural networks remain analytically unexplained, because the feature maps are nested and param…
PLOT uses optimal transport to find neural site handles for causal abstraction.
problem Finding the relevant neural site for causal analysis is computationally challenging.
method PLOT employs optimal transport to localize causal variables from neural network outputs.
result PLOT efficiently finds intervention handles for causal abstraction in neural networks.
BM2 learns Schrödinger bridges using neural networks.
problem Learning dynamic transport maps between two distributions.
method Coupled Bridge Matching (BM2) with neural networks. result Preliminary theoretical analysis and numerical experiments show BM2's effectiveness. This paper presents a widely applicable approach to solving (multi-marginal, martingale) optimal transport and related problems via neural networks. The core idea is to penalize the optimization problem in its dual formulation and reduce it to a finite dimensional one which corresponds to optimizing a neural network wi…
HyCNNs improve convex function learning and optimal transport.
problem Learning and optimizing convex functions efficiently.
method Combining Maxout networks and ICNNs to create a new neural architecture.
result HyCNNs require fewer parameters and outperform existing methods in convex tasks.
A new method computes high-dimensional optimal transport using flow neural networks.
problem Computing optimal transport for high-dimensional data.
method Optimizing a flow model to minimize transport cost between two arbitrary distributions.
result Trained optimal transport flow enables downstream tasks like DRE and domain adaptation.
Neural optimal transport improves multivariate conformal prediction.
problem Multivariate quantile regression challenges and existing methods ignore joint distribution geometry.
method Combines neural optimal transport with amortized optimization for efficient training and faster inference.
result Constructs tighter and more informative predictive regions for multivariate conformal prediction.
New methods optimize transport and sampling for neural networks.
problem Designing effective training losses for neural networks.
method Optimal transport and stochastic optimal control through Schrödinger bridge problem.
result Valid training losses can be designed with numerical advantages.
New metric compares noisy neural trajectories using optimal transport.
problem Existing metrics fail to capture differences in noisy, dynamic neural responses.
method Proposed an optimal transport distance metric for Gaussian processes.
result Metric effectively compares neural dynamics in different systems.
UNOT solves optimal transport problems efficiently using neural networks.
problem Computational expense in solving optimal transport problems.
method UNOT (Universal Neural Optimal Transport) uses Fourier Neural Operators to predict OT distances and plans accurately and efficiently.
result UNOT achieves up to 7.4x speedup over the Sinkhorn algorithm while maintaining accuracy.
A new framework SPOT efficiently solves large scale optimal transport problems.
problem Heavy computational burden in optimal transport limits its use.
method Implicit generative learning framework (SPOT) approximates optimal transport plan and solves it using stochastic gradient algorithms.
result SPOT efficiently solves optimal transport problems and can recover the density of the plan.
Optimal transport kernels improve neural architecture search efficiency.
problem Comparing complex neural architectures similarity using Euclidean metric fails.
method Developed a novel discrepancy using tree-Wasserstein (TW) for neural architectures.
result TW-based approaches outperform other methods in sequential and parallel NAS.
Optimal Transport Graph Neural Networks (OT-GNN) improves graph embeddings by using optimal transport.
problem Graph Neural Networks (GNN) often lose structural or semantic information when aggregating node embeddings.
method Combines optimal transport (OT) with parametric graph models to compute graph embeddings from Wasserstein distances between node embeddings and prototype point clouds.
result OT-GNN outperforms popular methods on molecular property prediction tasks and produces smoother graph representations.
A new method for optimal transport using neural ODEs that preserves marginal constraints.
problem Optimal transport between two continuous distributions with specific cost functions.
method Iterative construction of neural ODEs to minimize transport cost while preserving marginal constraints.
result Monotonic interior approach that decreases transport cost efficiently.
Generative modeling on metric graphs using neural optimal transport
problem Deep generative modeling for continuous probability distributions on metric graphs
method Embedding graph into smooth ambient space, solving entropic Kantorovich problem, projecting back onto graph
result Generator is graph-supported
Method learns conditional distributions using neural entropic optimal transport.
problem Challenges in learning multiple conditional distributions.
method Neural entropic optimal transport method with two networks and regularization.
result Effective learning of conditional distributions with limited samples.
Paper establishes rates of universal approximation for neural tangent kernels using transport mappings.
problem Universal approximation for neural tangent kernels with microscopic weight changes.
method Generic scheme to approximate functions with NTK using transport mappings, constructed via Fourier transforms.
result Approximation of continuous functions with roughly 1 / δ^(10d) nodes, where δ depends on function continuity.
Riemannian Neural OT maps improve scalability on manifolds.
problem Challenges in extending neural OT to high-dimensional Riemannian manifolds.
method Introduces Riemannian Neural OT (RNOT) maps that avoid discretization and incorporate geometric structure.
result RNOT maps approximate Riemannian OT maps with sub-exponential complexity in the dimension.
NeuTra-lizes bad geometry in HMC using neural transport.
problem Difficult-to-normalize posterior distributions with unfavorable geometry.
method Neural transport (NeuTra) HMC, using inverse autoregressive flows (IAF) to correct geometry.
result Significantly outperforms vanilla HMC in time and effective-sample-size rates.
FEAT estimates free energy using adaptive transports.
problem Estimating free energy across scientific domains.
method Uses learned transports and stochastic interpolants.
result Provides consistent, minimum-variance estimators.
New algorithms avoid weight transport, outperforming current deep learning methods.
problem Current deep learning algorithms rely on weight transport, which is biologically implausible.
method Two mechanisms: weight mirror and modified Kolen-Pollack algorithm, using random feedback weights.
result These mechanisms outperform feedback alignment and other methods on visual recognition tasks.
Researchers develop neural optimal transport with Lagrangian costs for efficient computation.
problem Optimal transport between measures with Lagrangian costs for systems with geometric constraints.
method Neural network approach to compute geodesics and optimal transport maps efficiently.
result Efficient computation of geodesics and optimal transport maps without ODE solvers.
Steerable neural ODEs on homogeneous spaces for equivariant feature dynamics.
problem Learning continuous-time equivariant dynamics of vector-valued features on homogeneous spaces.
method Introduces steerable neural ordinary differential equations on homogeneous spaces, interpreting features as sections of associated vector bundles over M. result Steerable NODEs are G-equivariant when the flow and connection are G-invariant, and they incorporate existing models. New algorithm trains generative networks using explicit optimal transport distances.
problem Training generative networks with flexible distance metrics.
method Uses an auxiliary neural network to express optimal transport map and trains generative networks with explicit transportation cost functions.
result Allows training with any transportation cost function, including image-centered distances.
Neural Local Wasserstein Regression models distribution-on-distribution regression with flexible, localized transport maps.
problem Estimating distribution-on-distribution regression with global optimal transport maps or linearization limitations.
method Proposes Neural Local Wasserstein Regression, a flexible nonparametric framework using locally defined transport maps in Wasserstein space.
result Demonstrates effective capture of nonlinear and high-dimensional distributional relationships.
New learning algorithm improves neural network generalization.
problem High generalization performance despite over-parameterization.
method Viewed neural networks as dynamical systems, analyzing transport map efficiency.
result Found a low kinetic energy bias in network displacements, linked to generalization.
Neural solver computes Wasserstein geodesics and velocity fields efficiently.
problem Computing Wasserstein geodesics and velocity fields efficiently.
method Sample-based neural network approach to solve the minimax problem.
result Directly samples from target distribution and estimates velocity field.
This paper generalizes neural transport learning for free energy estimation in arbitrary state spaces.
problem Efficient estimation of free energy in various state spaces.
method Generalized neural transport learning approach for arbitrary state spaces.
result Validation of the proposed method's effectiveness and efficiency in diverse settings.
Paper solves inverse optimal transport problem with convex optimization and neural network.
problem Learning the cost function for optimal transport from observed data.
method Unconstrained convex optimization, Sinkhorn-Knopp algorithm, and deep neural network parameterization.
result Novel framework avoids repeated OT solving, demonstrating efficiency and accuracy.
Study MinMax methods for optimization problems, including optimal transport.
problem Optimization problems, especially optimal transport.
method MinMax framework, regularization, neural networks, approximation theorems.
result Justification of neural networks for solving optimization problems.
Optimal Transport enhances machine learning with new methods.
problem Comparing and manipulating probability distributions in machine learning.
method Probabilistic framework rooted in rich history and theory.
result New solutions in generative modeling and transfer learning.
The paper introduces a new method for risk measurement using weak optimal transport.
problem Risk measurement in insurance and financial contexts.
method Convex risk measures with weak optimal transport penalties, explicit representation via nonlinear transform, computational aspects, and approximations using neural networks.
result Explicit representation and computational methods for risk measures.
Unified framework for optimal transport on curved spaces using neural potentials.
problem Optimal transport on curved Riemannian manifolds.
method Entropic RNOT combines entropic regularization with neural pullback parameterization.
result Unified framework recovers entropic optimal coupling in strong probabilistic metrics.
The paper uses optimal transport to calibrate stochastic simulations.
problem Improper fidelity of stochastic simulators in scientific applications.
method Optimal transport theory applied to neural network corrections.
result Calibrated stochastic simulations improve fidelity to reality.
FVI method calculates bicausal OT with neural networks, outperforming other methods.
problem Computing bicausal optimal transport with adapted coupling structures.
method FVI method using multilayer neural networks to approximate value functions.
result FVI method outperforms linear programming and Sinkhorn methods in scalability.
A new neural topic model using optimal transport improves document representation and topic coherence.
problem Challenges in achieving good document representation and coherent/diverse topics in existing NTMs.
method Proposes a neural topic model via optimal transport, learning topic distribution by minimising OT distance to document word distributions.
result Significantly outperforms state-of-the-art NTMs on discovering coherent and diverse topics.
This paper proposes a convolutional neural network (CNN)-based method that learns traffic as images and predicts large-scale, network-wide traffic speed with a high accuracy. Spatiotemporal traffic dynamics are converted to images describing the time and space relations of traffic flow via a two-dimensional time-space …
Optimal transport strategy reduces gender bias in job recommendation systems.
problem Mitigating gender biases in AI-driven job recommendation systems.
method Model agnostic optimal transport strategy applied to multi-class neural networks.
result Reduced undesirable algorithmic biases in job recommendation tasks.
End-to-end algorithm for W-2 distance using neural networks.
problem Training optimal transport mappings for W-2 distance.
method Input convex neural networks and cycle-consistency regularization.
result Algorithm scales well to high dimensions without bias.
A neural network speeds up computation of Wasserstein barycenters by 60x.
problem Computing Wasserstein barycenters is computationally demanding.
method Trained a deep convolutional neural network to compute Wasserstein barycenters.
result Computational times reduced from milliseconds to seconds.
Unified framework for sampling from complex densities using PDEs and neural networks.
problem Sampling from complicated probability densities.
method Dynamical measure transport via PDEs and physics-informed neural networks (PINNs).
result Significantly better mode coverage and high accuracy in sampling.