Note on the computational complexity of Gromov-Wasserstein distance.
problem Computational difficulty of Gromov-Wasserstein distance.
method Analysis of the optimization problem structure and providing explicit examples.
result Gromov-Wasserstein distance optimization problem is non-convex quadratic.
This study analyzes the quadratic Wasserstein metric's effects on inverse data matching.
problem Analyzing the quadratic Wasserstein metric's impact on inverse data matching.
method Characterizes and numerically analyzes the smoothing effect and convexity improvement of W2 distance. result The W2 distance improves convexity and reduces resolution for reconstructed objects at a given noise level. We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to approximate Wasserstein-2 distance. In contrast to popular entropic and quadratic regular…
Paper solves Gromov-Wasserstein for point clouds efficiently.
problem Quantifying similarity between two formations or shapes.
method Reformulates QAP as low-rank concave quadratic optimization problem.
result Global solution for large-scale problems with thousands of points.
Sharp 2-Wasserstein bounds for DDPMs derived from Föllmer process.
problem Sampling error bounds for DDPMs in 2-Wasserstein distance.
method Lipschitz-type conditions on score function, Föllmer process, and log-concave target distributions.
result Sharp upper bounds for DDPMs in 2-Wasserstein distance, optimal in dimension and steps.
Recently used in various machine learning contexts, the Gromov-Wasserstein distance (GW) allows for comparing distributions whose supports do not necessarily lie in the same metric space. However, this Optimal Transport (OT) distance requires solving a complex non convex quadratic program which is most of the time very…
We propose an SDP relaxation for the Gromov-Wasserstein distance, providing globally optimal solutions.
problem Matching objects between incomparable spaces using the Gromov-Wasserstein distance.
method Semi-definite programming (SDP) relaxation of the GW distance.
result The SDP relaxation provides globally optimal solutions for the GW distance in some instances.
Scalable algorithm for computing Wasserstein-2 barycenters without bias.
problem Computing Wasserstein-2 barycenters efficiently and accurately.
method Input convex neural networks and cycle-consistency regularization.
result Our approach avoids introducing bias and does not require minimax optimization.
Paper presents a new algorithm to approximate Wasserstein-2 barycenters without bias.
problem Approximating Wasserstein-2 barycenters of continuous measures.
method Generative model approach using arbitrary neural networks.
result The method does not introduce bias and is applicable to large-scale tasks.
The curvature-dimension condition is a generalization of the Bochner inequality to weighted Riemannian manifolds and general metric measure spaces. It is now known to be equivalent to evolution variational inequalities for the heat semigroup, and quadratic Wasserstein distance contraction properties at different times.…
Study shows neural networks trained with GD converge to Gaussian processes with polynomial decay.
problem Understanding convergence of neural networks to Gaussian processes during training.
method Explicit upper bounds on quadratic Wasserstein distance between trained networks and Gaussian approximations.
result Polynomial decay of approximation error with network width and training time.
The paper optimizes estimating transport maps between distributions.
problem Estimating optimal transport maps between distributions.
method Plugin approach using optimal couplings and extensions.
result Minimax optimality of the proposed estimators.
A new ParVI framework improves particle-based variational inference methods.
problem Non-trivial kernel design in particle-based variational inference methods.
method Proposes a generalized Wasserstein gradient descent (GWG) framework with broader regularizers.
result Demonstrates strong convergence guarantees and effectiveness on simulated and real data.
Paper tackles measure estimation in barycentric coding model.
problem Estimating an unknown measure in the barycentric coding model.
method Geometric, statistical, and computational insights; quadratic optimization problem; empirical i.i.d. samples algorithm.
result Proves precise rates of convergence for algorithm, ensuring statistical consistency.
The study examines lower and upper bounds of Wasserstein distances for affine transformations of random vectors.
problem Understanding Wasserstein distances for affine transformations of random vectors.
method Lower and upper bounds for affine transformations of random vectors in Rn are derived using Bures metric and compositions of affine maps. result Concrete lower bounds and upper bounds for affine transformations are derived and applied to various distributions.
New sampling method using regularized Wasserstein proximal for Gibbs distributions.
problem Sampling from Gibbs distributions with numerical stability and efficiency.
method Preconditioned regularized Wasserstein proximal operator.
result Discrete-time convergence analysis and explicit bias characterization.
Bounds neural network output distribution to Gaussian for random initialization.
problem Quantifying the distribution of randomly initialized deep neural networks.
method Quantitative Gaussian approximation using quadratic Wasserstein distance.
result Explicit inequalities show how network sizes affect Gaussian behavior.
New formulations for comparing metric measure spaces with arbitrary positive measures.
problem Comparing metric measure spaces with arbitrary positive measures.
method Two novel formulations: a divergence and a conic lifting approach.
result Efficiently solvable formulations for comparing metric spaces with arbitrary positive measures.
Neural solver computes Wasserstein geodesics and velocity fields efficiently.
problem Computing Wasserstein geodesics and velocity fields efficiently.
method Sample-based neural network approach to solve the minimax problem.
result Directly samples from target distribution and estimates velocity field.
Proposes an efficient lower bound for Gromov-Wasserstein discrepancy.
problem Comparing structured data from different metric-measure spaces.
method Orthogonal Gromov-Wasserstein (OGW) discrepancy with efficient closed-form lower bound.
result Efficient and tight lower bounds for Gromov-Wasserstein discrepancy.
Study absolute continuity of Wasserstein barycenters on manifolds with singular cost functions.
problem Absolute continuity of Wasserstein barycenters on manifolds with singular cost functions.
method Approximation framework to handle singularity, geometrically transparent.
result Precise analytic condition on cost profile for necessary assumptions.
SRRM improves recursive transport surrogates in the small-discrepancy regime.
problem Insufficient understanding of recursive partitioning methods' statistical behavior and resolution in the small-discrepancy regime.
method Introduced Selective Recursive Rank Matching (SRRM) to improve the resolution of Recursive Rank Matching (RRM).
result SRRM yields a higher-fidelity practical surrogate for the Wasserstein distance at moderate additional computational cost.
TreeDSB solves mOT problems on tree-structured costs for Wasserstein barycenters.
problem Optimal transport with multiple marginals and tree-structured quadratic costs.
method Tree-based Diffusion Schrödinger Bridge (TreeDSB) for continuous and dynamic solutions.
result TreeDSB efficiently computes Wasserstein barycenters in high dimensions.
Improved efficiency in HMC samplers reduces dissipative behavior.
problem Reducing dissipative behavior in HMC samplers.
method Variable integration time and partial velocity refreshment.
result Efficiency improved by a √κ factor in Wasserstein-2 distance.
WEGL embeds graphs in a vector space for faster machine learning.
problem Efficiently embedding graphs for machine learning tasks.
method Wasserstein distance for node embedding similarity, Monge maps for graph representation.
result State-of-the-art classification performance with superior computational efficiency.
New algorithm for low-rank optimal transport with improved interpretability and efficiency.
problem Quadratic scaling of optimal transport coupling matrix for massive datasets.
method Factor Relaxation with Latent Coupling (FRLC) algorithm.
result Superior performance on diverse applications including graph clustering and spatial transcriptomics.
New method synthesizes and analyzes probability measures using entropy-regularized optimal transport.
problem Synthesize and analyze probability measures with entropy-regularized optimal transport.
method Entropy-regularized Wasserstein-2 cost and Sinkhorn divergence for synthesis and analysis.
result Computed barycentric coefficients and their stability for classification of corrupted point cloud data.
Wasserstein GANs are shown to have hidden convexity, enabling exact solutions with convex optimization.
problem Non-convex and non-concave optimization in GANs.
method Convex duality analysis of Wasserstein GANs with two-layer neural network discriminators.
result Wasserstein GANs can be solved exactly with convex optimization under certain conditions.
In this paper, for μ and ν two probability measures on Rd with finite moments of order ρ≥1, we define the respective projections for the Wρ-Wasserstein distance of μ and ν on the sets of probability measures dominated by ν and of probability measures larger than μ in the convex order. Th…
Paper proposes a robust method for inferring parameters in multiobjective optimization.
problem Uncertainty in hypothetical decision-making problem, data quality, and parameter space.
method Wasserstein distributionally robust approach for inverse multiobjective optimization.
result WRO-IMOP minimizes worst-case expected loss over a Wasserstein ball of distributions.
Noise-free sampling method using Wasserstein proximal for faster convergence.
problem Sampling from distributions governed by potential functions.
method Deterministic score-based MCMC with regularized Wasserstein proximal.
result Improved mixing time bounds for Gaussian distributions compared to ULA and MALA.
New method solves tree-structured Schrödinger Bridge problems.
problem Computing Schrödinger Bridge between tree-structured distributions.
method Iterative Markovian Fitting (IMF) procedure for tree-structured costs.
result Extends IMF to tree-structured Schrödinger Bridge problems.
Improved spectral clustering via Gromov-Wasserstein Learning.
problem Optimizing graph partitioning performance.
method Bridge spectral clustering and GWL, using heat kernel for stable node correspondences.
result Improved graph partitioning results without compromising theoretical guarantees.
Paper optimizes WGAN parameters for non-Gaussian data.
problem Optimizing parameters for non-Gaussian data in WGAN.
method Characterization of optimal solutions for population WGAN beyond LQG setting, using sliced Wasserstein framework.
result Closed-form optimal parameters for non-linear activation functions and non-Gaussian data derived.
We study contractivity properties of gradient flows for functions on normed spaces or, more generally, on Finsler manifolds. Contractivity of the flows turns out to be equivalent to a new notion of convexity for the functions. This is different from the usual convexity along geodesics in non-Riemannian Finsler manifold…
Study uses actor-critic method for continuous-time mean-field control with entropy regularisation.
problem Continuous-time mean-field control in reinforcement learning.
method Actor-critic approach with entropy regularisation, value function alternation, and Wasserstein space parametrisation.
result Derives exact parametrisation of actor and critic functions in linear-quadratic mean-field framework.
Work on SGDm under heavy-tailed noise, revealing its generalization properties.
problem Understanding generalization of SGDm under heavy-tailed noise.
method Analysis of continuous-time limit (SDE) and discrete-time SGDm, establishing generalization bounds.
result SGDm can have worse generalization in the presence of heavy-tailed noise for quadratic loss functions.
New distances for comparing heterogeneous probability measures efficiently.
problem Comparing probability measures across different spaces.
method Introducing Anchor Energy (AE) and Anchor Wasserstein (AW) distances, and a sweep line algorithm for exact computation.
result Exact computation of AE and AW distances in log-quadratic time, significantly faster than GW.
Batching stabilizes risk in high-dimensional linear regression models.
problem Stability and risk behavior in high-dimensional overparameterized linear regression.
method Minimum-norm overparameterized linear regression model with batch-partitioning.
result Optimal batch size is inversely proportional to noise level and overparametrization ratio, leading to stable risk behavior.
New distances measure mixtures of Gaussians, useful in machine learning.
problem Comparing distributions with disjoint supports.
method Schoenberg-Rao distances based on concave Rao's entropy.
result Closed-form distances for mixtures of Gaussians.
We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a p-dimensional Gaussian random vector from n independent samples. The proposed model minimizes the worst case (maximum) of Stein's loss across all normal reference d…
A new method steers Gaussian distributions with minimal effort.
problem Steering high-dimensional Gaussian distributions efficiently.
method Sliced feedback controller using one-dimensional projections and averaging.
result The method steers Gaussian distributions to targets efficiently.
New algorithm solves mean-field control problems using actor-critic learning with moment neural networks.
problem Solving mean-field control problems in continuous time reinforcement learning.
method Gradient-based policy and value function learning with moment neural networks on the Wasserstein space.
result Effective solution for diverse mean-field control problems, including multi-dimensional and nonlinear settings.
A new slicing method reduces computational cost for cross-domain alignment.
problem High computational cost in solving Gromov-Wasserstein distance.
method Relation-Aware Projecting Direction (RAPD) and Relation-Aware Slicing Distribution (RASD).
result RASGW distance reduces computational cost and improves alignment accuracy.
This paper analyzes neural networks for solving complex optimization problems.
problem Minimax optimization problems in infinite-dimensional function spaces.
method Mean-field analysis of stochastic gradient descent-ascent in neural networks.
result The algorithm converges to a stationary point at a sublinear rate.
New stability bounds for Sinkhorn's algorithm in entropic optimal transport.
problem Stability and convergence of Sinkhorn's algorithm for entropic optimal transport.
method Semiconcavity approach to analyze stability and convergence.
result Exponential convergence of Sinkhorn's algorithm under semiconcavity conditions.
New method improves robust point matching under probabilistic settings.
problem Insufficient theoretical understanding of existing point matching methods.
method Distance profiles and modified matching procedure.
result Improved robustness under probabilistic settings.
Faster GW alignment for incomparable point clouds via low-rank couplings.
problem Aligning points across incomparable point clouds.
method Low-rank couplings and costs to solve Gromov-Wasserstein framework in linear time.
result Linear-time computation of Gromov-Wasserstein distances.