Convex PCA improves Euclidean PCA for convex data subsets.
problem Improving PCA for convex data subsets.
method Developed new theoretical results and a numerical implementation for finite dimensional convex PCA.
result Finite dimensional convex PCA approximates Wasserstein GPCA and ranked compositional data.
This paper develops GPCA for probability distributions using Otto-Wasserstein geometry.
problem Analyzing modes of variation in datasets of probability measures.
method Geodesic Principal Component Analysis (GPCA) on Wasserstein space with neural networks.
result Identification of geodesic curves that capture modes of variation in probability distributions.
GCN and GPCA are mathematically connected, leading to improved node classification performance.
problem Improving node classification performance in semi-supervised settings.
method Established a mathematical connection between GCN and GPCA, demonstrating their equivalence and using this to design an effective initialization strategy.
result GPCA paired with a simple MLP achieves similar or better performance than GCN on semi-supervised node classification tasks.
Proposes GPCA module for channel attention in CNNs using Gaussian processes.
problem Improving performance in visual tasks through effective channel selection.
method Integrates Gaussian processes into channel attention mechanisms for probabilistic modeling of channel correlations.
result Demonstrates improved performance of GPCA module in end-to-end CNN training.
Variables in many massive high-dimensional data sets are structured, arising for example from measurements on a regular grid as in imaging and time series or from spatial-temporal measurements as in climate studies. Classical multivariate techniques ignore these structural relationships often resulting in poor performa…
Many modern datasets can be represented as graphs and hence spectral decompositions such as graph principal component analysis (PCA) can be useful. Distinct from previous graph decomposition approaches based on subspace projection of a single topological feature, e.g., the Fiedler vector of centered graph adjacency mat…
Matrix factorization methods are extensively employed to understand complex data. In this paper, we introduce the cross-product penalized component analysis (XCAN), a sparse matrix factorization based on the optimization of a loss function that allows a trade-off between variance maximization and structural preservatio…
Wasserstein GANs fail to approximate Wasserstein distance, leading to their success.
problem Approximating Wasserstein distance in deep generative models.
method Analysis of differences between theoretical setup and training reality.
result Wasserstein GANs' success is due to their failure to approximate Wasserstein distance.
Study on conditions for achieving optimal robustness in statistical estimators.
problem Achieving the optimal robustness of estimators in statistical models.
method Developed a Wasserstein analogue of the Cramer-Rao inequality and investigated conditions for achieving the Wasserstein-Cramer-Rao lower bound.
result Conditions for the existence of asymptotically efficient estimators in one-parameter models and location-scale families.
A new method for generative modeling of discrete data using geometric latent subspaces.
problem Learning generative models for discrete data with statistical dependencies.
method Geometric latent-subspace framework in exponential parameter space of product manifolds of categorical distributions.
result Low-dimensional latent space encodes statistical dependencies and accurately models high-dimensional discrete data.
A method for fast estimation of Wasserstein distances using sliced Wasserstein distances.
problem Efficiently computing Wasserstein distances for multiple pairs of distributions.
method Regression on sliced Wasserstein distances to predict true Wasserstein distances.
result The proposed method provides a better approximation of Wasserstein distance than state-of-the-art models, especially in low-data regimes.
The paper introduces a new Wasserstein distance for approximating posteriors in inverse problems.
problem Approximating posterior measures in inverse problems using conditional Wasserstein distances.
method Introduces a conditional Wasserstein distance with restricted couplings and derives its dual.
result Shows that conditional Wasserstein GANs can yield favorable properties for posterior sampling.
Stability of Wasserstein spaces under various convergence types.
problem Stability and finiteness of Wasserstein spaces over singular and non-singular spaces.
method Gromov--Hausdorff convergence and equivariant Gromov--Hausdorff convergence.
result Analogue of Perelman's stability theorem on Wasserstein spaces.
A new spherical Sliced-Wasserstein distance for data on spheres.
problem Defining Wasserstein distance on manifolds, especially spheres.
method Closed-form solutions of the Wasserstein distance on the circle and a new spherical Radon transform.
result A novel spherical Sliced-Wasserstein (SW) discrepancy for data on spheres.
Algorithm samples from Wasserstein barycenter of measures.
problem Sampling from Wasserstein barycenter of measures.
method Gradient flow of multimarginal formulation with penalization.
result Algorithm samples close to Wasserstein barycenter.
A new robust metric compares distributions more accurately than existing methods.
problem Sensitivity to outliers and sampling discrepancy in Wasserstein distances.
method Introducing k-RPW, a partial p-Wasserstein distance.
result k-RPW converges faster to true distance and is more robust to outliers.
The paper studies scaling limits of Wasserstein metrics on Gaussian mixture models.
problem Understanding the scaling limits of Wasserstein metrics on Gaussian mixture models.
method Scaling limit approach on Gaussian mixture models, including inhomogeneous and extended models.
result Existence of the limit of the Wasserstein metric after renormalization for GMMs with zero variance.
This work robustifies Wasserstein distance estimation with MoM estimators for outlier-polluted data.
problem Estimating Wasserstein distance between two distributions with outliers.
method Introducing MoM-based robust estimators for Wasserstein distance.
result Consistent MoM-based estimators for Wasserstein distance with convergence rates.
Rigidity of Wasserstein spaces over Riemannian manifolds
problem Isometric rigidity of L2 Wasserstein spaces over Riemannian manifolds
method Showing L2 Wasserstein spaces are isometrically rigid if and only if their underlying manifolds do not admit a Euclidean de Rham factor
result Isometry of L2 Wasserstein spaces over non-Euclidean manifolds
Note on failure of Martingale Wasserstein Inequality in higher dimensions.
problem Analyzing failure of Martingale Wasserstein Inequality in higher dimensions.
method Checking failure in dimension d≥2 and proving a stronger inequality in all dimensions.
result A stronger Maximal Martingale Wasserstein Inequality holds in all dimensions.
WSFN overcomes saddle points for non-convex functionals in Wasserstein space.
problem Minimizing non-convex functionals over the Wasserstein space with saddle point avoidance.
method WSFN is a second-order method that preconditions the Wasserstein gradient to avoid saddle points.
result WSFN escapes saddle regions and reaches a global minimizer in polynomial time.
In this report, we review the calculation of entropy-regularised Wasserstein loss introduced by Cuturi and document a practical implementation in PyTorch. Code is available at https://github.com/t-vi/pytorch-tvmisc/blob/master/wasserstein-distance/Pytorch_Wasserstein.ipynb
This paper introduces Wasserstein variational inference, a new form of approximate Bayesian inference based on optimal transport theory. Wasserstein variational inference uses a new family of divergences that includes both f-divergences and the Wasserstein distance as special cases. The gradients of the Wasserstein var…
This paper approximates 1-Wasserstein distance using tree-based embedding.
problem Computational inefficiency of estimating 1-Wasserstein distance.
method L1-regularized approach to learn tree weights, using shortest path distance as a linear model.
result Tree-Wasserstein distance (TWD) approximates 1-Wasserstein distance efficiently.
Upper bound for max-sliced 2-Wasserstein distance between measures.
problem Estimating distance between probability measures and their empirical counterparts.
method Same technique as previous work, upper bound approach.
result Upper bound for expected max-sliced 2-Wasserstein distance.
We propose fast approximations for the generalized sliced-Wasserstein distance.
problem Efficient approximation of the generalized sliced-Wasserstein distance in high dimensions.
method Deterministic approximations using random projections and concentration of measure results.
result One-dimensional projections of high-dimensional random vectors are approximately Gaussian.
Paper introduces Wasserstein total correlation for disentangled representation learning.
problem Learning disentangled representations from data.
method Adversarial training of a critic to estimate Wasserstein total correlation in variational and Wasserstein autoencoders.
result Proposed method achieves comparable disentanglement performance with less reconstruction loss.
Note on the computational complexity of Gromov-Wasserstein distance.
problem Computational difficulty of Gromov-Wasserstein distance.
method Analysis of the optimization problem structure and providing explicit examples.
result Gromov-Wasserstein distance optimization problem is non-convex quadratic.
We improve image perturbation defenses using a better-defined Wasserstein threat model.
problem Real-world image perturbations are not pixel-independent, unlike ℓp threat models. method We rectify flaws in the Wasserstein threat model and explore stronger attacks and defenses.
result Current Wasserstein-robust models are ineffective against real-world perturbations.
Develops calculus on Wasserstein spaces for Riemannian manifolds.
problem Characterizing and understanding the geometry of Wasserstein spaces.
method Intrinsic formalism for topology, smooth structure, and Riemannian geometry of Wasserstein spaces.
result Wasserstein spaces of closed manifolds are geodesically convex.
Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In this paper, we propose a new variant of sliced Wasserstein distance, study the use …
New Sliced-Wasserstein distances for non-Euclidean data.
problem Computational burden of Wasserstein distance on non-Euclidean manifolds.
method Derive Sliced-Wasserstein distances and flows on Cartan-Hadamard manifolds.
result General constructions and non-parametric schemes for minimizing new distances.
Exact 1-Wasserstein distance between location-scale distributions derived, with privacy effects studied.
problem Calculating the 1-Wasserstein distance between location-scale distributions and its impact on differential privacy.
method Exact expressions and special functions for 1-Wasserstein distance, new upper bounds, and asymptotic analysis.
result New linear upper bound and detailed asymptotic bounds for Gaussian case, effect of differential privacy studied.
We propose a novel fused Gromov-Wasserstein alignment method to jointly learn the Hawkes processes in different event spaces, and align their event types. Given two Hawkes processes, we use fused Gromov-Wasserstein discrepancy to measure their dissimilarity, which considers both the Wasserstein discrepancy based on the…
Paper introduces robust market making using Wasserstein distance and entropy regularization.
problem Market making robustness under uncertainty.
method Wasserstein distance, entropy regularization, convex optimization, optimal radius selection.
result The robust market making problem can be reformulated as a convex optimization problem.
A new portfolio model improves on Kelly's by accounting for estimation error.
problem Estimation error in Kelly portfolio optimization.
method Wasserstein distributionally robust optimization (DRO) to define a robust log-optimal portfolio.
result The Wasserstein-Kelly portfolio outperforms the Kelly portfolio in out-of-sample testing.
Study compares geometric approaches for shape and deformation statistics.
problem Characterizing statistical models of shapes and deformations.
method Information geometry and Wasserstein geometry.
result Wasserstein estimator is robust against waveform perturbation.
Study of Gaussian distributions using entropic Gromov-Wasserstein and inner product Gromov-Wasserstein.
problem Optimal transportation between Gaussian distributions with different dimensions.
method Entropic Gromov-Wasserstein and inner product Gromov-Wasserstein, with closed-form expressions and von Neumann's trace inequality.
result Closed-form expressions for the entropic IGW and its unbalanced variant between Gaussian distributions.
Paper develops a new method for differential privacy sampling using Wasserstein distance.
problem Sampling from distributions under differential privacy constraints with geometric structure consideration.
method Develops a novel framework with Wasserstein Projection Mechanism (WPM) for minimax optimal mechanisms.
result Proposes efficient algorithms for approximate computation of the Wasserstein Projection Mechanism.
The paper explores a new type of kernel using Wasserstein distance for better classification of shapes.
problem Improving kernel methods for shape classification.
method Defined and studied exponential kernels based on regularized Wasserstein distance.
result Wasserstein squared exponential kernels perform better on small shape datasets.
Optimal neural network approximation for Wasserstein gradient direction via convex optimization.
problem Approximating Wasserstein gradient direction with limited data.
method Two-layer networks with squared-ReLU activations, SDP relaxation.
result Optimal approximation of Wasserstein gradient direction in two-layer networks.
A new ABC technique using Sliced-Wasserstein distance improves inference quality.
problem Intractable likelihood in generative models leads to loss of information in summary statistics.
method Proposes Sliced-Wasserstein ABC, a new ABC technique based on the Sliced-Wasserstein distance.
result Derives theoretical consistency results and demonstrates improved performance on synthetic and image denoising tasks.
We study in this paper a variant of Wasserstein barycenter problem, which we refer to as tree-Wasserstein barycenter, by leveraging a specific class of ground metrics, namely tree metrics, for Wasserstein distance. Drawing on the tree structure, we propose an efficient algorithmic approach to solve the tree-Wasserstein…
Develops a two-sample test using projected Wasserstein distance to handle high-dimensional data.
problem Testing whether two high-dimensional samples come from the same distribution.
method Optimal projection to find a low-dimensional linear mapping that maximizes the Wasserstein distance between projected probability distributions.
result Characterizes the convergence rate of the projected Wasserstein distance and presents practical algorithms.
A faster Wasserstein k-means algorithm for histogram data reduces computation and maintains clustering quality.
problem Efficiently clustering histogram data with reduced computation time.
method Sparse simplex projection to reduce data samples, centroids, and ground cost matrix, dynamically removing lower-valued samples.
result Significant reduction in computational complexity without compromising clustering quality.
Improved GAN performance using higher-order Wasserstein moments.
problem Stabilizing and enhancing GANs for better mode coverage and stability.
method Deriving and training a GAN with a modified Wasserstein distance using higher-order moments.
result Training a GAN with higher-order Wasserstein moments improves performance, even with increased computational cost.
We solve robust optimization problems using Wasserstein balls and apply it to mean-CVaR optimization.
problem Distributionally robust optimization with Wasserstein ambiguity sets.
method Transformed robust optimization into non-robust with penalty term, selecting ambiguity set size.
result Impressive results in robust mean-CVaR optimization compared to other strategies.
Orthogonal Wasserstein GANs improve image quality without gradient norm regularization.
problem Wasserstein-GANs' gradient norm regularization limits the distribution's fidelity.
method Substituted gradient norm regularization with orthogonality constraints on weight matrices.
result Orthogonal Wasserstein GANs achieve better image quality and generalization.