We propose fast approximations for the generalized sliced-Wasserstein distance.
problem Efficient approximation of the generalized sliced-Wasserstein distance in high dimensions.
method Deterministic approximations using random projections and concentration of measure results.
result One-dimensional projections of high-dimensional random vectors are approximately Gaussian.
A new slicing method speeds up sliced Wasserstein estimation.
problem Efficiently estimating sliced Wasserstein distance.
method Random-Path Projecting Direction (RPD) for fast sampling.
result RPSW and IWRPSW show favorable performance in training generative models.
A new method for comparing image probability measures using convolution operators.
problem Efficiently comparing images using conventional sliced Wasserstein methods.
method Proposed convolution sliced Wasserstein (CSW) methods with stride, dilation, and non-linear activation.
result CSW demonstrates favorable performance over conventional sliced Wasserstein in image comparison and deep generative modeling.
A new method optimizes projection directions for sliced Wasserstein distances.
problem Finding informative projecting directions for sliced Wasserstein distances is computationally expensive.
method Amortized projection optimization to predict directions efficiently.
result Proposed amortized models improve generative modeling performance.
This paper introduces repulsive Monte Carlo methods for computing the sliced Wasserstein distance.
problem Computing the integral of a function on the unit sphere using Monte Carlo methods.
method The approach involves using determinantal point processes and repelled point processes to create quadratures for the sliced Wasserstein distance.
result The UnifOrtho estimator is recommended for the computation of the sliced Wasserstein distance in large dimensions.
A new distance measure balances projection exploration and informativeness.
problem Inefficient and incomplete projection sampling in existing sliced-Wasserstein distances.
method Proposes Distributional Sliced-Wasserstein (DSW) that optimally balances projection exploration and informativeness.
result DSW generalizes Max-SW and can be computed efficiently.
Extends SW and GSW to compare heterogeneous joint distributions.
problem Limited applicability of SW and GSW to heterogeneous joint distributions.
method Introduces HHRT and PGRT to extend SW and GSW.
result H2SW distance for heterogeneous joint distributions.
New Sliced-Wasserstein distances for non-Euclidean data.
problem Computational burden of Wasserstein distance on non-Euclidean manifolds.
method Derive Sliced-Wasserstein distances and flows on Cartan-Hadamard manifolds.
result General constructions and non-parametric schemes for minimizing new distances.
New hyperbolic sliced-Wasserstein distances derived for efficient comparison.
problem Efficient comparison of distributions in hyperbolic spaces.
method Projections on geodesics or horospheres to derive novel sliced-Wasserstein distances.
result Novel hyperbolic sliced-Wasserstein distances are more computationally efficient.
New PAC-Bayesian bounds improve Sliced-Wasserstein distances.
problem Improving statistical properties of Sliced-Wasserstein distances.
method Leveraging PAC-Bayesian theory to provide bounds and learning procedures.
result PAC-Bayesian generalization bounds for adaptive SW distances.
Improves point-cloud reconstruction by optimizing projections with self-attention.
problem Inefficient and non-metric projection methods for sliced Wasserstein distances.
method Proposes distributional sliced Wasserstein distance with self-attention for permutation-invariant and metric optimization.
result Self-attention amortized distributional projection optimization achieves better performance in point-cloud reconstruction.
A new metric HSW derived from hierarchical Radon Transform addresses computational bottlenecks in sliced Wasserstein.
problem Computational inefficiency of sliced Wasserstein in high-dimensional settings with few supports.
method Hierarchical Radon Transform (HRT) and bottleneck projections to reduce projection number.
result HSW metric derived from HRT is computationally efficient and maintains metric properties.
A new spherical Sliced-Wasserstein distance for data on spheres.
problem Defining Wasserstein distance on manifolds, especially spheres.
method Closed-form solutions of the Wasserstein distance on the circle and a new spherical Radon transform.
result A novel spherical Sliced-Wasserstein (SW) discrepancy for data on spheres.
Researchers developed a differentially private method for computing Wasserstein distances.
problem Computing divergences between distributions while preserving privacy.
method They focused on the Sliced Wasserstein Distance and added Gaussian perturbations to make it differentially private.
result They introduced a new differentially private distance, the Smoothed Sliced Wasserstein Distance, which performs well in generative models and domain adaptation.
A new approach simplifies Sliced-Wasserstein distances to improve learning performance.
problem The concentration of measure phenomenon makes random projections uninformative in high dimensions.
method Propose rescaling the 1D Wasserstein distance to make all slices equally informative.
result The classical Sliced-Wasserstein, properly configured, can match or surpass complex variants.
Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to model high-dimensional distributions, sequential training and stacked architectures …
This paper improves normalizing flows by combining MLE and sliced-Wasserstein distance for better data fidelity.
problem Normalizing flows struggle with generating realistic data and detecting out-of-distribution data.
method Proposes a hybrid objective function combining MLE and sliced-Wasserstein distance.
result Shows better generative abilities and lower likelihood of out-of-distribution data.
Motivated by the growing popularity of variants of the Wasserstein distance in statistics and machine learning, we study statistical inference for the Sliced Wasserstein distance--an easily computable variant of the Wasserstein distance. Specifically, we construct confidence intervals for the Sliced Wasserstein distanc…
Introduces MSW distances to improve SW metrics.
problem Redundant projections in SW distance.
method Imposes Markov structure on projecting directions.
result MSW distances improve SW metrics.
Proposes QMC-based QSW for 3D SW distance.
problem Intractable SW distance in 3D.
method Quasi-Monte Carlo (QMC) for QSW approximations.
result QMC-based QSW improves SW estimation.
A new metric for comparing measures on tree systems reduces computational burden.
problem Heavy computation in Optimal Transport problems.
method Introducing tree systems and a novel metric (Tree-Sliced Wasserstein distance on Systems of Lines, TSW-SL).
result TSW-SL performs favorably compared to Sliced Wasserstein and its variants.
Proposes a new Sliced-Wasserstein distance for covariance matrices in M/EEG signals.
problem Efficiently dealing with distributions of covariance matrices in M/EEG multivariate time series.
method Defines a Sliced-Wasserstein distance for symmetric positive definite matrices and applies it to brain-age prediction and Brain Computer Interface applications.
result Demonstrates computational efficiency and strong theoretical guarantees for the proposed distance.
Proposes MFSWB for marginal fairness in SWB, improving efficiency and performance.
problem Achieving marginal fairness in SWB averaging.
method Defining MFSWB as a constrained SWB problem, proposing two surrogate problems and a new slicing distribution.
result Surrogate MFSWB problems effectively minimize distances to marginals and encourage marginal fairness.
We analyze critical points of the Sliced Wasserstein Distance for optimization stability.
problem Understanding the behavior of optimization algorithms for models trained with the Sliced Wasserstein Distance.
method Explicit perturbations and critical point analysis of the SW objective.
result Stable critical points of SW cannot concentrate on segments, providing optimization stability.
Proposes an energy-based sliced Wasserstein distance for improved probability measure comparison.
problem Inefficiencies and limitations in existing sliced Wasserstein distance approaches.
method Introduces an energy-based slicing distribution for better performance and stability.
result Demonstrates superior performance of the EBSW distance in various applications.
Gaussian mixture models (GMM) are powerful parametric tools with many applications in machine learning and computer vision. Expectation maximization (EM) is the most popular algorithm for estimating the GMM parameters. However, EM guarantees only convergence to a stationary point of the log-likelihood function, which c…
The paper studies properties of Sliced Wasserstein energy for discrete measures.
problem Optimizing discrete probability measures using Sliced Wasserstein loss.
method Investigates the regularity and optimisation properties of the Sliced Wasserstein energy and its Monte-Carlo approximation.
result Convergence results on the critical points of Monte-Carlo approximations to the Sliced Wasserstein energy.
In this paper we study generative modeling via autoencoders while using the elegant geometric properties of the optimal transport (OT) problem and the Wasserstein distances. We introduce Sliced-Wasserstein Autoencoders (SWAE), which are generative models that enable one to shape the distribution of the latent space int…
A new variational inference method using sliced Wasserstein distance is proposed.
problem The inefficiency and unreasonable properties of Kullback-Leibler divergence.
method Minimizing sliced Wasserstein distance, a valid metric from optimal transport.
result The proposed method approximates the unnormalized distribution efficiently and without requiring a tractable density function.
New method estimates SW distance using CDFs for scalable data parallelism.
problem Estimating SW distance efficiently for large datasets.
method Estimators based on CDFs of projected measures, avoiding sorting.
result Efficient estimation for large datasets and federated learning.
Generative model improved using Liouville PDE-based sliced-Wasserstein flow.
problem Improving generative models for fair regression.
method Transformed sliced-Wasserstein flow into Liouville PDE-based formalism, handling density estimation with normalizing flows of neural ODE.
result Outperforms in convergence and fairness with reduced variance.
A new method approximates the Sliced-Wasserstein distance without random projections.
problem Efficiently approximating the Sliced-Wasserstein distance for machine learning applications.
method Utilizing the concentration of measure phenomenon to develop a deterministic approximation.
result The approximation error goes to zero as the dimension increases, under a weak dependence condition.
Paper introduces a differentially private generative model using gradient flow and sliced Wasserstein distance.
problem Protecting privacy in sensitive training data for generative models.
method Gradient flow in the space of probability measures, Gaussian-smoothed Sliced Wasserstein Distance, and numerical scheme for SDE.
result Demonstrates higher-fidelity data generation at low privacy budget compared to existing methods.
This paper proposes a new method to solve functional minimization problems in probability distributions using sliced-Wasserstein gradient flows.
problem Solving functional minimization problems in high-dimensional probability distributions is computationally challenging.
method The paper introduces a new approach using sliced-Wasserstein gradient flows to approximate the Jordan-Kinderlehrer-Otto (JKO) scheme, parameterizing densities with generative models.
result The proposed method is more flexible and computationally tractable compared to existing methods like JKO-ICNN.
A new method for fast optimal transport using sliced Wasserstein generalized geodesics.
problem Computing optimal transport distances efficiently and accurately.
method Proposes a new proxy of squared Wasserstein distance based on one-dimensional projections.
result min-SWGG is an upper bound of Wasserstein distance with similar computational complexity.
A new method using spherical harmonics approximates the Sliced-Wasserstein distance.
problem Approximating the Sliced-Wasserstein distance between probability measures.
method Spherical Harmonics Control Variates (SHCV) method for Monte Carlo approximation of the SW distance.
result SHCV method provides an improved rate of convergence compared to Monte Carlo for general measures.
Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In this paper, we propose a new variant of sliced Wasserstein distance, study the use …
New method for summarizing Bayesian mixture models using sliced Wasserstein distances.
problem Estimating the mixing measure in nonparametric Bayesian mixture models.
method Decision-theoretic approach using sliced Wasserstein distances for Gaussian mixtures.
result Effective estimation of the mixing measure and mixture density.
Max-sliced Wasserstein metric reduces high-dimensional data to 1D for better estimation.
problem Curse of dimensionality in optimal transport.
method Introduces max-sliced Wasserstein metric to reduce high-dimensional problems to 1D.
result Uniform ratio bounds of empirical measures on RKHS concentrate uniformly fast at parametric rates.
Approximate Bayesian Computation (ABC) is a popular method for approximate inference in generative models with intractable but easy-to-sample likelihood. It constructs an approximate posterior distribution by finding parameters for which the simulated data are close to the observations in terms of summary statistics. T…
A new method for distribution regression using sliced Wasserstein distance.
problem Learning functions over spaces of probabilities.
method Proposes an OT-based estimator using the Sliced Wasserstein distance.
result Proves universal consistency and excess risk bounds for the proposed estimator.
The Wasserstein distance and its variations, e.g., the sliced-Wasserstein (SW) distance, have recently drawn attention from the machine learning community. The SW distance, specifically, was shown to have similar properties to the Wasserstein distance, while being much simpler to compute, and is therefore used in vario…
A method for fast estimation of Wasserstein distances using sliced Wasserstein distances.
problem Efficiently computing Wasserstein distances for multiple pairs of distributions.
method Regression on sliced Wasserstein distances to predict true Wasserstein distances.
result The proposed method provides a better approximation of Wasserstein distance than state-of-the-art models, especially in low-data regimes.
New method for reducing dimensions of distributional data.
problem Nonlinear sufficient dimension reduction for distribution-on-distribution regression.
method Building universal kernels on metric spaces to characterize conditional independence.
result Method outperforms competing methods in synthetic and real data applications.
sWk-means clusters multidimensional financial time series into distinct market regimes.
problem Classifying distinct market regimes in multidimensional financial time series.
method Approximated multidimensional Wasserstein distance as sliced Wasserstein distance for clustering.
result sWk-means successfully identifies distinct market regimes in real financial data.
Proposes variance reduction techniques for sliced Wasserstein distance estimation.
problem Intractability of estimating sliced Wasserstein distances.
method Uses control variates based on Gaussian approximations of projected measures.
result Significant reduction in variance of SW distance estimators.
In this work, we connect two distinct concepts for unsupervised domain adaptation: feature distribution alignment between domains by utilizing the task-specific decision boundary and the Wasserstein metric. Our proposed sliced Wasserstein discrepancy (SWD) is designed to capture the natural notion of dissimilarity betw…
A permutation-based SW test achieves minimax-optimal power for two-sample testing.
problem Nonparametric two-sample testing using the sliced Wasserstein distance.
method Proposes a permutation-based SW test and analyzes its performance.
result Achieves minimax separation rate n−1/2 over multinomial and bounded-support alternatives.