Understanding proper distance measures between distributions is at the core of several learning tasks such as generative models, domain adaptation, clustering, etc. In this work, we focus on mixture distributions that arise naturally in several application domains where the data contains different sub-populations. For …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Mixture Wasserstein distance”
Paper proposes a new Wasserstein distance for mixtures of radially contoured distributions.
problem Generalization of Wasserstein distance to non-elliptically contoured distributions.
method Relaxed formulation for mixtures of radially contoured distributions without marginal consistency.
result The new distance yields more stable error and better color distribution in image transfer tasks.
Paper uses Gaussian mixture models and Wasserstein distance for schema matching.
problem Schema matching between different datasets.
method Gaussian mixture models and Wasserstein distance for comparison.
result Derives an approximation for Wasserstein distance between Gaussian mixture models.
Estimation and inference for the Wasserstein distance between mixing measures in topic modelsmath.ST
New tools for estimating and inferring Wasserstein distance in topic models.
problem Estimating and inferring the Wasserstein distance between mixing measures in topic models.
method New canonical interpretation and tools for inference on Wasserstein distance in topic models.
result First minimax lower bounds and fully data-driven inferential tools for the Wasserstein distance in topic models.
New slicing methods speed up Gaussian mixture Wasserstein distance computations.
problem High computational cost of the mixture Wasserstein distance.
method Slicing-based approximations to reduce computational complexity.
result Significant reduction in computational complexity while preserving key properties.
Paper introduces new Gromov-type distances for comparing Gaussian mixture models.
problem Comparing distributions across different metric spaces using Gromov-Wasserstein distances.
method Incorporates invariance properties into MW2, introducing MGW2 and EW2.
result MGW2 and EW2 are efficient for estimating distances between GMMs in practical applications.
This paper studies convergence behavior of latent mixing measures that arise in finite and infinite mixture models, using transportation distances (i.e., Wasserstein metrics). The relationship between Wasserstein distances on the space of mixing measures and f-divergence functionals such as Hellinger and Kullback-Leibl…
Paper proposes MWDE for estimating finite location-scale mixtures.
problem Estimating finite location-scale mixtures using MLE is problematic.
method Investigates minimum Wasserstein distance estimators (MWDE).
result MWDE is consistent and provides a numerical solution.
Study proposes a new metric for comparing Gaussian mixtures in RKHS.
problem Comparing complex multimodal densities in RKHS.
method Wasserstein-type metric for kernel Gaussian mixtures.
result Enhanced capability to model multimodal densities.
New distances measure mixtures of Gaussians, useful in machine learning.
problem Comparing distributions with disjoint supports.
method Schoenberg-Rao distances based on concave Rao's entropy.
result Closed-form distances for mixtures of Gaussians.
Improved convergence rates for MLE in mixture models using penalized log-likelihood.
problem Convergence rates for MLE in finite mixture models.
method Penalizing log-likelihood to discourage vanishing mixing weights, using Wasserstein distance and new loss functions.
result Improved convergence rates for some mixture components, faster than traditional methods.
We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides a more desirable optimisation space. We thus provide a stable solution to the E…
New method for summarizing Bayesian mixture models using sliced Wasserstein distances.
problem Estimating the mixing measure in nonparametric Bayesian mixture models.
method Decision-theoretic approach using sliced Wasserstein distances for Gaussian mixtures.
result Effective estimation of the mixing measure and mixture density.
Gaussian mixture models (GMM) are powerful parametric tools with many applications in machine learning and computer vision. Expectation maximization (EM) is the most popular algorithm for estimating the GMM parameters. However, EM guarantees only convergence to a stationary point of the log-likelihood function, which c…
A method for fast estimation of Wasserstein distances using sliced Wasserstein distances.
problem Efficiently computing Wasserstein distances for multiple pairs of distributions.
method Regression on sliced Wasserstein distances to predict true Wasserstein distances.
result The proposed method provides a better approximation of Wasserstein distance than state-of-the-art models, especially in low-data regimes.
We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any time spot follows a Gaussian mixture distribution, a fact exploited to softly matc…
Algorithm improves variational inference in Wasserstein distance.
problem Improving variational inference methods for complex models.
method Wasserstein contraction analysis of coordinate ascent.
result General and sharp convergence guarantees for various models.
We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any time position follows a Gaussian mixture distribution, a fact exploited to softly …
New method estimates SW distance using CDFs for scalable data parallelism.
problem Estimating SW distance efficiently for large datasets.
method Estimators based on CDFs of projected measures, avoiding sorting.
result Efficient estimation for large datasets and federated learning.
We define a novel class of distances between statistical multivariate distributions by modeling an optimal transport problem on their marginals with respect to a ground distance defined on their conditionals. These new distances are metrics whenever the ground distance between the marginals is a metric, generalize both…
Proposes a Riemannian optimization for policy improvement in MDPs.
problem Optimizing policy functions in Markov decision processes (MDPs).
method Riemannian proximal optimization algorithm with Gaussian mixture model (GMM).
result Guaranteed convergence and efficacy demonstrated in preliminary experiments.
This paper improves topic model estimation for sparse distributions and applies it to Wasserstein distances.
problem Estimating sparse topic distributions in topic models with high-dimensional data.
method MLE for topic weights when is known, plug-in estimator for unknown .
result MLE can be exactly sparse and contain true zero pattern of topic weights.
Wasserstein framework solves mixed linear regression problems.
problem Mixed linear regression with multi-modal distributions.
method Wasserstein distance minimization for nonconvex-concave minimax optimization.
result WMLR achieves global convergence and generalization guarantees for two linear models.
Proposes new loss functions for better handling bimodal predictive uncertainty.
problem Bimodal predictive uncertainty in machine learning models.
method Family of distribution-aware loss functions integrating normalized RMSE with Wasserstein and Cramér distances.
result Proposed loss functions reduce predictive uncertainty estimation error by 45% on complex bimodal datasets.
WDL models density curves using Wasserstein distance and flexible mixture models.
problem Modeling entire distribution and non-negativity constraints.
method Wasserstein distance, Semi-parametric Conditional Gaussian Mixture Models (SCGMM), Majorization-Minimization optimization.
result WDL better characterizes nonlinear dependence of conditional densities.
Differentiable Expectation-Maximisation and Applications to Gaussian Mixture Model Optimal Transportcs.LG
Differentiable EM for Gaussian Mixture Models improves model integration.
problem Non-differentiability of EM algorithm limits its use in modern learning pipelines.
method Presented and compared several differentiation strategies for EM.
result Differentiable EM enables the use of Mixture Wasserstein distance in machine learning tasks.
Busemann Functions in the Wasserstein Space: Existence, Closed-Forms, and Applications to Slicingcs.LG
Researchers find Busemann functions in Wasserstein space, enabling efficient projections and distances.
problem Defining Busemann functions in Wasserstein space for efficient data projections and distances.
method Investigated existence and computation of Busemann functions in Wasserstein space, establishing closed-form expressions for specific cases.
result Explicit projection schemes for probability distributions on \(\mathbb{R}\) enable novel Sliced-Wasserstein distances over Gaussian mixtures and labeled datasets.
Understanding separation effects on parameter estimation in finite Gaussian mixtures
problem Minimum component separation impact on convergence rates in finite Gaussian mixtures
method Developing a unified geometric framework using Hellinger lower bounds and specialized moment-extraction test functions
result Separation complexity driven by spatial configuration of mixture components
Neural Local Wasserstein Regression models distribution-on-distribution regression with flexible, localized transport maps.
problem Estimating distribution-on-distribution regression with global optimal transport maps or linearization limitations.
method Proposes Neural Local Wasserstein Regression, a flexible nonparametric framework using locally defined transport maps in Wasserstein space.
result Demonstrates effective capture of nonlinear and high-dimensional distributional relationships.
New algorithm for computing Gaussian mixtures with guaranteed accuracy and efficiency.
problem Computing the nonparametric maximum likelihood estimator for Gaussian mixtures efficiently and accurately.
method Developed an algorithm that computes an ε-approximation of the estimator in Wasserstein distance with time complexity , and certifiably computes the exact number of components.
result The algorithm provides guaranteed accuracy and efficiency for computing the nonparametric maximum likelihood estimator for Gaussian mixtures.
While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work of Arora et al. suggests a dilemma about GANs' statistical properties: powerful d…
A new method for estimating SW from streaming data.
problem Estimating Wasserstein distance from sample streams.
method Introducing a streaming estimator of the 1DW and applying it to all projections.
result Stream-SW achieves more accurate approximation of SW than random subsampling.
Wasserstein GANs fail to approximate Wasserstein distance, leading to their success.
problem Approximating Wasserstein distance in deep generative models.
method Analysis of differences between theoretical setup and training reality.
result Wasserstein GANs' success is due to their failure to approximate Wasserstein distance.
OT-ICA uses optimal transport to find independent components, outperforming traditional methods.
problem Finding independent components from linear mixtures of signals.
method OT-ICA uses the squared Wasserstein distance to maximize non-Gaussianity, optimizing projections via gradient descent.
result OT-ICA outperforms traditional proxy-based methods in various applications.
The paper introduces a new Wasserstein distance for approximating posteriors in inverse problems.
problem Approximating posterior measures in inverse problems using conditional Wasserstein distances.
method Introduces a conditional Wasserstein distance with restricted couplings and derives its dual.
result Shows that conditional Wasserstein GANs can yield favorable properties for posterior sampling.
The paper studies scaling limits of Wasserstein metrics on Gaussian mixture models.
problem Understanding the scaling limits of Wasserstein metrics on Gaussian mixture models.
method Scaling limit approach on Gaussian mixture models, including inhomogeneous and extended models.
result Existence of the limit of the Wasserstein metric after renormalization for GMMs with zero variance.
A new robust metric compares distributions more accurately than existing methods.
problem Sensitivity to outliers and sampling discrepancy in Wasserstein distances.
method Introducing k-RPW, a partial p-Wasserstein distance.
result k-RPW converges faster to true distance and is more robust to outliers.
A new distance metric for vMF distributions simplifies spherical data analysis.
problem Intractability of normalization constants and lack of suitable geometric metrics for comparing vMF distributions.
method Proposes a Wasserstein-like distance that decomposes vMF distribution discrepancies into angular and concentration components.
result The proposed distance metric induces a latent geometric structure on the space of non-degenerate vMF distributions.
We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the -Wasserstein metric tensor in the probability density space to a parameter space, equipping the latter with a positive definite metric tensor, under which it becomes a Riemanni…
Paper optimizes classification of distributions using Wasserstein metric.
problem Classifying instances represented by distributions on a vector space.
method Maximizing Fisher's ratio in the Wasserstein metric space through iterative algorithm.
result The method enhances classification performance and is robust to variations in distribution summaries.
This paper approximates 1-Wasserstein distance using tree-based embedding.
problem Computational inefficiency of estimating 1-Wasserstein distance.
method L1-regularized approach to learn tree weights, using shortest path distance as a linear model.
result Tree-Wasserstein distance (TWD) approximates 1-Wasserstein distance efficiently.
A new method for learning Gaussian Mixture Models using gradient descent.
problem Learning Gaussian Mixture Models efficiently and with gradient descent.
method Sliced Cramér 2-distance for multivariate GMMs, compatible with gradient descent.
result Closed-form solution for univariate case, easy to implement.
Upper bound for max-sliced 2-Wasserstein distance between measures.
problem Estimating distance between probability measures and their empirical counterparts.
method Same technique as previous work, upper bound approach.
result Upper bound for expected max-sliced 2-Wasserstein distance.
We propose fast approximations for the generalized sliced-Wasserstein distance.
problem Efficient approximation of the generalized sliced-Wasserstein distance in high dimensions.
method Deterministic approximations using random projections and concentration of measure results.
result One-dimensional projections of high-dimensional random vectors are approximately Gaussian.
A new supervised tree-Wasserstein distance improves document classification.
problem Measuring document similarity efficiently and accurately.
method Rewriting Wasserstein distance on tree metric, using contrastive loss for optimization.
result The Supervised Tree-Wasserstein (STW) distance improves document classification accuracy.
Note on the computational complexity of Gromov-Wasserstein distance.
problem Computational difficulty of Gromov-Wasserstein distance.
method Analysis of the optimization problem structure and providing explicit examples.
result Gromov-Wasserstein distance optimization problem is non-convex quadratic.
This work robustifies Wasserstein distance estimation with MoM estimators for outlier-polluted data.
problem Estimating Wasserstein distance between two distributions with outliers.
method Introducing MoM-based robust estimators for Wasserstein distance.
result Consistent MoM-based estimators for Wasserstein distance with convergence rates.
Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In this paper, we propose a new variant of sliced Wasserstein distance, study the use …