Study on conditions for achieving optimal robustness in statistical estimators.
problem Achieving the optimal robustness of estimators in statistical models.
method Developed a Wasserstein analogue of the Cramer-Rao inequality and investigated conditions for achieving the Wasserstein-Cramer-Rao lower bound.
result Conditions for the existence of asymptotically efficient estimators in one-parameter models and location-scale families.
This work robustifies Wasserstein distance estimation with MoM estimators for outlier-polluted data.
problem Estimating Wasserstein distance between two distributions with outliers.
method Introducing MoM-based robust estimators for Wasserstein distance.
result Consistent MoM-based estimators for Wasserstein distance with convergence rates.
A method for fast estimation of Wasserstein distances using sliced Wasserstein distances.
problem Efficiently computing Wasserstein distances for multiple pairs of distributions.
method Regression on sliced Wasserstein distances to predict true Wasserstein distances.
result The proposed method provides a better approximation of Wasserstein distance than state-of-the-art models, especially in low-data regimes.
Centered plug-in estimators reduce bias in Wasserstein distance estimation.
problem Conservative bias in plug-in estimators of Wasserstein distances.
method Centering procedure based on linear combinations to reduce bias.
result Centered plug-in estimators provide informative upper and lower bounds on Wasserstein distances.
This paper explores how entropic regularization improves Wasserstein estimators' performance.
problem Improving the approximation and estimation properties of Wasserstein estimators.
method Entropic regularization of optimal transport costs to smooth Wasserstein estimators.
result Entropic regularization can achieve comparable statistical performance to un-regularized estimators at lower computational cost.
Paper proposes robust estimators for GANs under Wasserstein contamination.
problem Robust estimation of distributions under contamination.
method Wasserstein GAN-based estimators for location, covariance, and regression.
result Proposed estimators are minimax optimal in many scenarios.
Study robust distribution estimation with Wasserstein distance, achieving optimal risk.
problem Robust distribution estimation under adversarial corruption.
method Combining partial OT and minimum distance estimation, proving structural properties and deriving a novel dual form.
result Achieves minimax-optimal robust estimation risk in many settings.
Wasserstein distances are increasingly used in a wide variety of applications in machine learning. Sliced Wasserstein distances form an important subclass which may be estimated efficiently through one-dimensional sorting operations. In this paper, we propose a new variant of sliced Wasserstein distance, study the use …
Study compares geometric approaches for shape and deformation statistics.
problem Characterizing statistical models of shapes and deformations.
method Information geometry and Wasserstein geometry.
result Wasserstein estimator is robust against waveform perturbation.
We study the minimax optimal rate for estimating the Wasserstein-1 metric between two unknown probability measures based on n i.i.d. empirical samples from them. We show that estimating the Wasserstein metric itself between probability measures, is not significantly easier than estimating the probability measures u…
The paper proves inequalities linking Wasserstein distances and eigenfunctions in RCD(K,∞) spaces.
problem Estimating Wasserstein distances and their bounds in RCD(K,∞) spaces.
method Similar techniques used to prove inequalities involving p-Wasserstein distances and Laplace eigenfunctions. result Proves a conjectured lower bound on p-Wasserstein distance between positive and negative parts of Laplace eigenfunctions. Improved estimator reduces bias in statistical learning models.
problem Asymptotic bias in classic WDRO estimator.
method Adjusted Wasserstein distributionally robust estimator.
result Asymptotic unbiased estimator with smaller MSE.
We reduce variance in Bures-Wasserstein variational inference.
problem High variance in Monte Carlo approximations of Bures-Wasserstein gradients.
method Control variates to reduce variance in the forward step.
result Proposed estimator reduces variance by orders of magnitude.
New tools for estimating and inferring Wasserstein distance in topic models.
problem Estimating and inferring the Wasserstein distance between mixing measures in topic models.
method New canonical interpretation and tools for inference on Wasserstein distance in topic models.
result First minimax lower bounds and fully data-driven inferential tools for the Wasserstein distance in topic models.
Proposes hinge-Wasserstein to improve uncertainty estimation in regression tasks.
problem Estimating multimodal aleatoric uncertainty in regression tasks from images.
method Regression-by-classification paradigm with hinge-Wasserstein loss.
result Hinge-Wasserstein loss improves uncertainty estimation on challenging tasks.
A new portfolio model improves on Kelly's by accounting for estimation error.
problem Estimation error in Kelly portfolio optimization.
method Wasserstein distributionally robust optimization (DRO) to define a robust log-optimal portfolio.
result The Wasserstein-Kelly portfolio outperforms the Kelly portfolio in out-of-sample testing.
Wasserstein Dropout improves uncertainty estimation in neural networks.
problem Estimating neural uncertainties for safe machine learning.
method A purely non-parametric approach using dropout-based sub-network distributions and Wasserstein distance.
result Wasserstein Dropout outperforms state-of-the-art methods in uncertainty estimation.
New theory of sensitivity for unbiased estimators using Wasserstein geometry.
problem Estimating the instability of estimators under small perturbations.
method Developed a new theory based on Wasserstein geometry, analogous to classical Cramér-Rao theory.
result Wasserstein-Cramér-Rao lower bound for sensitivity of unbiased estimators.
Corrects local error estimates for UBU integrator in SDEs, improving complexity guarantees.
problem Improper local error estimates in UBU integrator for SDEs.
method Reconciles theory with practice by correcting local error estimates.
result Stronger assumptions needed for O(d1/4ε−1/2) steps in Wasserstein-2 distance. This work improves scalability of Wasserstein distances in high dimensions.
problem Scalability issues in computing Wasserstein distances in high dimensions.
method Empirical convergence rates, robustness to data contamination, and computational methods.
result Established fast rates and robust estimation risks for sliced Wasserstein distances.
New method estimates SW distance using CDFs for scalable data parallelism.
problem Estimating SW distance efficiently for large datasets.
method Estimators based on CDFs of projected measures, avoiding sorting.
result Efficient estimation for large datasets and federated learning.
Wasserstein active regression improves estimation precision.
problem Improving regression model accuracy through active learning.
method Combines Wasserstein distance and GroupSort Neural Networks for uncertainty quantification.
result Wasserstein active regression often provides more precise estimations.
A new slicing method speeds up sliced Wasserstein estimation.
problem Efficiently estimating sliced Wasserstein distance.
method Random-Path Projecting Direction (RPD) for fast sampling.
result RPSW and IWRPSW show favorable performance in training generative models.
This paper bridges variational inference and Wasserstein gradient flows.
problem Combining variational inference and Wasserstein gradient flows for more efficient approximations.
method Recasting Bures-Wasserstein gradient flow as a Euclidean gradient flow and using path-derivative gradient estimator.
result A new gradient estimator for f-divergences that can be implemented using machine learning libraries. Study minimax robustness in statistical estimation under Wasserstein contamination.
problem Adversarial perturbations in statistical data.
method Developed minimax theory for ℓqr losses under Wasserstein-r contaminations. result Exact minimax risk identified for joint contaminations in location estimation and prediction in linear regression.
Proposes variance reduction techniques for sliced Wasserstein distance estimation.
problem Intractability of estimating sliced Wasserstein distances.
method Uses control variates based on Gaussian approximations of projected measures.
result Significant reduction in variance of SW distance estimators.
Paper develops NW kernel estimator for LSPs with Wasserstein bounds.
problem Capturing nuanced dynamics in time series data with evolving statistical characteristics.
method Nadaraya-Watson kernel smoothing for conditional probability estimation, using Wasserstein and sliced Wasserstein distances.
result Established convergence rates and bounds for NW-based conditional probability estimator in LSPs.
A Wasserstein spaces is a metric space of sufficiently concentrated probability measures over a general metric space. The main goal of this paper is to estimate the largeness of Wasserstein spaces, in a sense to be precised. In a first part, we generalize the Hausdorff dimension by defining a family of bi-Lipschitz inv…
WAVE improves stability in reinforcement learning by adaptively weighting critic's loss.
problem Inherent instability in actor-critic reinforcement learning algorithms.
method Wasserstein adaptive value estimation with Sinkhorn approximation.
result Achieves $\mathcal{O}\left(\frac{1}{k}
ight)$ convergence rate for critic's mean squared error.
The Wasserstein metric is an important measure of distance between probability distributions, with applications in machine learning, statistics, probability theory, and data analysis. This paper provides upper and lower bounds on statistical minimax rates for the problem of estimating a probability distribution under W…
DRIVE improves IV estimation by accounting for distributional uncertainties.
problem Challenges in IV estimation due to untestable model assumptions and poor finite sample properties.
method DRIVE is a distributionally robust IV estimation method that minimizes a square root TSLS objective with a Wasserstein ambiguity set.
result DRIVE achieves consistency without requiring regularization parameter to vanish, ensuring robustness to distributional uncertainties.
Private density estimation in Wasserstein distance for geographic populations.
problem Private estimation of population density distributions.
method Differentially private algorithms for Wasserstein distance, instance-optimal.
result Uniformly achievable instance-optimal rates in both 1D and 2D.
GANICE improves GAN-based causal inference by minimizing averaged Wasserstein risk.
problem Estimating interventional outcome distributions and quantiles in causal inference.
method GANICE uses extended Wasserstein distance and a cellwise critic to minimize averaged Wasserstein risk.
result GANICE achieves minimax optimality and consistently outperforms existing methods.
Establishes exponential contraction in Wasserstein distance on manifolds and flows.
problem Analyzing contraction rates in Wasserstein distance on manifolds and their evolution.
method Explicit estimates and extension to evolving manifolds under geometric flow.
result Gradient estimates with exponential contraction rate under weak curvature conditions.
Paper proves robust estimators' generalization guarantees without dimensionality issues.
problem Generalization guarantees for Wasserstein distributionally robust models.
method Analyzes and extends existing guarantees to broader classes of models and regularized versions.
result Generalization guarantees hold without dimensionality issues and cover distribution shifts.
Minimum expected distance estimation (MEDE) algorithms have been widely used for probabilistic models with intractable likelihood functions and they have become increasingly popular due to their use in implicit generative modeling (e.g. Wasserstein generative adversarial networks, Wasserstein autoencoders). Emerging fr…
New Random Forest variants estimate heterogeneous treatment effects using Wasserstein distances.
problem Estimating heterogeneous treatment effects in complex situations.
method Proposes natural variants of Random Forests using Wasserstein distances.
result Natural variants of Random Forests are well-suited for estimating conditional distributions.
Paper presents a new method to learn unnormalized models efficiently.
problem Scalability issues in score matching for flexible unnormalized models.
method Connects learning objectives to Wasserstein gradient flows for scalability.
result Demonstrates improved learning of unnormalized models on manifolds.
We introduce and study a novel model-selection strategy for Bayesian learning, based on optimal transport, along with its associated predictive posterior law: the Wasserstein population barycenter of the posterior law over models. We first show how this estimator, termed Bayesian Wasserstein barycenter (BWB), arises na…
New algorithm speeds up Wasserstein optimization.
problem Efficiently compute Wasserstein distance for probability distributions.
method Stochastic optimization with sublinear time per step.
result Algorithm reduces time per step to sublinear in dimensions.
Paper estimates Wasserstein distance for Ricci shrinkers.
problem Estimating Wasserstein distance for Ricci shrinkers.
method Analyzes Wasserstein distance between measures in tangent spaces.
result Provides upper estimate for Wasserstein distance.
Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance (in a Wasserstein sense) from the underlying empirical measure. While motivated by…
The paper shows how heat flows and Wasserstein distances relate to space rigidity.
problem Understanding rigidity in Wasserstein contraction along heat flows.
method Establishing equivalence between rigidity and Bakry-Émery gradient estimates, applying results from Ambrosio-Brué-Semola and Han.
result Spaces with specific curvature bounds exhibit rigidity in Wasserstein contraction.
Wasserstein gradient boosting predicts probability distributions for supervised learning.
problem Distribution-valued supervised learning where outputs are probability distributions.
method Fits a new weak learner to Wasserstein gradients of loss functionals of probability distributions.
result Superior performance in probabilistic prediction compared to existing methods.
New algorithm solves uncertain Markov decision processes using Wasserstein uncertainty.
problem Solving Markov decision processes with uncertain transition probabilities.
method Distributionally robust Q-learning algorithm for Wasserstein uncertainty. result Convergence of the algorithm proved and demonstrated with real data.
Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent improvement in GAN literature is to use the Wasserstein distance as loss function le…
Proposes a new distance metric for multi-marginal optimal transport.
problem Computational scalability in multi-marginal optimal transport.
method Random one-dimensional projections to construct sliced multi-marginal Wasserstein distance.
result Sliced multi-marginal Wasserstein distance is a metric with dimension-free sample complexity.
We propose a novel fused Gromov-Wasserstein alignment method to jointly learn the Hawkes processes in different event spaces, and align their event types. Given two Hawkes processes, we use fused Gromov-Wasserstein discrepancy to measure their dissimilarity, which considers both the Wasserstein discrepancy based on the…