Paper presents efficient computation of robust Wasserstein distance using Riemannian optimization.
problem Intractability of optimizing Projection Robust Wasserstein (PRW) distance due to non-convexity and non-smoothness.
method Riemannian optimization to efficiently compute PRW/Wasserstein Projection Pursuit (WPP) distance.
result The original formulation of PRW/WPP can be efficiently computed in practice, providing better behavior than its convex relaxation.
A general duality proof for Wasserstein distributionally robust optimization.
problem Optimizing under uncertainty with Wasserstein distance.
method One-dimensional convex analysis and interchangeability principle.
result General duality result holds for various distributions and costs.
Paper proposes PRWB and RPRWB for Wasserstein barycenters.
problem Numerical challenges in computing Wasserstein barycenters.
method Projection robust Wasserstein barycenter (PRWB) and relaxed PRWB (RPRWB).
result RPRWB improves clustering performance on real text datasets.
This work improves understanding of projection robust optimal transport distances.
problem Understanding the behavior of minimum Wasserstein estimators in high-dimensional and misspecified models.
method Adopting projection robust (PR) optimal transport, establishing statistical properties, proposing IPRW distance, and providing asymptotic guarantees.
result Established fundamental statistical properties and proposed new distances that outperform Wasserstein distances empirically.
Bayesian approach to portfolio selection reduces pessimism in frequent trading.
problem Tackling the challenge of estimating drift in Merton's portfolio selection model.
method Bayesian distributionally robust control with nonlinear Wasserstein projections.
result Reduced pessimism and improved performance in frequent rebalancing compared to existing methods.
Robust Q Q Q -learning for mean-field control under Wasserstein uncertainty
problem Mean-field control under Wasserstein uncertainty
method Quantization-and-projection scheme with Wasserstein dual reformulation
result Convergence and finite-time iteration bounds
A new method solves the projection robust Wasserstein distance problem efficiently.
problem Computing the projection robust Wasserstein distance is challenging due to the curse of dimensionality.
method Riemannian block coordinate descent (RBCD) method to solve the regularized max-min problem over the Stiefel manifold.
result RBCD method significantly improves the complexity of obtaining an ε-stationary point compared to existing methods.
New method for robustly interpreting ML models using quantile constraints and Wasserstein projections.
problem Assessing robustness of black-box models to input misspecification.
method Quantile-constrained Wasserstein projections for robust interpretability.
result Analytical solution for perturbation problem and smooth perturbations.
Our attacks are stronger and faster under Wasserstein metric.
problem Vulnerability of deep models to adversarial attacks.
method Developed an exact yet efficient projection operator and used the Frank-Wolfe method.
result Generated much stronger attacks and improved model robustness.
Efficient algorithms solve large-scale DRSVM problems.
problem Optimizing support vector machines under worst-case distribution uncertainty.
method Epigraphical projection-based incremental algorithms.
result Incremental algorithms solve DRSVM problems up to 1000x faster than state-of-the-art methods.
Efficiently learns distributions corrupted by both global and local adversarial modifications.
problem Learning distributions with both global and local adversarial corruptions.
method Develops an efficient algorithm to minimize Wasserstein distance with orthogonal projections.
result Achieves optimal risk bounds with error ε k + ρ + i l d e O ( d k n − 1 / ( k ∨ 2 ) ) \sqrt{\varepsilon k} + ρ+ ilde{O}(d\sqrt{k}n^{-1/(k \lor 2)}) ε k + ρ + i l d e O ( d k n − 1/ ( k ∨ 2 ) ) . The paper tackles robust statistical methods using Wasserstein DRO formulations.
problem Distributional uncertainty in learning from limited samples.
method Min-max distributionally robust optimization with Wasserstein DRO formulations.
result Error bounds free from the curse of dimensionality.
Making sense of Wasserstein distances between discrete measures in high-dimensional settings remains a challenge. Recent work has advocated a two-step approach to improve robustness and facilitate the computation of optimal transport, using for instance projections on random real lines, or a preliminary quantization of…
A rapidly growing area of work has studied the existence of adversarial examples, datapoints which have been perturbed to fool a classifier, but the vast majority of these works have focused primarily on threat models defined by ℓ p \ell_p ℓ p norm-bounded perturbations. In this paper, we propose a new threat model for adver…
KG-WDRO optimizes transfer learning with external knowledge.
problem Over-pessimism in WDRO for small target samples.
method KG-WDRO incorporates multiple sources of external knowledge to construct smaller Wasserstein ambiguity sets.
result KG-WDRO improves transfer learning performance and adaptivity.
Develops a two-sample test using projected Wasserstein distance to handle high-dimensional data.
problem Testing whether two high-dimensional samples come from the same distribution.
method Optimal projection to find a low-dimensional linear mapping that maximizes the Wasserstein distance between projected probability distributions.
result Characterizes the convergence rate of the projected Wasserstein distance and presents practical algorithms.
We propose fast approximations for the generalized sliced-Wasserstein distance.
problem Efficient approximation of the generalized sliced-Wasserstein distance in high dimensions.
method Deterministic approximations using random projections and concentration of measure results.
result One-dimensional projections of high-dimensional random vectors are approximately Gaussian.
A faster Wasserstein k-means algorithm for histogram data reduces computation and maintains clustering quality.
problem Efficiently clustering histogram data with reduced computation time.
method Sparse simplex projection to reduce data samples, centroids, and ground cost matrix, dynamically removing lower-valued samples.
result Significant reduction in computational complexity without compromising clustering quality.
Paper develops a new method for differential privacy sampling using Wasserstein distance.
problem Sampling from distributions under differential privacy constraints with geometric structure consideration.
method Develops a novel framework with Wasserstein Projection Mechanism (WPM) for minimax optimal mechanisms.
result Proposes efficient algorithms for approximate computation of the Wasserstein Projection Mechanism.
We solve robust optimization problems using Wasserstein balls and apply it to mean-CVaR optimization.
problem Distributionally robust optimization with Wasserstein ambiguity sets.
method Transformed robust optimization into non-robust with penalty term, selecting ambiguity set size.
result Impressive results in robust mean-CVaR optimization compared to other strategies.
Improves point-cloud reconstruction by optimizing projections with self-attention.
problem Inefficient and non-metric projection methods for sliced Wasserstein distances.
method Proposes distributional sliced Wasserstein distance with self-attention for permutation-invariant and metric optimization.
result Self-attention amortized distributional projection optimization achieves better performance in point-cloud reconstruction.
A new method optimizes projection directions for sliced Wasserstein distances.
problem Finding informative projecting directions for sliced Wasserstein distances is computationally expensive.
method Amortized projection optimization to predict directions efficiently.
result Proposed amortized models improve generative modeling performance.
Paper introduces robust market making using Wasserstein distance and entropy regularization.
problem Market making robustness under uncertainty.
method Wasserstein distance, entropy regularization, convex optimization, optimal radius selection.
result The robust market making problem can be reformulated as a convex optimization problem.
Researchers find Busemann functions in Wasserstein space, enabling efficient projections and distances.
problem Defining Busemann functions in Wasserstein space for efficient data projections and distances.
method Investigated existence and computation of Busemann functions in Wasserstein space, establishing closed-form expressions for specific cases.
result Explicit projection schemes for probability distributions on \(\mathbb{R}\) enable novel Sliced-Wasserstein distances over Gaussian mixtures and labeled datasets.
WRAAC uses Wasserstein distance for robust reinforcement learning.
problem Lack of quantified robustness to system dynamics in existing reinforcement learning algorithms.
method Leverages Wasserstein distance to connect state disturbance to transition kernel disturbance, reducing infinite-dimensional optimization to a finite-dimensional problem.
result Designs a novel algorithm, WRAAC, that achieves robust reinforcement learning.
New method improves Wasserstein distance for large-scale data.
problem High computational cost of Wasserstein distance for large-scale machine learning.
method Augmented Sliced Wasserstein Distances (ASWDs) using neural network mappings.
result ASWDs significantly outperform other Wasserstein variants in synthetic and real-world problems.
A new slicing method speeds up sliced Wasserstein estimation.
problem Efficiently estimating sliced Wasserstein distance.
method Random-Path Projecting Direction (RPD) for fast sampling.
result RPSW and IWRPSW show favorable performance in training generative models.
Study on conditions for achieving optimal robustness in statistical estimators.
problem Achieving the optimal robustness of estimators in statistical models.
method Developed a Wasserstein analogue of the Cramer-Rao inequality and investigated conditions for achieving the Wasserstein-Cramer-Rao lower bound.
result Conditions for the existence of asymptotically efficient estimators in one-parameter models and location-scale families.
AdaRL improves robust RL by adaptively adjusting policy complexity.
problem Handling epistemic uncertainty in environment dynamics.
method Bi-level optimization framework with adaptive rank adjustment.
result AdaRL outperforms existing methods on MuJoCo benchmarks.
A new portfolio model improves on Kelly's by accounting for estimation error.
problem Estimation error in Kelly portfolio optimization.
method Wasserstein distributionally robust optimization (DRO) to define a robust log-optimal portfolio.
result The Wasserstein-Kelly portfolio outperforms the Kelly portfolio in out-of-sample testing.
Exact generalization guarantees for robust models using Wasserstein distance are established.
problem Capturing data uncertainty and distribution shifts in machine learning models.
method Establishes exact generalization guarantees for robust models based on the Wasserstein distance, covering various cases and transport costs.
result Exact generalization guarantees are provided for a wide range of cases, including deep learning objectives with nonsmooth activations.
Paper tackles robust optimal transport with improved computational complexity and barycenter approximation.
problem Computing robust optimal transport and its barycenter efficiently.
method Sinkhorn-based algorithms for robust optimal transport and iterative Bregman projections for barycenter approximation.
result Improved computational complexity for robust optimal transport and barycenter approximation.
A new method approximates the Sliced-Wasserstein distance without random projections.
problem Efficiently approximating the Sliced-Wasserstein distance for machine learning applications.
method Utilizing the concentration of measure phenomenon to develop a deterministic approximation.
result The approximation error goes to zero as the dimension increases, under a weak dependence condition.
Wasserstein distance plays increasingly important roles in machine learning, stochastic programming and image processing. Major efforts have been under way to address its high computational complexity, some leading to approximate or regularized variations such as Sinkhorn distance. However, as we will demonstrate, regu…
Introduces MSW distances to improve SW metrics.
problem Redundant projections in SW distance.
method Imposes Markov structure on projecting directions.
result MSW distances improve SW metrics.
Paper quantifies distortion risk measures' robustness to distributional uncertainty.
problem Quantifying risk measures' robustness to distributional uncertainty.
method Employing isotonic projections, the paper derives bounds on distortion risk measures' values.
result Sharp bounds on distortion risk measures' values are provided, especially for Value-at-Risk and Range-Value-at-Risk.
A robust multiclass SVM tackles imbalanced data uncertainty.
problem Imbalanced multiclass classification with uncertain labels.
method Wasserstein distributionally robust optimization for multiclass SVM.
result Our model outperforms state-of-the-art OVA models in imbalanced settings.
Study robust distribution estimation with Wasserstein distance, achieving optimal risk.
problem Robust distribution estimation under adversarial corruption.
method Combining partial OT and minimum distance estimation, proving structural properties and deriving a novel dual form.
result Achieves minimax-optimal robust estimation risk in many settings.
The paper finds non-Gaussian directions in high-dimensional data using Wasserstein distance.
problem Locating interesting non-Gaussian features in high-dimensional data.
method Projection pursuit using 2-Wasserstein distance to maximize the difference from Gaussian.
result Statistical guarantees for accurately approximating an unknown low-dimensional non-Gaussian subspace.
New framework robustly handles outliers in Wasserstein DRO for better decision-making.
problem Non-geometric perturbations like adversarial outliers distort Wasserstein distance.
method Proposes an outlier-robust WDRO framework using a robust Wasserstein ball.
result Derives minimax optimal excess risk bounds for robust WDRO.
New method estimates SW distance using CDFs for scalable data parallelism.
problem Estimating SW distance efficiently for large datasets.
method Estimators based on CDFs of projected measures, avoiding sorting.
result Efficient estimation for large datasets and federated learning.
This work robustifies Wasserstein distance estimation with MoM estimators for outlier-polluted data.
problem Estimating Wasserstein distance between two distributions with outliers.
method Introducing MoM-based robust estimators for Wasserstein distance.
result Consistent MoM-based estimators for Wasserstein distance with convergence rates.
Proposes robust model through Wasserstein geodesic interpolation of training data.
problem Improving model robustness through data augmentation.
method Augment data by finding worst-case Wasserstein barycenter on geodesic path.
result Improves robustness on CIFAR-10 up to 7.7% and on CIFAR-100 up to 16.8%.
New statistical methods for analyzing distributions using Wasserstein metric.
problem Statistical analysis of probability distributions on the real line.
method Projected methods exploiting Wasserstein metric and Riemannian structure.
result Projected PCA and regression methods are faster and more flexible.
A new metric HSW derived from hierarchical Radon Transform addresses computational bottlenecks in sliced Wasserstein.
problem Computational inefficiency of sliced Wasserstein in high-dimensional settings with few supports.
method Hierarchical Radon Transform (HRT) and bottleneck projections to reduce projection number.
result HSW metric derived from HRT is computationally efficient and maintains metric properties.
A new method for Bayesian inference tackles high-dimensional problems.
problem Bayesian inference in high-dimensional settings with kernel density estimation issues.
method Projected Wasserstein gradient descent (pWGD) method to overcome curse of dimensionality.
result pWGD method effectively addresses high-dimensional Bayesian inference problems.
We improve image perturbation defenses using a better-defined Wasserstein threat model.
problem Real-world image perturbations are not pixel-independent, unlike ℓ p \ell_p ℓ p threat models. method We rectify flaws in the Wasserstein threat model and explore stronger attacks and defenses.
result Current Wasserstein-robust models are ineffective against real-world perturbations.
This work improves scalability of Wasserstein distances in high dimensions.
problem Scalability issues in computing Wasserstein distances in high dimensions.
method Empirical convergence rates, robustness to data contamination, and computational methods.
result Established fast rates and robust estimation risks for sliced Wasserstein distances.