arXiv research

The paper explores multidimensional critic output in GANs, improving convergence and diversity.

Improved GAN performance using higher-order Wasserstein moments.

Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent improvement in GAN literature is to use the Wasserstein distance as loss function le…

A scalable algorithm approximates Wasserstein Barycenters using neural networks.

Generative Adversarial Networks create synthetic data for structural damage detection.

Study robust distribution estimation with Wasserstein distance, achieving optimal risk.

Our attacks are stronger and faster under Wasserstein metric.

WGANs improve probability distribution approximation with depth and width trade-offs.

Generative adversarial networks (GANs) are one of the most popular approaches when it comes to training generative models, among which variants of Wasserstein GANs are considered superior to the standard GAN formulation in terms of learning stability and sample quality. However, Wasserstein GANs require the critic to b…

Develops a new non-adversarial framework for better generative models.

Adaptive framework for learning latent space dimensions in GANs.

This paper raises an implicit manifold learning perspective in Generative Adversarial Networks (GANs), by studying how the support of the learned distribution, modelled as a submanifold $\mathcal{M}_θ$, perfectly match with $\mathcal{M}_{r}$, the support of the real data distribution. We show that optimizing Jensen-Sha…

iWGAN improves GANs by stabilizing training and preventing mode collapse.

The study improves PAC-Bayesian bounds for adversarial generative models.

Enhances generative models stability and accuracy with BNPL, WMMD, and triple model.

Paper proposes WGAIN for missing feature reconstruction.

DAG-WGAN learns causal structures using Wasserstein distance.

Vanilla GANs are connected to Wasserstein distance for better understanding.

DRO-Augment framework enhances deep neural network robustness.

Quantum Earth Mover's distance improves stability and efficiency in quantum learning.

MonoFlow rethinks GANs using Wasserstein gradient flows.

Paper tackles distribution matching by partially matching distributions, achieving robust results.

We investigate under and overfitting in Generative Adversarial Networks (GANs), using discriminators unseen by the generator to measure generalization. We find that the model capacity of the discriminator has a significant effect on the generator's model quality, and that the generator's poor performance coincides with…

We study minimax convergence rates of nonparametric density estimation under a large class of loss functions called "adversarial losses", which, besides classical $\mathcal{L}^p$ losses, includes maximum mean discrepancy (MMD), Wasserstein distance, and total variation distance. These losses are closely related to the …

In this paper we study generative modeling via autoencoders while using the elegant geometric properties of the optimal transport (OT) problem and the Wasserstein distances. We introduce Sliced-Wasserstein Autoencoders (SWAE), which are generative models that enable one to shape the distribution of the latent space int…

Generative adversarial network improves audio inpainting for long gaps.

Improved robustness for deep neural networks with tighter bounds and attacks.

Electroencephalography (EEG) data are difficult to obtain due to complex experimental setups and reduced comfort with prolonged wearing. This poses challenges to train powerful deep learning model with the limited EEG data. Being able to generate EEG data computationally could address this limitation. We propose a nove…

GroupSort neural networks can approximate Lipschitz continuous functions.

New findings suggest minimax optimality doesn't guarantee distribution learning for GANs.

This paper explains the math behind a generative adversarial network (GAN) model and why it is hard to be trained. Wasserstein GAN is intended to improve GANs' training by adopting a smooth metric for measuring the distance between two probability distributions.

WDAIL uses Wasserstein distance for more effective reward shaping in IL.

In the last couple of years, several adversarial attack methods based on different threat models have been proposed for the image classification problem. Most existing defenses consider additive threat models in which sample perturbations have bounded L_p norms. These defenses, however, can be vulnerable against advers…

Paper provides statistical guarantees for GANs estimating Hölder space densities.

This study analyzes how well GANs approximate distributions from small samples.

Wasserstein GANs are shown to have hidden convexity, enabling exact solutions with convex optimization.

Generative Adversarial Networks (GANs) produce systematically better quality samples when class label information is provided., i.e. in the conditional GAN setup. This is still observed for the recently proposed Wasserstein GAN formulation which stabilized adversarial training and allows considering high capacity netwo…

A rapidly growing area of work has studied the existence of adversarial examples, datapoints which have been perturbed to fool a classifier, but the vast majority of these works have focused primarily on threat models defined by $\ell_p$ norm-bounded perturbations. In this paper, we propose a new threat model for adver…

Paper proposes robust estimators for GANs under Wasserstein contamination.

Generative adversarial networks (GANs) have received a tremendous amount of attention in the past few years, and have inspired applications addressing a wide range of problems. Despite its great potential, GANs are difficult to train. Recently, a series of papers (Arjovsky & Bottou, 2017a; Arjovsky et al. 2017b; and Gu…

Wasserstein Generative Adversarial Networks (WGANs) provide a versatile class of models, which have attracted great attention in various applications. However, this framework has two main drawbacks: (i) Wasserstein-1 (or Earth-Mover) distance is restrictive such that WGANs cannot always fit data geometry well; (ii) It …

Training neural networks under a strict Lipschitz constraint is useful for provable adversarial robustness, generalization bounds, interpretable gradients, and Wasserstein distance estimation. By the composition property of Lipschitz functions, it suffices to ensure that each individual affine transformation or nonline…

Generative source separation methods such as non-negative matrix factorization (NMF) or auto-encoders, rely on the assumption of an output probability density. Generative Adversarial Networks (GANs) can learn data distributions without needing a parametric assumption on the output density. We show on a speech source se…

POTNet uses penalized optimal transport to generate data without mode collapse.

The paper explores theoretical insights into WGANs for better understanding and stability.

To address the challenges in learning deep generative models (e.g.,the blurriness of variational auto-encoder and the instability of training generative adversarial networks, we propose a novel deep generative model, named Wasserstein-Wasserstein auto-encoders (WWAE). We formulate WWAE as minimization of the penalized …

Domain adaptation aims at generalizing a high-performance learner on a target domain via utilizing the knowledge distilled from a source domain which has a different but related data distribution. One solution to domain adaptation is to learn domain invariant feature representations while the learned representations sh…

Minimum expected distance estimation (MEDE) algorithms have been widely used for probabilistic models with intractable likelihood functions and they have become increasingly popular due to their use in implicit generative modeling (e.g. Wasserstein generative adversarial networks, Wasserstein autoencoders). Emerging fr…