Proposes MR-GAN to improve GAN training by respecting real data manifold geometry.
problem Challenges in training GANs, especially mode collapse and poor generalization.
method Introduces manifold regularizer to regularize GAN training.
result Improves GAN performance in terms of generalization, equilibrium, and stability.
SR-GANs combat mode collapse in GANs by monitoring and compensating spectral distributions.
problem Mode collapse in GANs.
method Spectral regularization (SR-GANs) to combat spectral collapse.
result SR-GANs prevent mode collapse and outperform SN-GANs in experiments.
GAN+VER improves GANs by regularizing entropy to reduce mode collapse.
problem Mode collapse in GANs where the generator fails to capture all modes.
method Maximizing a variational lower bound on the entropy of generated samples.
result Significant improvement in evaluation metrics for real and generated samples.
Adversarial Lipschitz Regularization improves Wasserstein GANs without gradient norm penalties.
problem Training stability and sample quality issues in Wasserstein GANs.
method Explicit Lipschitz penalty using adversarial training.
result Explicit Lipschitz penalty leads to competitive performance in Wasserstein GANs.
This work investigates image augmentations for GAN training, improving image quality.
problem Improving the accuracy and robustness of GAN models for image synthesis.
method Systematic study of various image augmentation techniques for GAN training.
result Vanilla GANs can achieve state-of-the-art generation quality with image augmentations.
A new training method for GANs improves image generation quality.
problem Training GANs is challenging and unstable.
method Consistency regularization to stabilize GAN training.
result CR-GAN achieves best FID scores for unconditional image generation.
Regularized OT improves disentangled latent representations in GANs.
problem Disentangled representation learning in GANs.
method Structured regularization of optimal transport for latent space.
result Regularization leads to informative latent dimensions in GANs.
Generative Adversarial Networks are powerful generative models that are able to model the manifold of natural images. We leverage this property to perform manifold regularization by approximating a variant of the Laplacian norm using a Monte Carlo approximation that is easily computed with the GAN. When incorporated in…
Improves GAN-based semi-supervised learning with consistency regularization.
problem Lack of consistency in class probability predictions under local perturbations.
method Introduces consistency regularization to GANs, leveraging both local and interpolation consistency.
result Significantly improves performance and achieves new state-of-the-art results.
GANS are powerful generative models that are able to model the manifold of natural images. We leverage this property to perform manifold regularization by approximating the Laplacian norm using a Monte Carlo approximation that is easily computed with the GAN. When incorporated into the feature-matching GAN of Improved …
Enhances GANs by improving consistency regularization.
problem Improving the artifacts introduced by consistency regularization in GANs.
method Proposed modifications to consistency regularization to fix artifacts and improve performance.
result Significant improvement in FID scores on various GAN architectures.
Study on GANs learning distributions, deriving rates and regularization.
problem Learning distributions with GANs.
method Analysis of GANs through regularization theory.
result Optimal rates for distribution estimation under adversarial framework.
Orthogonal Wasserstein GANs improve image quality without gradient norm regularization.
problem Wasserstein-GANs' gradient norm regularization limits the distribution's fidelity.
method Substituted gradient norm regularization with orthogonality constraints on weight matrices.
result Orthogonal Wasserstein GANs achieve better image quality and generalization.
New approach stabilizes GANs by leveraging implicit competitive regularization.
problem Stability issues in GAN training due to discriminator's exploitation of generator errors.
method Competitive Gradient Descent (CGD) for opponent-aware modeling of generator and discriminator.
result Significant improvement in GAN training stability without explicit regularization.
Ensemble of GANs improves performance on disconnected data.
problem Disconnected datasets in computer vision cannot be represented by continuous GANs.
method Construct an optimization problem to relate single GAN, ensemble of GANs, conditional GANs, and Gaussian Mixture GANs.
result Ensemble of GANs outperforms single GANs with fewer parameters.
Study extends DRO with IPMs, linking robustness to regularization and GANs.
problem Addressing robustness of deep neural networks to adversarial attacks.
method Distributionally Robust Optimization (DRO) with Integral Probability Metrics (IPMs).
result DRO under any IPM corresponds to a family of regularization penalties.
Generative adversarial networks (GANs) are notoriously difficult to train and the reasons underlying their (non-)convergence behaviors are still not completely understood. By first considering a simple yet representative GAN example, we mathematically analyze its local convergence behavior in a non-asymptotic way. Furt…
Gradient descent on MMD GAN parameter space converges globally to target distribution.
problem Convergence of gradient descent in Maximum Mean Discrepancy (MMD) GANs.
method Proposes a parametric kernelized gradient flow that mimics the min-max game in gradient regularized MMD GAN.
result Gradient descent on the generator's parameter space in gradient regularized MMD GAN is globally convergent to the target distribution under certain conditions.
New control theory approach stabilizes GANs training.
problem Stability issues in GANs training.
method Control theory applied to GANs function space dynamics.
result Effective stabilization of GANs training with CLC and squared L2 regularizer. PresGANs improve GANs by mitigating mode collapse and enhancing log-likelihood.
problem GANs struggle with mode collapse and lack a reliable way to evaluate generalization.
method PresGANs add noise to density networks and use entropy regularization to stabilize training and capture all modes.
result PresGANs reduce the gap in predictive log-likelihood between GANs and VAEs.
Optimal transport relaxations improve Wasserstein GAN training efficiency.
problem Training inefficiency in Wasserstein GANs.
method Optimal transport relaxations with a minimization step over a small region.
result Running time improvements with no performance degradation.
IAGAN method improves medical image reconstruction by incorporating adaptive GAN priors.
problem Reconstructing high-fidelity medical images from incomplete data.
method Image-adaptive GAN-based reconstruction method (IAGAN).
result IAGAN can recover fine structures relevant for medical diagnosis.
A new method for unsupervised disentanglement in GANs.
problem Learning disentangled representations in generative models.
method Regularizing GANs by aligning Jacobian vectors with coordinate axes.
result Unsupervised disentanglement achieved in GANs through spectral regularization.
Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of hyper-parameters. This fragility is in part due to a dimensional mismatch or non-overlapping s…
Paper explores GAN generalization via privacy protection, proving bounds on generalization gap and reducing leakage.
problem Understanding and bounding the generalization gap of GANs.
method Theoretical proof using differential privacy, reinterpreting Bayesian GAN, membership attacks.
result Proven bounds on generalization gap and reduced information leakage.
This work explains GANs as Bayesian neural networks with partial stochasticity.
problem Challenges in optimizing GANs and understanding their limitations.
method Interpreting GANs as Bayesian neural networks with partial stochasticity, establishing conditions, and proposing strategies to smooth the loss landscape and find solutions with minimum description length.
result Proposed strategies lead to performance improvements and deeper understanding of GANs.
Optimized GAN discriminator using polyharmonic interpolation.
problem Optimizing the discriminator in GANs with higher-order gradient regularization.
method Polyharmonic interpolation and variational calculus.
result The optimal discriminator is a polyharmonic radial basis function.
Proposes a method to generate diverse outputs in conditional GANs.
problem Mode-collapse in conditional GANs, where outputs are overly simplified.
method Explicit regularization to produce diverse outputs based on latent codes.
result Demonstrates improved diversity in image-to-image translation, inpainting, and future video prediction tasks.
Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously challenging task and requires a significant number of hyperparameter tuning, neural arc…
Develops a convex duality framework for analyzing GANs.
problem Analyzing how GANs behave under different discriminator constraints.
method Introduces a convex duality framework to interpret GANs under constrained discriminators.
result Shows that the GAN formulation can be interpreted as minimizing a divergence to penalized moments of the data distribution.
Improves disentangled GAN training and selection without labeled data.
problem Challenges in training disentangled GANs, especially self-supervision.
method Contrastive Regularizer and ModelCentrality for unsupervised disentanglement.
result Significantly improved disentanglement scores without labeled data.
This work explains GAN mode collapse and convergence issues via optimal transportation theory.
problem GANs struggle with convergence and mode collapse due to discontinuous optimal transportation mappings.
method The study connects GANs to optimal transportation theory, testing hypotheses about discontinuity and proposing a new method to approximate continuous Brenier potentials.
result The supports of real data distributions are often non-convex, leading to discontinuous optimal transportation mappings and mode collapse in GANs.
Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss function may lead to the vanishing gradients problem during the learning process…
We reinterpreting the variational inference in a new perspective. Via this way, we can easily prove that EM algorithm, VAE, GAN, AAE, ALI(BiGAN) are all special cases of variational inference. The proof also reveals the loss of standard GAN is incomplete and it explains why we need to train GAN cautiously. From that, w…
Kernel-guided training stabilizes GANs by controlling discrepancies.
problem Stability and interpretability issues in GANs.
method Kernel-based regularization to control discrepancies in GAN loss function.
result Theoretical guarantees on stability of the training dynamics.
Self-supervised GAN prevents forgetting in sequential tasks.
problem Discriminator forgetting in GANs leads to training instability.
method Add self-supervision to the discriminator to maintain useful representations.
result Self-supervised GAN outperforms regular GANs in learning better representations.
Improves GANs by enforcing diverse feature learning.
problem GANs can collapse to a single configuration and be unstable.
method Enforces diverse feature learning by penalizing correlated features.
result Enforces diverse features, stabilizes training, and improves image synthesis.
Physics-constrained GANs generate samples that meet deterministic constraints.
problem Ensuring GAN-generated samples comply with physical constraints.
method Enforce deterministic constraints via modified loss function.
result Physics-constrained GANs produce samples that accurately meet underlying constraints.
Generative adversarial network for probabilistic forecasting of random systems.
problem Forecasting random dynamical systems without distributional assumptions.
method Recurrent neural network and generative adversarial network (GAN) with regularization based on maximum mean discrepancy (MMD).
result The proposed model successfully forecasts complex stochastic processes with multiple-step predictions.
We study a simplification of GAN training: the problem of transporting particles from a source to a target distribution. Starting from the Sobolev GAN critic, part of the gradient regularized GAN family, we show a strong relation with Optimal Transport (OT). Specifically with the less popular dynamic formulation of OT …
Despite the growing prominence of generative adversarial networks (GANs), optimization in GANs is still a poorly understood topic. In this paper, we analyze the "gradient descent" form of GAN optimization i.e., the natural setting where we simultaneously take small gradient steps in both generator and discriminator par…
AdvAs improves GAN training by penalizing the generator based on discriminator gradients.
problem Mismatch between theoretical analysis and practice in GAN training.
method AdvAs is a penalty imposed on the generator based on the discriminator's gradient norm.
result AdvAs reduces the mismatch between theory and practice and improves GAN training.
A framework selects GANs for specific applications efficiently.
problem Fragmented knowledge leads to trial-error selection of GANs.
method Comprehensive summary of GANs, comparison, and novel framework.
result Significant reduction in search space for GAN selection.
We propose a novel regularizer to improve the training of Generative Adversarial Networks (GANs). The motivation is that when the discriminator D spreads out its model capacity in the right way, the learning signals given to the generator G are more informative and diverse. These in turn help G to explore better and di…
Generative Adversarial Networks (GANs) have been promising in the field of image generation, however, they have been hard to train for language generation. GANs were originally designed to output differentiable values, so discrete language generation is challenging for them which causes high levels of instability in tr…
Paper proposes LSVGD to stabilize GAN training via Langevin Stein Variational Gradient Descent.
problem Mode collapse and performance deterioration in GAN training.
method Langevin Stein Variational Gradient Descent (LSVGD) incorporating noise to stabilize training.
result LSVGD improves performance and stability of various GAN models.
Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize the distance between the model and the empirical distribution in terms of a dif…
Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions. Unfortunately, minimizing the Wasserstein distance between the data distribution and the gene…