DAWSON adapts GANs for new domains with minimal data.
problem Training GANs for new domains requires vast data and time.
method Meta-learning approach combining GANs and meta-learning algorithms.
result DAWSON can adapt to new domains with just tens of songs.
Diffusion-GAN uses diffusion to improve GAN training stability and realism.
problem Stability and realism issues in training GANs.
method Diffusion-GAN employs a forward diffusion chain to generate Gaussian-mixture distributed instance noise, with adaptive diffusion process and timestep-dependent discriminator.
result Diffusion-GAN produces more realistic images with higher stability and data efficiency.
PrAda-GAN improves synthetic data generation under differential privacy.
problem Generating synthetic data under differential privacy with marginal-based methods.
method Sequential generator architecture integrating GAN and marginal-based approaches, with adaptive regularization of Bayes network structure.
result PrAda-GAN outperforms existing methods in privacy-utility trade-off on synthetic and real-world datasets.
IAGAN method improves medical image reconstruction by incorporating adaptive GAN priors.
problem Reconstructing high-fidelity medical images from incomplete data.
method Image-adaptive GAN-based reconstruction method (IAGAN).
result IAGAN can recover fine structures relevant for medical diagnosis.
Paper analyzes GANs training difficulties and proposes a control framework.
problem Difficulties in training GANs, especially for financial time series.
method Stochastic control framework for hyper-parameters tuning.
result Explicit forms for optimal adaptive learning rate and batch size derived.
Generative adversarial networks benefit from optimal input dimension and adaptive generator architecture.
problem Minimizing generalization error in GANs through optimal input dimension.
method Introducing generalized GANs (G-GANs) with group penalty and architecture penalty for adaptive dimensionality reduction and network architecture identification.
result G-GANs achieve superior performance with 40%+ improvements in maximum mean discrepancy or Frechet inception distance compared to off-the-shelf methods.
CAM-GAN improves GANs for continual learning with efficient feature map transformations.
problem Efficient continual learning for GANs with reduced parameter growth.
method Designing and leveraging parameter-efficient feature map transformations, including global and task-specific parameters, residual bias, and Fisher information matrix.
result Significantly improved model performance and high-quality samples with fewer parameters.
Unified CLIP space manipulations improve GAN adaptation with a single target image.
problem Overfitting or underfitting in fine-tuning a pre-trained generator with a single target image.
method Two-step training strategy: latent optimization in CLIP space followed by generator fine-tuning with CLIP space consistency loss.
result Our model generates diverse outputs with the target texture and outperforms baseline models.
ADAPT method controls balance between sparse generator and discriminator in GANs.
problem High computational complexity in GANs training.
method Balanced Dynamic Sparse Training (ADAPT) method.
result ADAPT method achieves a good trade-off between performance and computational cost.
Researchers compare two GAN models for lip-synchronization tasks.
problem Improving the quality of generated lip-sync videos.
method Reimplemented and trained two GAN models (LipGAN and L1WGAN-GP) on the GRID dataset.
result L1WGAN-GP outperformed LipGAN in generating more realistic lip-sync videos.
Most existing GANs architectures that generate images use transposed convolution or resize-convolution as their upsampling algorithm from lower to higher resolution feature maps in the generator. We argue that this kind of fixed operation is problematic for GANs to model objects that have very different visual appearan…
A recent technical breakthrough in the domain of machine learning is the discovery and the multiple applications of Generative Adversarial Networks (GANs). Those generative models are computationally demanding, as a GAN is composed of two deep neural networks, and because it trains on large datasets. A GAN is generally…
We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss functions raised by recent work: we show that gradient estimators used in the optimizat…
Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this paper, we propose a novel GAN framework called evolutionary generative adversar…
We introduce a new model for building conditional generative models in a semi-supervised setting to conditionally generate data given attributes by adapting the GAN framework. The proposed semi-supervised GAN (SS-GAN) model uses a pair of stacked discriminators to learn the marginal distribution of the data, and the co…
Improves training GANs by escaping limit cycles.
problem Limit cycling behavior in training GANs.
method Predictive Centripetal Acceleration Algorithm (PCAA) combined with Adam.
result PCAA improves convergence rates and effectively trains GANs.
Generative adversarial networks (GANs) generate data based on minimizing a divergence between two distributions. The choice of that divergence is therefore critical. We argue that the divergence must take into account the hypothesis set and the loss function used in a subsequent learning task, where the data generated …
This study analyzes how well GANs approximate distributions from small samples.
problem Understanding how well GANs approximate distributions from limited data.
method Analysis of GANs using integral probability metrics and Hölder classes.
result GANs can adaptively learn low-dimensional structures or Hölder densities.
Generative Adversarial Networks (GAN) training process, in most cases, apply Uniform or Gaussian sampling methods in the latent space, which probably spends most of the computation on examples that can be properly handled and easy to generate. Theoretically, importance sampling speeds up stochastic optimization in supe…
Adaptive framework for learning latent space dimensions in GANs.
problem Inadequate latent space dimensions lead to poor generative models for complex data.
method Proposes a novel framework (LWGAN) that adaptively learns latent dimensions of data manifolds.
result Proves that the estimated intrinsic dimension is a consistent estimate of the true data manifold dimension.
Stabilizes GAN training with limited data.
problem Overfitting in GANs with scarce data.
method Adaptive discriminator augmentation.
result Good results possible with few thousand images.
Generative adversarial networks create synthetic insurance datasets from confidential originals.
problem Difficulty in accessing or sharing confidential insurance datasets for research.
method Design and use of three GAN architectures tailored for multi-categorical insurance data.
result MC-WGAN-GP synthesizes the best data, CTGAN is easiest to use, and MNCDP-GAN ensures differential privacy.
BNCR-GAN improves GANs to generate clean images from degraded inputs.
problem Generating clean images from blurred, noisy, and compressed degraded inputs.
method Multiple-generator model with image, blur-kernel, noise, and quality-factor generators, using masking architectures and adaptive consistency losses.
result BNCR-GAN effectively learns clean image generators from degraded images without degradation parameters.
Generative Adversarial Networks generate PXD background noise efficiently.
problem Efficiently generate statistically independent PXD background noise samples.
method Conditional Generative Adversarial Networks (GANs) with contrastive learning.
result On-demand PXD background generator reduces storage requirements.
RDP-GAN improves GAN privacy by adding random noises to loss function.
problem Protecting sensitive information in GANs while maintaining quality of generated samples.
method Integrates Rényi-differential privacy into GAN training process by adding random noises to loss function.
result Achieves better privacy protection with high-quality samples compared to existing methods.
Generative adversarial networks generate realistic, time-evolving high-resolution atmospheric fields.
problem Improving spatial resolution of low-resolution atmospheric images.
method Recurrent, stochastic super-resolution GAN for generating ensembles of time-evolving high-resolution atmospheric fields.
result The GAN produces realistic, temporally consistent super-resolution sequences for radar-measured precipitation and cloud optical thickness.
While Generative Adversarial Networks (GANs) have seen huge successes in image synthesis tasks, they are notoriously difficult to adapt to different datasets, in part due to instability during training and sensitivity to hyperparameters. One commonly accepted reason for this instability is that gradients passing from t…
We propose a new active learning by query synthesis approach using Generative Adversarial Networks (GAN). Different from regular active learning, the resulting algorithm adaptively synthesizes training instances for querying to increase learning speed. We generate queries according to the uncertainty principle, but our…
New method stabilizes GAN training by solving ODEs.
problem Stability issues in GAN training.
method Solving ordinary differential equations (ODEs) to stabilize GAN training.
result Well-known ODE solvers can stabilize GAN training.
InvGAN combines generative and inference models for photo-realistic image manipulation.
problem GANs lack an inference model for image editing and downstream tasks.
method Train inference and generative models together to adapt and converge.
result InvGAN embeds real images into a high-quality generative model's latent space.
New algorithm solves min-max optimization problems in a decentralized manner.
problem Solving min-max saddle point games in a decentralized and adaptive manner.
method Developed a decentralized adaptive momentum (DADAM3) algorithm for min-max optimization. result DADAM3 achieves non-asymptotic rates of convergence for finding Nash equilibrium points. Unsupervised domain mapping has attracted substantial attention in recent years due to the success of models based on the cycle-consistency assumption. These models map between two domains by fooling a probabilistic discriminator, thereby matching the probability distributions of the real and generated data. Instead of…
In this paper, we propose a novel application of Generative Adversarial Networks (GAN) to the synthesis of cells imaged by fluorescence microscopy. Compared to natural images, cells tend to have a simpler and more geometric global structure that facilitates image generation. However, the correlation between the spatial…
Generative models improve commodity hedging using deep learning.
problem Improving risk management in commodity markets.
method Four state-of-the-art generative models adapted for commodity time series.
result Deep hedging of commodity options trained on generated time series shows promising results.
Market-GAN adds context control to financial market data generation.
problem Lack of context labels and precision in generating context-aligned financial data.
method Proposes Contextual Market Dataset and Market-GAN architecture integrating GAN, autoencoder, and supervisors.
result Market-GAN outperforms state-of-the-art models in Dow Jones data generation.
AdaBelief optimizes deep learning models with faster convergence and better stability.
problem Combining fast convergence and stability in deep learning models.
method Adapts stepsize based on the belief in observed gradients using exponential moving average (EMA) of noisy gradients.
result AdaBelief outperforms other methods in image classification and GAN training, achieving comparable accuracy to SGD on ImageNet.
Enhances model's ability to distinguish target domain by adding a new class.
problem Improving unsupervised domain adaptation models' discriminative power.
method Training model on data from a new class generated by GAN, repositioning current class data.
result Achieves state-of-the-art performance in various unsupervised domain adaptation scenarios.
Study stabilizes adversarial training in neural networks over infinite-dimensional spaces.
problem Stability issues in adversarial training of neural networks.
method Functional analysis of minimax optimization over infinite-dimensional spaces of continuous functions and probability measures.
result Convergence property of minimax problems under certain conditions, interpreted as stabilization techniques.
We propose the Margin Adaptation for Generative Adversarial Networks (MAGANs) algorithm, a novel training procedure for GANs to improve stability and performance by using an adaptive hinge loss function. We estimate the appropriate hinge loss margin with the expected energy of the target distribution, and derive princi…
SwiGAN generates drought scenarios for climate risk management.
problem Natural catastrophes and droughts increase insurance costs.
method Conditional GANs for generating spatio-temporal SWI maps.
result Simulates drought patterns up to 2050 for French regions.
Survey of GANs and autoencoders, addressing mode collapse and likelihood issues.
problem Addressing mode collapse and likelihood issues in GANs and autoencoders.
method Explains various GAN and autoencoder variants, their applications, and methods to resolve issues.
result Various methods to resolve mode collapse and improve likelihood in GANs and autoencoders.
Method synthesizes 4D CMR images from XCAT model using GAN and SPADE.
problem Synthesizing realistic 4D CMR images with annotations and adaptable styles.
method Hybrid GAN approach with XCAT anatomical ground truth and SPADE for semantic preservation.
result Synthesized images with modality-specific features learned from real CMR data.
Adam-type optimizers show one-sided convergence in GAN training, not reaching critical points.
problem Theoretical understanding of Adam-type optimizers in non-convex non-concave min-max optimization.
method Empirical and theoretical analysis of Adam-type algorithms' convergence in GAN training.
result Adam-type algorithms converge to one-sided first order stationary points under the one-sided MVI condition.
New time series generation models improve accuracy and correlation identification.
problem Generating accurate and correlated time series from limited data.
method Conditional Euler Generator (CEGEN) using Euler discretization of SDEs and Wasserstein metrics.
result CEGEN outperforms state-of-the-art models on various metrics and real-world datasets.
Although voice conversion (VC) algorithms have achieved remarkable success along with the development of machine learning, superior performance is still difficult to achieve when using nonparallel data. In this paper, we propose using a cycle-consistent adversarial network (CycleGAN) for nonparallel data-based VC train…
A new GAN model α-GAN with tunable loss function addresses gradient vanishing and mode collapse issues.
problem Addressing vanishing gradients and mode collapse in GANs.
method Introduced a tunable GAN α-GAN using a supervised α-loss function. result Holistic understanding of α-GAN related to Arimoto divergence and convergence properties. Unbalanced GANs stabilize GAN training by pre-training the generator with VAE.
problem Stable training of GANs to avoid mode collapses and improve image quality.
method Pre-train GAN generator with VAE, balance generator and discriminator training, prevent discriminator's early convergence.
result Unbalanced GANs reduce mode collapses and outperform ordinary GANs in stability, convergence, and image quality.
GANs can approximate SDEs for large time steps.
problem Approximating SDEs for large time steps using GANs.
method Proposed a conditional GAN architecture to enable strong approximation of SDEs.
result Supervised GAN outperformed standard GAN and other schemes in strong error.