Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

1122 · Jan 202019922001200920172026
19 results for BigGANs

Cost-effective method improves and re-purposes pre-trained GANs by fine-tuning class-embeddings.

problem Fine-tuning BigGANs from scratch is impractical due to instability and high computational cost.
method Fine-tuning only the class-embedding layer of pre-trained GANs.
result Significantly improved realism and diversity of samples, re-purposed for new tasks, and de-biased or improved diversity.

A cost-effective method to generate high-resolution images using wavelet-based super-resolution.

problem High compute resources required for training state-of-the-art image generation models.
method Wavelet-based two-step training framework: low-frequency sampling followed by super-resolution.
result Achieves FID of 10.59 on ImageNet 512x512 with half the compute of BigGAN.

Improves GANs by sampling from an energy-based model induced by discriminator scores.

problem Improving the quality of images generated by GANs.
method DDLS (Discriminator Driven Latent Sampling) using the sum of latent prior log-density and discriminator output score.
result Significantly improves Inception Score on CIFAR-10 dataset.

Perturbative GAN, which replaces convolution layers of existing convolutional GANs (DCGAN, WGAN-GP, BIGGAN, etc.) with perturbation layers that adds a fixed noise mask, is proposed. Compared with the convolu-tional GANs, the number of parameters to be trained is smaller, the convergence of training is faster, the incep…

2019-02-05abs ↗pdf ↗

Adversarially trained generative models (GANs) have recently achieved compelling image synthesis results. But despite early successes in using GANs for unsupervised representation learning, they have since been superseded by approaches based on self-supervision. In this work we show that progress in image generation qu…

2019-07-04abs ↗pdf ↗

Deep generative models are becoming a cornerstone of modern machine learning. Recent work on conditional generative adversarial networks has shown that learning complex, high-dimensional distributions over natural images is within reach. While the latest models are able to generate high-fidelity, diverse natural images…

2019-03-06abs ↗pdf ↗

Despite recent progress in generative image modeling, successfully generating high-resolution, diverse samples from complex datasets such as ImageNet remains an elusive goal. To this end, we train Generative Adversarial Networks at the largest scale yet attempted, and study the instabilities specific to such scale. We …

2018-09-28abs ↗pdf ↗

The ability to automatically estimate the quality and coverage of the samples produced by a generative model is a vital requirement for driving algorithm research. We present an evaluation metric that can separately and reliably measure both of these aspects in image generation tasks by forming explicit, non-parametric…

2019-04-15abs ↗pdf ↗

Deep learning representations of GAN data are like Gaussian mixtures, according to this study.

problem Understanding the statistical nature of deep learning representations of GAN-generated data.
method Using Random Matrix Theory, the study shows that DL representations of GAN data are concentrated random vectors that behave like Gaussian mixtures.
result Deep learning representations of GAN data can be fully described by their first two statistical moments.

Deep generative models (DGMs) of images are now sufficiently mature that they produce nearly photorealistic samples and obtain scores similar to the data distribution on heuristics such as Frechet Inception Distance (FID). These results, especially on large-scale datasets such as ImageNet, suggest that DGMs are learnin…

2019-05-26abs ↗pdf ↗