FID misaligns with human judgment due to reliance on ImageNet classes.
problem FID metric's reliance on ImageNet classes causes discrepancies with human evaluation.
method Investigated and visualized the feature space of FID and its relation to ImageNet classes.
result Aligning histograms of Top-N ImageNet classifications can reduce FID without improving quality. FastFID efficiently trains generative models with FID loss.
problem Efficiently training generative models with FID loss.
method Introduces FastFID to train generative models with FID as a loss function.
result Improves FID for GANs using FID as an additional loss.
New metrics improve reliability of image generation evaluation.
problem Lack of reliable metrics for evaluating fidelity and diversity in generative models.
method Proposed density and coverage metrics to diagnose fidelity and diversity separately.
result Density and coverage metrics provide more interpretable and reliable signals.
Paper presents a new algorithm to approximate Wasserstein-2 barycenters without bias.
problem Approximating Wasserstein-2 barycenters of continuous measures.
method Generative model approach using arbitrary neural networks.
result The method does not introduce bias and is applicable to large-scale tasks.
Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well with the perceived quality of samples and are sensitive to mode dropping. However,…
Unified and extended precision-recall metrics for generative models.
problem Evaluation of generative models using scalar metrics like FID and IS.
method Unified various precision-recall approaches under a common framework.
result Recovered entire precision-recall curves and exposed metric pitfalls.
TVM improves generative modeling by matching terminal velocities.
problem Creating high-fidelity one- and few-step generative models.
method TVM generalizes flow matching, modeling transitions between diffusion timesteps and regularizing terminal behavior.
result TVM achieves state-of-the-art FID scores with minimal architectural changes and fused attention kernel.
Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii) monitoring the progress of a single model throughout training. The latter cannot be…
Enhances GANs by improving consistency regularization.
problem Improving the artifacts introduced by consistency regularization in GANs.
method Proposed modifications to consistency regularization to fix artifacts and improve performance.
result Significant improvement in FID scores on various GAN architectures.
The new wave of successful generative models in machine learning has increased the interest in deep learning driven de novo drug design. However, assessing the performance of such generative models is notoriously difficult. Metrics that are typically used to assess the performance of such generative models are the perc…
We simplify diffusion models by defining a design space and improving FID scores.
problem Complexity in diffusion-based generative models.
method Defined a design space, improved sampling and training processes, and pre-conditioned score networks.
result Improved FID scores of 1.79 for CIFAR-10 and 1.97 for unconditional settings.
Recent work (Pennington et al, 2017) suggests that controlling the entire distribution of Jacobian singular values is an important design consideration in deep learning. Motivated by this, we study the distribution of singular values of the Jacobian of the generator in Generative Adversarial Networks (GANs). We find th…
Researchers compare two GAN models for lip-synchronization tasks.
problem Improving the quality of generated lip-sync videos.
method Reimplemented and trained two GAN models (LipGAN and L1WGAN-GP) on the GRID dataset.
result L1WGAN-GP outperformed LipGAN in generating more realistic lip-sync videos.
A new metric FRD improves comparing medical images.
problem Comparing medical images for distribution or domain differences.
method Developed a new metric FRD using standardized radiomic features.
result FRD outperforms other metrics in various medical imaging applications.
Unified framework for human motion generation on Riemannian manifolds.
problem Learning valid human motion in Euclidean spaces.
method Riemannian Motion Generation (RMG) on product manifolds, Riemannian flow matching.
result Achieves state-of-the-art FID (0.043) on HumanML3D and surpasses strong baselines on MotionMillion.
SiD distills pretrained diffusion models into a fast one-step generator.
problem Efficiently distilling pretrained diffusion models into a fast generator.
method Reformulates forward diffusion processes as semi-implicit distributions and uses three score-related identities to create a loss mechanism.
result Achieves high FID performance and significantly reduces generation time.
Nuclear magnetic resonance (NMR) spectroscopy exploits the magnetic properties of atomic nuclei to discover the structure, reaction state and chemical environment of molecules. We propose a probabilistic generative model and inference procedures for NMR spectroscopy. Specifically, we use a weighted sum of trigonometric…
SciRE-Solver accelerates DMs sampling by recursively calculating the score function derivative.
problem Slow iterative process of diffusion models due to estimating the score function derivative.
method Recursive Difference (RD) method combined with truncated Taylor expansion of score-integrand.
result SciRE-Solver achieves state-of-the-art FIDs with significantly fewer score function evaluations.
This work addresses unstable MeanFlow training by optimizing a coefficient in the loss function.
problem Unstable training of MeanFlow models with non-decreasing loss and unbounded gradient variance.
method Established a theory attributing the instability to misuse of the conditional velocity field, derived the optimal coefficient, and showed practical realizations.
result Optimal coefficient yields up to 54% improvement in sample quality and monotone FID trend.
Deep generative models (DGMs) of images are now sufficiently mature that they produce nearly photorealistic samples and obtain scores similar to the data distribution on heuristics such as Frechet Inception Distance (FID). These results, especially on large-scale datasets such as ImageNet, suggest that DGMs are learnin…
A new method uses higher-order Langevin dynamics with critical damping for better generative modeling.
problem Improving generative models using Langevin dynamics with auxiliary variables.
method Introducing higher-order Langevin dynamics with critical damping, providing closed-form solutions.
result Improved generative models with better performance as measured by FID metric.
Improved GAN performance with a novel local attention mechanism.
problem Enhancing the performance of Generative Adversarial Networks (GANs).
method Introducing a two-dimensional local attention mechanism that preserves geometry and locality, and using information flow graphs for design.
result Significant improvements in FID and Inception scores, from 18.65 to 15.94 on ImageNet.
Diffusion models outperform GANs in image synthesis quality.
problem Improving image synthesis quality using generative models.
method Developed and optimized diffusion models, and introduced classifier guidance for conditional synthesis.
result Achieved superior image synthesis quality with diffusion models, matching or exceeding GANs in FID scores.
Improved continuous-time consistency models for large-scale image generation.
problem Training instability and discretization errors in existing diffusion models.
method Unified theoretical framework, improved diffusion process, and network architecture.
result Trained continuous-time CMs at 1.5B parameters, achieving state-of-the-art FID scores.
Efficiently distills pretrained text-to-image models without real data, improving FID and CLIP scores.
problem Slow iterative refinement process of diffusion-based text-to-image models.
method Guided Score identity Distillation with Long and Short Classifier-Free Guidance.
result Achieves state-of-the-art FID performance with competitive CLIP score.
We introduce autoregressive implicit quantile networks (AIQN), a fundamentally different approach to generative modeling than those commonly used, that implicitly captures the distribution using quantile regression. AIQN is able to achieve superior perceptual quality and improvements in evaluation metrics, without incu…
Paper proposes evaluation methods for climate change illustrations.
problem Lack of metrics to compare realism in conditional generative models.
method Adapted and assessed several existing metrics, including FID.
result FID with Inception-V3 embeddings correlates best with human realism.
Discriminator optimizes to approximate optimal transport for better image generation.
problem Improving the quality of generated images using GANs.
method Trains discriminator to optimize a lower bound of Wasserstein distance, approximating optimal transport.
result Trained discriminator improves inception score and FID metrics.
Improved image generation quality using closed-form discriminator guidance in diffusion models.
problem Enhancing the quality of images generated by diffusion models.
method Theoretical framework to analyze GAN discriminator's effect on Langevin sampling, proposing IPM-GAN optimization as smoothed score-matching.
result Closed-form kernel-based discriminator guidance improves metrics like CLIP-FID and KID.
Improved image compression with diffusion models outperforming state-of-the-art methods.
problem Difficulties in replicating text-to-image success in image compression.
method Two-stage approach combining autoencoder targeting MSE followed by score-based decoder.
result Significantly improved perceptual quality at a given bit-rate, measured by FID score.
ECS evaluates synthetic CXR images' distributional fidelity.
problem Evaluating synthetic CXR images' distributional fidelity under privacy constraints.
method Characteristic function transforms of feature embeddings.
result ECS uncovers clinically relevant distributional discrepancies.
Wavelets improve VAE image quality.
problem VAEs produce blurry images due to lack of high-frequency detail emphasis.
method Wavelet space VAE that emphasizes high-frequency components.
result Wavelet-based VAE generates higher quality images.
High-quality image synthesis with diffusion models, achieving state-of-the-art FID score.
problem Generating high-quality images from latent variables.
method Training diffusion probabilistic models with a weighted variational bound, inspired by denoising score matching and Langevin dynamics.
result State-of-the-art FID score of 3.17 on CIFAR10 dataset.
CTM improves diffusion model sampling quality with efficient ODE traversal.
problem Lack of natural trade-off between sample quality and speed in consistency models.
method CTM trains a neural network to output scores and traverse ODE trajectories efficiently.
result CTM achieves state-of-the-art FIDs and improves sample quality with increased computational budget.
W-Flow generates images in one step, faster and better than multi-step methods.
problem Efficiently generating images from a simple reference distribution to a target data distribution.
method W-Flow uses Wasserstein gradient flows to transform the reference distribution to the target distribution in a single step, trained with Sinkhorn divergence.
result W-Flow achieves state-of-the-art results in ImageNet 256imes256 generation with improved mode coverage and faster sampling. LOGAN optimizes GAN training by improving adversarial dynamics.
problem Training GANs is challenging due to delicate adversarial dynamics and potential divergence.
method Integrates natural gradient-based latent optimisation into CS-GAN.
result Significant improvement in GAN training performance, achieving state-of-the-art results.
Enhances VAEs for sharper image synthesis.
problem Blurriness in generated images from VAEs.
method Integrates a downscaled version of the original image into the VAE framework and uses it as input to the decoder.
result Improves FID score in image synthesis while maintaining similar log-likelihood performance.
Despite recent progress in generative image modeling, successfully generating high-resolution, diverse samples from complex datasets such as ImageNet remains an elusive goal. To this end, we train Generative Adversarial Networks at the largest scale yet attempted, and study the instabilities specific to such scale. We …
The paper interprets diffusion models as gradient descent and proposes a new sampler.
problem Improving the efficiency and quality of diffusion models.
method Interprets diffusion models as gradient descent and proposes a new sampler.
result The new sampler achieves state-of-the-art FID scores and generates high quality samples.
IMM generates high-quality samples in few steps with stable training.
problem Slow inference and instability in generating high-quality samples using diffusion models and Flow Matching.
method Inductive Moment Matching (IMM) is a new generative model for one- or few-step sampling with a single-stage training procedure.
result IMM achieves state-of-the-art 2-step FID of 1.98 on CIFAR-10 for a model trained from scratch.
Bayesian Power Steering fine-tunes large diffusion models for domain adaptation.
problem Fine-tuning pre-trained diffusion models for tasks in a smaller probability space.
method Bayesian framework with a novel network structure (Bayesian Power Steering).
result Bayesian Power Steering achieves an FID score of 10.49 on the COCO17 dataset.
Generative adversarial networks fix aliasing issues by making signals continuous.
problem Alias-free generation in GANs to prevent unwanted information leakage.
method Interpreting all signals as continuous, deriving small architectural changes.
result Generative models match FID of StyleGAN2 but have better internal representations.
Hyperbolic GANs improve image generation metrics.
problem Improving image generation quality in neural networks.
method Integrating hyperbolic layers into GAN architectures.
result Hyperbolic GANs achieve better metrics than Euclidean counterparts.
Improves diversity of text-to-image models without sacrificing FID.
problem Lack of diversity and tendency to recreate training set images.
method Adds sparse repellency terms to diffusion SDE to guide trajectories away from a reference set.
result Improves diversity of diffusion models with minimal impact on FID.
Proposes using continuum percolation to analyze data manifolds and improve generative models.
problem Disentangling geometric support from probability distributions in high-dimensional data.
method Establishes a correspondence between topological phase transitions of random geometric graphs and data manifolds, using Percolation Shift metric.
result Demonstrates that Percolation Shift metric captures structural pathologies like mode collapse and guides training to prevent manifold shrinkage and improve fidelity.
Improves image quality in generative models by estimating pixel-wise aleatoric uncertainty.
problem Lack of quantitative assessment of image quality in diffusion models.
method Estimate pixel-wise aleatoric uncertainty during sampling phase using a perturbation scheme designed for diffusion models.
result Uncertainty-guided sampling leads to better sample generation quality as shown by FID scores.
This paper uses diffusion models for lossy image compression, improving perceptual metrics and practicality.
problem Lossy image compression with improved perceptual metrics and practicality.
method End-to-end optimized lossy image compression using conditional diffusion models.
result The model yields stronger FID scores and competitive performance in distortion metrics.
Jeffrey guidance extends diffusion-model control to more complex applications.
problem Controlling diffusion models beyond simple cases like conditional sampling.
method Leveraging Jeffrey's rule of conditioning to update marginal distributions towards a target distribution.
result Significant reductions in FID on CIFAR-10 and FFHQ with Inception embeddings as the target.