Soft Truncation improves diffusion model performance by balancing loss scales across diffusion times.
problem Inverse correlation between density estimation and sample generation in diffusion models.
method Introduces Soft Truncation, a training technique that softens the truncation hyperparameter.
result Soft Truncation achieves state-of-the-art performance on various datasets.
NVAE improves VAE performance on large image datasets.
problem Improving variational autoencoder performance for large image datasets.
method Deep hierarchical VAE with depth-wise separable convolutions and batch normalization, residual parameterization of Normal distributions, and spectral regularization.
result NVAE achieves state-of-the-art results on MNIST, CIFAR-10, CelebA 64, and CelebA HQ datasets.
LSGM trains SGMs in latent space for faster sampling.
problem Efficiently generating high-quality samples from complex distributions.
method LSGM trains SGMs in latent space using a variational autoencoder framework, introducing new score-matching objectives and parameterizations.
result LSGM achieves state-of-the-art FID score of 2.10 on CIFAR-10 and outperforms previous SGMs in sampling time.
We describe a simple, low-level approach for embedding probabilistic programming in a deep learning ecosystem. In particular, we distill probabilistic programming down to a single abstraction---the random variable. Our lightweight implementation in TensorFlow enables numerous applications: a model-parallel variational …
We propose a novel procedure which adds "content-addressability" to any given unconditional implicit model e.g., a generative adversarial network (GAN). The procedure allows users to control the generative process by specifying a set (arbitrary size) of desired examples based on which similar samples are generated from…
A training-free method for conditional sampling using flow matching.
problem Weight degeneracy in high-dimensional importance sampling.
method Sequential Monte Carlo with resampling and stochastic flow.
result Significantly outperforms existing methods on MNIST and CIFAR-10.
Proposes a new method to generate unrestricted adversarial examples.
problem Generating unrestricted adversarial examples without norm constraints.
method Leveraging state-of-the-art generative models to manipulate image fine-grained aspects.
result Our adversarial images look indistinguishable from natural images and can bypass certified defenses.
Jeffrey guidance extends diffusion-model control to more complex applications.
problem Controlling diffusion models beyond simple cases like conditional sampling.
method Leveraging Jeffrey's rule of conditioning to update marginal distributions towards a target distribution.
result Significant reductions in FID on CIFAR-10 and FFHQ with Inception embeddings as the target.
NDMs enable non-linear transformations in diffusion models for better generative tasks.
problem Limited to linear transformations, diffusion models struggle with generative tasks.
method Presented NDMs that allow time-dependent non-linear transformations.
result NDMs outperform conventional diffusion models in likelihood and sample quality.
Normalizing flows optimize Jacobian determinant for unique likelihood objective.
problem Optimizing normalizing flows for unique likelihood.
method Showed Jacobian determinant is unique for given distributions, leading to a unique global optimum. Used eigenvalues of auto-correlation matrix for explicit likelihood expression.
result Explicit expression of likelihood for flows, independent of neural network parameterization, with theoretical optimal value.
WS diffusion models handle anisotropic Gaussian noise better than conventional methods.
problem Handling anisotropic Gaussian noise in imaging inverse problems.
method Whitened Score (WS) diffusion models based on stochastic differential equations.
result WS DMs outperform conventional DMs on anisotropic Gaussian noise.
Improves GAN performance without changing network architecture.
problem Discriminator fails to guide generator effectively.
method Cascading Rejection (CR) module for discriminator.
result Significantly improves GAN performance in terms of FID.
New methods create counterfactuals for image regression models.
problem Creating interpretable explanations for regression models in images.
method Two methods using diffusion-based generative models to create counterfactuals.
result Diffusion-based methods produce realistic, semantic, and smooth counterfactuals.
Improved VAEs by training a contrastive prior to match posterior.
problem Prior hole problem in VAEs, leading to poor image generation.
method Introduced a contrastive energy-based prior and trained it using noise contrastive estimation.
result Significant improvement in VAE generative performance on various datasets.
Generative model uses random weighted support points for interpretable data sampling.
problem Creating diverse and interpretable sample sets from large datasets efficiently.
method Random weighted support points from Dirichlet process and Bayesian bootstrap.
result High-quality and diverse outputs at lower computational cost.
Proposes efficient deep causal generative models for high-dimensional causal inference.
problem Inefficient training of deep generative models for high-dimensional data.
method Modular training of deep causal generative models using adversarial training and pre-trained models.
result First algorithm that provably samples from any identifiable causal query in the presence of latent confounders.
A new method uses higher-order Langevin dynamics with critical damping for better generative modeling.
problem Improving generative models using Langevin dynamics with auxiliary variables.
method Introducing higher-order Langevin dynamics with critical damping, providing closed-form solutions.
result Improved generative models with better performance as measured by FID metric.
CCVFM uses coreset to improve generative models by refining residual flows.
problem Generating multimodal distributions from scratch is challenging.
method Augments hierarchical rectified flow with a data-informed source distribution using a coreset.
result CCVFM achieves competitive few-step generation without a learned noise-to-data map.
Generative adversarial network synthesizes sketches into realistic images.
problem Improving the quality and realism of facial sketches.
method Hybrid GAN with quality guided encoder and identity preserving network.
result Synthesized images are more realistic and maintain identity.