The recent success of Generative Adversarial Networks (GAN) is a result of their ability to generate high quality images from a latent vector space. An important application is the generation of images from a text description, where the text description is encoded and further used in the conditioning of the generated i…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Conditional Image Generation”
Framework generates realistic crop images for growth modeling.
problem Modeling crop growth over time with precision and detail.
method Two-stage framework: image prediction and growth estimation models.
result Framework accurately predicts crop images with varying conditions.
LcGAN generates synthetic CT images for hemorrhagic lesion segmentation.
problem Scarce training data for hemorrhagic lesion segmentation.
method Lesion conditional Generative Adversarial Network (LcGAN) for synthetic image generation.
result Segmentation improved by 12.8% with synthetic data augmentation.
Plug-and-play multimodal controller improves class-conditional image generation.
problem Generating class-conditional images from user-specified labels.
method Introduces a `multimodal controller` to generate multimodal data without additional learning parameters.
result Multimodal controlled generative models produce higher quality class-conditional images and novel modalities.
We are interested in attribute-guided face generation: given a low-res face input image, an attribute vector that can be extracted from a high-res image (attribute image), our new method generates a high-res face image for the low-res input that satisfies the given attributes. To address this problem, we condition the …
Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with the reconstruction loss. However, we reveal that this training recipe shared by …
Generative model generates images with multiple object classes.
problem Generating images with multiple object classes.
method Conditional Deep Convolutional GAN architecture, stabilized against collapse.
result System generates diverse samples with inter-object relationships.
Image captioning has demonstrated models that are capable of generating plausible text given input images or videos. Further, recent work in image generation has shown significant improvements in image quality when text is used as a prior. Our work ties these concepts together by creating an architecture that can enabl…
Generative model extracts road networks from images.
problem Extracting road networks from image data.
method Developed Generative Graph Transformer (GGT) for image-conditioned graph generation.
result Demonstrated effective road network generation from semantic segmentation data.
SNS-GAN integrates class labels into generative models for images and time series.
problem Effective integration of class labels in generative models without network modifications.
method Embeds class conditions within the generator's noise space.
result Superior performance in time series generation compared to baseline models.
Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given descriptions, but they fail to contain necessary details and vivid object parts. In…
Understanding the Intrinsic Robustness of Image Distributions using Conditional Generative Modelscs.LG
This work proves intrinsic robustness bounds for natural image distributions.
problem Understanding the robustness of natural image distributions against adversarial attacks.
method Assumes natural image distributions are captured by conditional generative models and proves robustness bounds for classifiers.
result Shows a large gap between theoretical robustness limits and current state-of-the-art adversarial robustness.
Conditional domain generation is a good way to interactively control sample generation process of deep generative models. However, once a conditional generative model has been created, it is often expensive to allow it to adapt to new conditional controls, especially the network structure is relatively deep. We propose…
YuruGAN generates yuru-chara images using GANs and clustering for small datasets.
problem Generating high-quality yuru-chara images with limited data.
method Class conditional GAN with clustering and data augmentation.
result Improved quality of generated yuru-chara images through clustering and data augmentation.
DiffDenoise preserves fine structures in medical images using conditional diffusion models.
problem Medical image denoising often results in loss of fine structures.
method Conditional diffusion model with stabilized reverse sampling and supervised training.
result DiffDenoise outperforms state-of-the-art methods in medical image denoising.
HW2MP-GAN tackles ancient handwritten text recognition.
problem Automatic text recognition from ancient handwritten records.
method Conditional Generative Adversarial Network (HW2MP-GAN) with Sliced Wasserstein distance and U-Net architectures.
result HW2MP-GAN outperforms state-of-the-art models in image-to-image translation and handwritten recognition.
We propose Progressive Structure-conditional Generative Adversarial Networks (PSGAN), a new framework that can generate full-body and high-resolution character images based on structural information. Recent progress in generative adversarial networks with progressive training has made it possible to generate high-resol…
Generative model creates realistic scenes from pixel-wise labels.
problem Creating photo-realistic scenes from pixel-wise labels.
method Semantic bottleneck GAN model combining conditional and unconditional generation networks.
result Model outperforms state-of-the-art models in unsupervised image synthesis.
A method to improve image synthesis diversity using mutual information.
problem Mode collapse in conditional GANs for multimodal image synthesis.
method Explicitly estimate and maximize mutual information between latent code and output image.
result Prevents mode collapse and encourages synthesis of diverse images.
We present a conditional generative model to learn variation in cell and nuclear morphology and the location of subcellular structures from microscopy images. Our model generalizes to a wide range of subcellular localization and allows for a probabilistic interpretation of cell and nuclear morphology and structure loca…
Paper proposes method to generate images from text using GANs trained on uncaptioned images.
problem Limited captioned image datasets for text-to-image synthesis.
method Conditional GANs trained on uncaptioned images with an Image Captioning Module.
result Promising preliminary results compared to unconditional GANs.
A new model improves medical image segmentation uncertainty.
problem Uncertainty in medical image segmentation.
method Conditional Normalizing Flow (cFlow) for improved segmentation uncertainty.
result Improved quality and diversity of segmentation samples.
New method for generating images with conditional probability models.
problem Generating images with specific conditions.
method Score-based diffusion models with theoretical analysis and new estimator.
result New estimator for conditional score performs similarly to state-of-the-art.
CSI method learns conditional distributions by estimating flow equations.
problem Learning conditional distributions in generative models.
method Estimates probability flow equations to transport reference to target distribution.
result Derives explicit expressions for conditional drift and score functions.
CAFLOW uses auto-regressive flows to translate images efficiently.
problem Image-to-image translation tasks.
method Transforms conditioning image into latent encodings using normalizing flows, models conditional distribution with auto-regressive distributions.
result Outperforms former conditional flow designs.
Efficient Subsampling of Realistic Images From GANs Conditional on a Class or a Continuous Variablecs.CV
This work introduces an efficient method to sample high-quality images from conditional GANs.
problem Efficient subsampling of images from conditional GANs (cGANs) is challenging.
method Developed a novel conditional density ratio estimation method (cDRE-F-cSP) and rejection sampling scheme (cDR-RS).
result cDR-RS outperforms state-of-the-art methods in both effectiveness and efficiency.
In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual descriptions of its ingredients. Previous works on synthesis of images from text typically rely on pre-trained text models to extract text features, followed by a genera…
We propose a novel, projection based way to incorporate the conditional information into the discriminator of GANs that respects the role of the conditional information in the underlining probabilistic model. This approach is in contrast with most frameworks of conditional GANs used in application today, which use the …
CcGAN tackles conditional image generation for continuous labels.
problem Mathematical challenges in conditioning on continuous, scalar labels.
method Proposes novel empirical losses and label input methods for continuous conditional GANs.
result CcGAN generates diverse, high-quality images from continuous labels.
Unsupervised image inpainting models generate plausible reconstructions from incomplete data.
problem Inpainting without paired or unpaired training data.
method Conditional GAN with latent component dependency for generating image distributions.
result Model generates a distribution of plausible images from incomplete observations.
Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We construct a variant of GANs employing label conditioning that results in 128x128 r…
We propose a simple yet highly effective method that addresses the mode-collapse problem in the Conditional Generative Adversarial Network (cGAN). Although conditional distributions are multi-modal (i.e., having many modes) in practice, most cGAN approaches tend to learn an overly simplified distribution where an input…
Unified framework for classification and image generation.
problem Limited supervision in classification and image generation.
method Triple Generative Adversarial Network (Triple-GAN) as a three-player minimax game.
result Unique equilibrium converges to data distribution, achieving excellent classification and generation results.
Unified method for multi-defect microscopy image restoration with limited training data.
problem Challenges in applying deep learning methods due to limited training data for multi-defect microscopy images.
method Two-stage approach: data augmentation with GAN and conditional GAN training.
result Proposed method gives comparable or superior results to existing methods in image quality restoration.
The paper generates future brain imaging sequences for Alzheimer's disease detection.
problem Understanding brain aging and neurodegenerative diseases through sequential image data.
method Formulated a min-max problem based on -divergence to learn a time series generator using a deep neural network.
result Generated image sequences converge to the latent truth under specific conditions, enhancing downstream tasks like Alzheimer's disease detection.
We introduce MosAIc, an interactive web app that allows users to find pairs of semantically related artworks that span different cultures, media, and millennia. To create this application, we introduce Conditional Image Retrieval (CIR) which combines visual similarity search with user supplied filters or "conditions". …
Generates realistic faces from detailed textual descriptions.
problem Face generation from fine-grained textual descriptions.
method Conditional GAN model with DC-GAN and GAN-CLS loss, using CelebA dataset with generated captions.
result Promising results in generating diverse face images from fine-grained textual descriptions.
Generates samples conditioned on labels using optimal transport.
problem Estimating conditional distributions for specific labels.
method Wasserstein geodesic generator based on optimal transport theory.
result Learned conditional distributions and optimal transport maps.
A new method learns continuous guidance weights to improve diffusion model quality and distributional alignment.
problem Improving perceptual quality and distributional alignment of samples from conditional diffusion models.
method Learned continuous guidance weights are used to minimize distributional mismatch and reward guided sampling.
result Improvements in Fréchet inception distance (FID) for image generation and better image-prompt alignment in text-to-image applications.
The Hilbert map's image is discussed, showing when it's surjective.
problem Understanding when the Hilbert map is surjective.
method Analyzing the Hilbert map's properties to determine surjectivity.
result Necessary and sufficient conditions for the Hilbert map to be surjective.
ISB learns nonlinear diffusion processes between images.
problem Image restoration tasks, especially with limited structural information.
method Conditional diffusion models, Schrödinger bridge approach.
result ISB outperforms standard models in various image restoration tasks.
The GANs are generative models whose random samples realistically reflect natural images. It also can generate samples with specific attributes by concatenating a condition vector into the input, yet research on this field is not well studied. We propose novel methods of conditioning generative adversarial networks (GA…
Few-Shot Diffusion Models generate new samples from small image sets.
problem Generating new samples from a few images.
method Conditional Denoising Diffusion Probabilistic Models (DDPM) with patch-based input set information.
result FSDM can generate samples from previously unseen classes conditioned on as few as 5 samples.
Autoregressive generative models of images tend to be biased towards capturing local structure, and as a result they often produce samples which are lacking in terms of large-scale coherence. To address this, we propose two methods to learn discrete representations of images which abstract away local detail. We show th…
AugurOne trains single image generators without GANs using image warps.
problem Training end-to-end single image generators without GANs.
method Non-affine augmentations of single input images for training an upscaling neural network.
result End-to-end training yields state-of-the-art performance on conditional generation tasks.
Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Conditional Learningstat.ML
This paper studies the problem of learning the conditional distribution of a high-dimensional output given an input, where the output and input may belong to two different domains, e.g., the output is a photo image and the input is a sketch image. We solve this problem by cooperative training of a fast thinking initial…
AR-CSM models use derivatives of univariate log-conditionals to estimate joint distributions efficiently.
problem Scalability and stability issues in training autoregressive models.
method Parameterize joint distribution using derivatives of univariate log-conditionals and introduce Composite Score Matching (CSM) for efficient training.
result AR-CSM models are more scalable and stable compared to previous score matching algorithms.
A smaller, less-trained model guides image generation, improving quality without sacrificing variation.
problem Improving image quality and variation in diffusion models without compromising one for the other.
method Guiding a conditional model with a smaller, less-trained version of the same model.
result Significant improvements in ImageNet generation, setting record FIDs.