Pseudo rehearsal uses non-photo-realistic images to save resources without sacrificing performance.
problem Catastrophic forgetting in neural networks when learning new tasks.
method Synthetically generate non-photo-realistic images to rehearse previous tasks.
result Non-photo-realistic images can be used for rehearsal without sacrificing performance and significantly reduce resource consumption.
VALAN is a framework for navigation agents in photo-realistic environments.
problem Developing agents for indoor navigation tasks.
method Deep reinforcement learning with SEED RL architecture.
result VALAN framework can solve a variety of RL problems.
Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given descriptions, but they fail to contain necessary details and vivid object parts. In…
Paper proposes using synthetic data to improve face recognition accuracy.
problem Improving face recognition accuracy using real data alone.
method Proposes a GAN that disentangles identity attributes and generates photo-realistic synthetic images.
result Synthetic images generated by the model are photo-realistic and can increase face recognition accuracy.
Despite the breakthroughs in accuracy and speed of single image super-resolution using faster and deeper convolutional neural networks, one central problem remains largely unsolved: how do we recover the finer texture details when we super-resolve at large upscaling factors? The behavior of optimization-based super-res…
Although Generative Adversarial Networks (GANs) have shown remarkable success in various tasks, they still face challenges in generating high quality images. In this paper, we propose Stacked Generative Adversarial Networks (StackGAN) aiming at generating high-resolution photo-realistic images. First, we propose a two-…
InvGAN combines generative and inference models for photo-realistic image manipulation.
problem GANs lack an inference model for image editing and downstream tasks.
method Train inference and generative models together to adapt and converge.
result InvGAN embeds real images into a high-quality generative model's latent space.
We present a conditional generative model to learn variation in cell and nuclear morphology and the location of subcellular structures from microscopy images. Our model generalizes to a wide range of subcellular localization and allows for a probabilistic interpretation of cell and nuclear morphology and structure loca…
Deep learning detects face swapping with high accuracy and uncertainty.
problem Photo-realistic face swapping without consent.
method Deep transfer learning for face swapping detection, human subject rankings for comparison.
result True positive rates >96% with minimal false alarms, uncertainty provided for each prediction.
Recent advances in deep learning-based object detection techniques have revolutionized their applicability in several fields. However, since these methods rely on unwieldy and large amounts of data, a common practice is to download models pre-trained on standard datasets and fine-tune them for specific application doma…
This paper introduces a novel approach to in-painting where the identity of the object to remove or change is preserved and accounted for at inference time: Exemplar GANs (ExGANs). ExGANs are a type of conditional GAN that utilize exemplar information to produce high-quality, personalized in painting results. We propos…
Improves GAN sample quality by refining the training dataset.
problem GANs generate unrealistic samples outside the data manifold.
method Instance selection to improve sample quality and reduce training time.
result Significantly reduces training time and improves sample fidelity.
Modern computer vision algorithms typically require expensive data acquisition and accurate manual labeling. In this work, we instead leverage the recent progress in computer graphics to generate fully labeled, dynamic, and photo-realistic proxy virtual worlds. We propose an efficient real-to-virtual world cloning meth…
Aims to learn from multiple unpredictable teachers with minimal interaction.
problem Learning from multiple non-deterministic teachers with low interaction cost.
method Develops a framework and an active learning algorithm to estimate a distribution over policy space.
result Significantly reduces interaction with teachers without compromising performance.
Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by \cite{arjovsky2017towards}, who also propose an alternative direction to avoid the caveats in the minmax two-player training of GANs. The corres…
FAMOS combines parametric and non-parametric methods for efficient image stylization.
problem Efficiently stylize images with limited data and compute resources.
method Fully Adversarial Mosaics (FAMOS) that integrates parametric and non-parametric approaches.
result Demonstrates the effectiveness of FAMOS in stylizing images with minimal data and compute resources.
Generative model creates realistic scenes from pixel-wise labels.
problem Creating photo-realistic scenes from pixel-wise labels.
method Semantic bottleneck GAN model combining conditional and unconditional generation networks.
result Model outperforms state-of-the-art models in unsupervised image synthesis.
Develops a deep model for joint image-text learning.
problem Bidirectional joint image-text modeling.
method Variational hetero-encoder randomized GAN (VHE-GAN).
result Achieves state-of-the-art performance in image-text learning and generation.
We present a novel introspective variational autoencoder (IntroVAE) model for synthesizing high-resolution photographic images. IntroVAE is capable of self-evaluating the quality of its generated samples and improving itself accordingly. Its inference and generator models are jointly trained in an introspective way. On…
Paper proposes method to generate images from text using GANs trained on uncaptioned images.
problem Limited captioned image datasets for text-to-image synthesis.
method Conditional GANs trained on uncaptioned images with an Image Captioning Module.
result Promising preliminary results compared to unconditional GANs.
Generative model creates meal images from ingredient descriptions.
problem Synthesize photo-realistic meal images from ingredient descriptions.
method Attention-based ingredients-image association model, cycle-consistent constraint.
result Model generates meal images corresponding to ingredient descriptions.
New method controls generative models with continuous factors.
problem Lack of control over generative models and poor understanding of latent space.
method Introduces a method to find meaningful directions in latent space for precise control of generated images.
result Demonstrates effectiveness of method for GANs and variational auto-encoders.
We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user input, and/or simple scene models, we train an end-to-end deep neural network that di…
Agent learns to navigate uncertain 3D maps using a hybrid planner.
problem Planning in 3D environments with uncertain topological maps.
method Hierarchical strategy combining graph planner and local policy, data-driven learning with neural network.
result Machine learning can overcome missing information in probabilistic topological maps.
This guide explains statistical distances for evaluating generative models.
problem Evaluating the quality of samples from generative models.
method Four statistical distances: SW, C2ST, MMD, FID.
result Different distances can yield varying results on similar data.
StyleNeRF generates high-resolution images with 3D consistency and style control.
problem Generating high-resolution images with fine details and 3D consistency.
method Integrates NeRF into a style-based generator for efficient high-resolution image synthesis.
result Synthesizes high-resolution images at interactive rates with high 3D consistency and style control.
Sketch-BERT learns vector sketches using BERT-like self-supervised learning.
problem Lack of effective vector sketch representation for recognition and retrieval tasks.
method Generalized BERT to sketch domain with novel embedding networks and self-supervised sketch gestalt learning.
result Improved performance on sketch recognition, retrieval, and gestalt tasks.
Unsupervised framework learns latent codes for controllable generation.
problem Challenging to achieve controllable generation with GANs.
method Self-training iterative feedback from discriminator to generator.
result Better disentanglement and semantic meaningful latent codes.
Efficiently generates high-resolution images with reduced sampling time using LEGO bricks.
problem Efficiently generating high-resolution images with reduced sampling time.
method Introduces LEGO bricks that integrate Local-feature Enrichment and Global-content Orchestration to create a test-time reconfigurable diffusion backbone.
result Significantly reduces sampling time compared to other methods.
Generative adversarial network synthesizes sketches into realistic images.
problem Improving the quality and realism of facial sketches.
method Hybrid GAN with quality guided encoder and identity preserving network.
result Synthesized images are more realistic and maintain identity.
DCGANs generate realistic breast masses for mammography.
problem Lack of labelled data and imbalanced datasets in medical imaging.
method DCGANs trained on mammographic images to generate synthetic masses.
result DCGANs improve lesion detection in mammography by ~0.09 F1 score.
Automated testing improves deep learning model accuracy by 259.2%.
problem Ensuring robustness of deep learning models through automated testing.
method Jointly optimizing differential behaviors and neuron coverage; generating corner-cases; applying transformations and GANs.
result Deep learning model accuracy increased by 259.2% using automated generated corner cases.
DeepRacing uses neural networks to predict trajectories for autonomous racing in video games.
problem Training algorithms for high-speed autonomous racing in realistic environments.
method Developed a virtual testbed using F1 video games, trained neural networks to predict trajectories and control commands.
result Trajectory prediction outperforms end-to-end control methods in autonomous racing simulations.