Unified model for age-invariant face recognition with photorealistic face synthesis.
problem Reliable face recognition across ages remains challenging due to significant intra-class variations.
method Unified deep architecture for cross-age face synthesis and recognition, continuous face rejuvenation/aging, disentangled age-invariant face representations.
result Superior performance on CAFR and other cross-age datasets, promising generalizability to unconstrained face recognition.
Proposes a new GAN architecture for generating data conditioned on partial information.
problem Generating data conditioned on partial ancillary information.
method Introduces a new Adversarial Network architecture and training strategy.
result The proposed method outperforms standard Conditional GANs in generating data under partial conditioning.
Improved visual speech synthesis using adapted ASR acoustic models.
problem Lack of synchronized audio, video, and depth data for speaker-independent speech-driven visual speech synthesis.
method Adapted an ASR acoustic model trained on audio-only data to the visual speech synthesis domain.
result Viewers significantly prefer animations generated from the adapted ASR acoustic model.
Generates high-resolution faces based on attributes.
problem Creating realistic face images with user-specified attributes.
method Conditional CycleGAN, handling unpaired data and attribute control.
result Produces realistic face images with user-controlled attributes.
This paper converts speech to match a face image and vice versa.
problem Matching speech to a face image and vice versa.
method Proposes a model with speech converter, face encoder/decoder, and voice encoder.
result Trained model converts speech to match a face image and generates a face image that matches the voice of input speech.
Synthesizes faces from facial features, invariant to pose and expression.
problem Creating realistic face images from facial features.
method Learning facial landmarks and textures from facial-recognition features, training on frontal, neutral-expression images.
result Generated images are invariant to lighting, pose, and expression.
Feature Quantization improves GAN training stability.
problem Stability issues in GAN training.
method Feature Quantization (FQ) for the discriminator, embedding true and fake data into a shared discrete space.
result FQ-GAN achieves new state-of-the-art performance on various GAN tasks.
A new generator for GANs separates style and variation.
problem Improving GANs' ability to control and disentangle image attributes.
method Borrowing from style transfer, a new generator architecture.
result Improves GANs' quality and disentanglement of latent factors.
Polynomial fusion layer improves speech-driven facial animation.
problem Recent facial synthesis relies on low-dimensional representations and concatenation, ignoring higher-order interactions.
method Proposes a polynomial fusion layer to model higher-order interactions of facial encodings.
result Demonstrates improved video quality, audiovisual synchronisation, and blink generation.
MO-PaDGAN generates diverse, high-performance designs with multiple metrics.
problem Challenges in generating diverse, high-performance designs with multiple metrics.
method MO-PaDGAN uses a new Determinantal Point Processes based loss function for probabilistic modeling of diversity and performances.
result MO-PaDGAN expands the design space towards high-performance regions and generates new designs with high diversity and performances.
StackGAN++ generates high-quality images from text descriptions.
problem Generating high-quality photo-realistic images from text descriptions.
method Two-stage and multi-stage generative adversarial networks (GANs) with stacked architecture.
result StackGAN++ significantly outperforms other methods in generating photo-realistic images.
Predicts routing congestion in FPGA designs using machine learning.
problem Routing congestion estimation is absent or inaccurate in HLS design methods.
method Machine learning to predict routing congestion in HLS.
result Accurately estimates routing congestion with errors of 6.71% and 10.05%.
Generative model generates synthetic medical images for data augmentation and anonymization.
problem Imbalanced medical imaging data sets, especially for rare pathologies.
method Generative adversarial network (GAN) trained on two public brain MRI datasets.
result Synthetic images improve tumor segmentation performance and serve as an anonymization tool.
FaceSigns embeds a secret watermark in images to authenticate and detect deepfakes.
problem Realistic image and video manipulation threats, especially deepfakes.
method Semi-fragile watermarking using neural networks, robust to face-swapping but fragile to deepfake manipulations.
result FaceSigns can reliably detect deepfake content with high accuracy.
Proposes a network to predict structured uncertainty distributions for images.
problem Previous methods only predicted diagonal covariance matrices, limiting reconstruction accuracy.
method Learns to predict full Gaussian covariance matrices for efficient sampling and likelihood evaluation.
result Accurately reconstructs ground truth correlated residual distributions and generates plausible high frequency samples.
Paper introduces a method for generating interlocutor-aware facial gestures in dyadic settings.
problem Generating appropriate non-verbal behavior for conversational agents in dyadic settings.
method Probabilistic method using multi-modal cues from the interlocutor to synthesize facial gestures.
result The model successfully leverages multi-modal input from the interlocutor to generate more appropriate behavior.
Improved GANs mitigate forgetting and collapse issues.
problem Catastrophic forgetting and mode collapse in GANs.
method Contrastive learning and mutual information maximization.
result Significantly stabilizes GAN training and improves performance.
Copula-based method generates synthetic populations from marginal distributions.
problem Generating realistic synthetic populations from limited data.
method Copula-based framework for population synthesis.
result Copula framework enhances transferability and realism of synthetic populations.
Machine learning optimizes polymer fiber synthesis.
problem Complex material synthesis requires impractical experimentation.
method Bayesian optimisation using machine learning.
result Efficiently directs synthesis to achieve material and process objectives.
Tree-based synthesis improves forecast accuracy in GDP and inflation.
problem Improving forecast accuracy in GDP and inflation.
method Developed a nonparametric synthesis function using regression trees.
result Tree-based synthesis leads to improved forecast accuracy.
Speech synthesis from EEG features using RNN.
problem Speech synthesis from EEG data.
method Recurrent Neural Network (RNN) regression model to predict acoustic features from EEG features.
result Feasibility of synthesizing speech directly from EEG features demonstrated.
Neural model synthesizes music with flexible timbre controls.
problem Creating audio samples with varied timbres from musical scores.
method Recurrent neural network conditioned on learned instrument embedding followed by WaveNet vocoder.
result Learned embedding space captures diverse timbres and enables interpolation for morphing.
Dataset of human-written problem statements and solutions for program synthesis.
problem Creating programs from natural language problem descriptions.
method Crowdsourced problem statements and solutions from programming competitions.
result Best model achieved 8.8% accuracy, indicating high complexity.
SED integrates synthesis, execution, and debugging for neural program synthesis.
problem Challenges in synthesizing complex programs that match specifications.
method SED combines synthesis, execution, and debugging to improve neural program generation.
result SED reduces error rates and outperforms standard decoding methods.
System uses machine learning and automated reasoning to speed up PBE synthesis.
problem Slow synthesis in PBE due to domain-specific knowledge and large training datasets.
method Preprocess SyGuS PBE problems with a neural network to reduce search space, then use automated reasoning for faster solution.
result System outperforms all competing tools in the 2019 SyGuS Competition for the PBE Strings track by 47.65%.
Method synthesizes 4D CMR images from XCAT model using GAN and SPADE.
problem Synthesizing realistic 4D CMR images with annotations and adaptable styles.
method Hybrid GAN approach with XCAT anatomical ground truth and SPADE for semantic preservation.
result Synthesized images with modality-specific features learned from real CMR data.
WaveCycleGAN2 improves speech synthesis quality by reducing aliasing.
problem Human ear can still distinguish synthesized speech from natural speech.
method WaveCycleGAN2 uses generators without down/up-sampling modules and combines discriminators from waveform and acoustic parameter domains.
result WaveCycleGAN2 achieves high-quality speech synthesis with comparable mean opinion scores to natural speech.
Automated synthesis planning from scientific literature using AI.
problem Accelerate materials design and discovery by connecting scientific literature to synthesis insights.
method Word embeddings from language models, named entity recognition, conditional variational autoencoder.
result The model predicts precursors for perovskite materials using historical data.
This paper solves steady-state planning for multichain MDPs.
problem Specifying constraints on the steady-state behavior of an agent.
method Linear programming solution for multichain MDPs.
result Optimal solutions yield stationary policies with rigorous guarantees.
Deep reinforcement learning optimizes retrosynthetic planning for chemical synthesis.
problem Optimizing chemical synthesis plans from molecular targets to simpler starting materials.
method Deep reinforcement learning to estimate synthesis costs and values of molecules.
result Trained neural networks outperform heuristic approaches in synthesizing unfamiliar molecules.
Spatial GAN improves texture synthesis quality and scalability.
problem Texture synthesis quality and scalability issues.
method Spatial Generative Adversarial Networks (SGAN) with extended noise distribution.
result High quality textures, scalability, real-time generation, and fusion of diverse images.
Generative model improves audio synthesis from TF features.
problem Challenges in generating high-quality audio from TF features.
method Used a GAN to generate invertible TF features from short-time Fourier transforms.
result Generated TF features from GAN outperformed direct waveform generation.
A neural program synthesis method with iterative fix operations.
problem Creating correct programs from input-output examples.
method Combines encoder-decoder synthesis with a differentiable fixer.
result Improves synthesis accuracy by reducing discrepancies between outputs and desired outputs.
New approach generates better synthetic data for neural program synthesis.
problem Current approaches to neural program synthesis generalize poorly to real data.
method Adversarial approach to control synthetic data distributions.
result Proposed method outperforms current approaches.
Framework synthesizes geological images minimizing patch distribution discrepancy.
problem Synthesizing realistic geological images from a single exemplar.
method Uses kernel discrepancies and generative neural networks for efficient synthesis.
result Synthesized images match visual patterns and spatial statistics of the exemplar.
Generative model creates realistic scenes from pixel-wise labels.
problem Creating photo-realistic scenes from pixel-wise labels.
method Semantic bottleneck GAN model combining conditional and unconditional generation networks.
result Model outperforms state-of-the-art models in unsupervised image synthesis.
Enhanced Tacotron for Japanese speech synthesis improves naturalness.
problem Challenges in end-to-end Japanese speech synthesis due to pitch accents.
method Extended Tacotron with self-attention to capture pitch accent dependencies.
result Proposed systems show improvements but still lag behind traditional pipeline methods.
We prove that spherical spectral analysis and synthesis hold in Damek-Ricci spaces and derive two-radius theorems.
Inverse Drum Machine separates drum mixes using transcription and synthesis.
problem Separating individual drum tracks from mixed recordings.
method Analysis-by-synthesis framework combining deep learning and automatic transcription.
result Separation quality comparable to supervised methods requiring isolated stems.
New unsupervised speaker adaptation method for speech synthesis.
problem Adapting speech synthesis to new speakers with minimal data.
method Concatenating audio and text inputs, proposing new training schemes.
result Improves adaptation to unseen speakers and multi-speaker modeling.
Language models predict inorganic synthesis conditions and temperatures.
problem Limited data and heuristic approaches constrain inorganic synthesis planning.
method Language models without fine-tuning predict precursor conditions and temperatures.
result Language models achieve high accuracy in predicting synthesis conditions and temperatures.
Proposes GANs using Capsule Networks for faster image synthesis.
problem Faster image synthesis with fewer training samples and epochs.
method Capsule Networks for image synthesis using GAN architectures.
result Learn data manifold faster and synthesize visually accurate images.
CrossBeam learns to search more efficiently in program synthesis.
problem Efficiently searching through vast program spaces.
method Trains a neural model to guide program synthesis, combining previously explored programs.
result CrossBeam explores much smaller portions of the program space compared to state-of-the-art methods.
MORL uses program synthesis to improve reinforcement learning policies.
problem Difficult to interpret and impose constraints on learned policies from black-box neural networks.
method Iterative framework combining program synthesis and behavior cloning.
result Programmatic representation allows for high-level modifications leading to improved learning.
BOiLS optimizes circuit quality using Bayesian optimization.
problem Optimizing circuits with complex search spaces.
method Adapting Bayesian optimization to logic synthesis, using Gaussian process kernels and trust-region constrained acquisitions.
result Demonstrated superior performance in sample efficiency and QoR values.
AutoDiff combines auto-encoder and diffusion model for realistic tabular data synthesis.
problem Generating realistic synthetic tabular data with heterogeneous features.
method Employing auto-encoder architecture to handle tabular data's complexity.
result Synthetic tables from AutoDiff show good statistical fidelity and perform well in machine learning tasks.
New method evaluates text-to-image synthesis for realism, variety, and semantic accuracy.
problem Lack of metrics revealing semantic accuracy in text-to-image synthesis.
method Uses Inception network representations and t-SNE visualization for semantic evaluation.
result Classification accuracy of generated images to real images' visual concepts correlates with semantic accuracy.
Diffusion models outperform GANs in image synthesis quality.
problem Improving image synthesis quality using generative models.
method Developed and optimized diffusion models, and introduced classifier guidance for conditional synthesis.
result Achieved superior image synthesis quality with diffusion models, matching or exceeding GANs in FID scores.