Proposes a new interpretation of separable convolutions.
problem Lack of a thorough explanation for the efficacy of separable convolutions.
method Hybrid interpretation combining depthwise and pointwise convolutions.
result Proposes a new model for understanding separable convolutions.
Jacobian conditioning predicts GAN quality, and clamping improves GAN performance.
problem Predicting and improving GAN performance through Jacobian conditioning.
method Examined Jacobian singular values in GANs, proposed Jacobian Clamping as a regularization technique.
result Jacobian Clamping improves GAN metrics like Inception Score and FID.
Improved image classification accuracy on CIFAR-10 dataset.
problem Classifying images from the CIFAR-10 dataset with high accuracy.
method Combining features from manual and deep learning approaches, including VGG16, Inception ResNet v2, HOG, and pixel intensities.
result Achieved 94.6% testing accuracy by combining top 1000 principal components.
Study how neural networks optimize to stable linearly connected regions.
problem Understanding how neural networks converge to stable solutions under different training conditions.
method Investigate the stability of neural networks to SGD noise and apply it to iterative magnitude pruning.
result Subnetworks that reach full accuracy must be stable to SGD noise, either at initialization or early in training.
Novel unsupervised LSTM method for video frame prediction.
problem Video frame prediction with limited labeled data.
method Inception-based LSTM architecture.
result Inception-based LSTM outperforms convolutional LSTM and has better performance than Inception v2 LSTM.
The paper analyzes GANs focusing on Inception Score, label smoothing, gradient vanishing, and -log(D(x)).
problem Improving the quality and diversity of generated images in Generative Adversarial Networks (GANs).
method Mathematical analysis of Inception Score, label smoothing, gradient vanishing, and -log(D(x)) alternative in the context of GANs.
result Detailed mathematical insights into Inception Score, label smoothing, gradient vanishing, and -log(D(x)) alternative.
Inception v3 model classifies face shapes with high accuracy.
problem Face shape classification using deep learning.
method Retraining Inception v3 model on face shape dataset.
result Inception v3 outperforms other classifiers.
Exchange Traded Funds (ETFs) have been gaining increasing popularity in the investment community as is evidenced by the high growth both in the number of ETFs and their net assets since 2000. As ETFs are in nature similar to index mutual funds, in this paper we examined if this growing demand for ETFs can be explained …
DRS uses a GAN discriminator to improve sampling accuracy.
problem Improving sampling accuracy in GANs.
method Rejection sampling using discriminator output.
result DRS improves Inception Score and FID on ImageNet.
The Inception Score fails to guide model comparisons.
problem The Inception Score is insufficient for model evaluation.
method Analysis of Inception Score's limitations and application issues.
result Inception Score does not provide useful guidance for model comparison.
Hyperbolic GANs improve image generation metrics.
problem Improving image generation quality in neural networks.
method Integrating hyperbolic layers into GAN architectures.
result Hyperbolic GANs achieve better metrics than Euclidean counterparts.
Improves GANs by incorporating class information with a multi-hinge loss.
problem Improving GANs to better respect class information.
method Proposes a multi-class generalization of the Hinge loss for GANs.
result Improves Inception Scores and Frechet Inception Distance on Imagenet.
Proposes Topology Distance for evaluating GANs.
problem Challenges in evaluating GANs' goodness.
method Builds Vietoris-Rips complex on image features and defines TD based on latent manifold comparisons.
result Demonstrates TD's superiority over existing metrics.
Generative model produces high-fidelity video samples.
problem Generating high-fidelity videos from complex datasets.
method Large GAN trained on Kinetics-600 dataset, using a computationally efficient discriminator.
result Achieved state-of-the-art metrics in video synthesis and prediction.
FastFID efficiently trains generative models with FID loss.
problem Efficiently training generative models with FID loss.
method Introduces FastFID to train generative models with FID as a loss function.
result Improves FID for GANs using FID as an additional loss.
Paper proposes evaluation methods for climate change illustrations.
problem Lack of metrics to compare realism in conditional generative models.
method Adapted and assessed several existing metrics, including FID.
result FID with Inception-V3 embeddings correlates best with human realism.
This study evaluates how adversarial examples transfer between different models.
problem Transferability of adversarial examples across models poses a threat to machine learning reliability.
method Evaluation of three adversarial attacks (FGSM, Basic Iterative Method, Carlini & Wagner) on two model classes (VGG and Inception). Use of specific parameters and metrics (L-Infinity clipping, SSIM) for assessment.
result Adversarial examples can be transferred between models, indicating a vulnerability in machine learning systems.
Improved GAN training speed and quality with FastGAN.
problem Slower convergence and less expressive models in GAN training.
method Adversarial training with FastGAN algorithm.
result Better generation quality with less training time.
Proposes qIS for quantum generative models, extending classical inception score.
problem Develop a metric to evaluate quantum generative models.
method Introduces qIS, relating quality to Holevo information of quantum channel.
result qIS enhances the quality of quantum generative models, showing physical limitations.
SAGAN improves image generation by leveraging attention across feature locations.
problem Traditional GANs generate details only from local feature maps, limiting image quality.
method SAGAN uses self-attention to model long-range dependencies and spectral normalization for better training.
result SAGAN achieves state-of-the-art results, boosting Inception score and reducing Frechet Inception distance.
This paper uses MH algorithm to improve variational inference and GANs.
problem Improving sampling efficiency in Bayesian inference and GANs.
method Proposes learning an independent sampler to maximize MH acceptance rate, related to variational inference. Deduces GANs from MH perspective.
result Improves variational inference and GANs performance on real-world datasets.
Enhances GANs with class labels to improve sample quality.
problem Improving sample quality in GANs using class labels.
method Mathematical analysis of GANs with class labels, proposing AM-GAN.
result AM-GAN outperforms other GANs on metrics like Inception Score and AM Score.
Improved sampling quality with RBM-Flow and D-Flow models.
problem Efficient sampling of complex data distributions using invertible flows.
method Implement RBM-Flow and D-Flow models with discrete latent variables.
result Significant improvement in sampling quality over baseline models.
LOGAN optimizes GAN training by improving adversarial dynamics.
problem Training GANs is challenging due to delicate adversarial dynamics and potential divergence.
method Integrates natural gradient-based latent optimisation into CS-GAN.
result Significant improvement in GAN training performance, achieving state-of-the-art results.
Generative models struggle with class prediction on real data.
problem Evaluating generative models' ability to infer class labels.
method Trained classifiers on synthetic data generated by various models and tested on real data.
result Generative models from different classes outperform GANs on a new classification accuracy score (CAS).
Method learns moments for large implicit models, improving image generation quality.
problem Difficulty in defining and selecting moments for training large implicit models.
method Introduced moment network and used asymptotic theory to define and learn better moments.
result MoLM-trained generators outperform other methods in quality and diversity of generated images.
Satellite imagery improves house price prediction models.
problem Improving accuracy of housing price estimation models.
method Transfer learning from ImageNet-pretrained Inception-v3 model to satellite images.
result Achieved a 10% improvement in R-squared score.
FID misaligns with human judgment due to reliance on ImageNet classes.
problem FID metric's reliance on ImageNet classes causes discrepancies with human evaluation.
method Investigated and visualized the feature space of FID and its relation to ImageNet classes.
result Aligning histograms of Top-N ImageNet classifications can reduce FID without improving quality. End-to-end audio recognition system improves accuracy.
problem Improving accuracy in auditory object recognition.
method Proposes an end-to-end deep neural network with an 'inception nucleus' to learn features from raw waveforms.
result Bests current state-of-the-art approaches by 10.4 percentage points on Urbansound8k dataset.
We study the impact of input noise dimension on GAN performance.
problem Challenges in GANs like mode collapse and unstable training.
method Quantitative analysis using FID and IS on different image datasets.
result The optimal input noise dimension varies by dataset and architecture.
Transform classical network structures to graph CNN for better graph recognition.
problem Transforming classical network structures to graph CNN for better graph recognition.
method Review and introduce ResNet, Inception, and DenseNet into graph CNN, constructing G_ResNet, G_Inception, G_DenseNet.
result Demonstrated how different network structures work on graph CNN in the graph recognition task.
New methods validate a hypothesis explaining how neural nets generalize well.
problem Why over-parameterized nets generalize well despite memorizing training data.
method Developed new algorithms to suppress weak gradient directions without per-example gradients.
result Validated a hypothesis about gradient directions and their role in generalization.
Paper discusses sliced generative models for improved sample discrimination.
problem Improving sample discrimination in generative models.
method One-dimensional slicing of AutoEncoder-based generative models, focusing on normality tests and classical distances.
result The second group of methods based on classical distances gives a faster decrease rate of Fréchet Inception Distance (FID).
Automatically evaluates image quality based on human judgment.
problem Difficulty in rigorously evaluating generated image quality.
method Generative model embeddings, human labels regression, and statistical matching.
result 66% accuracy in predicting human scores of image realism.
Unified and extended precision-recall metrics for generative models.
problem Evaluation of generative models using scalar metrics like FID and IS.
method Unified various precision-recall approaches under a common framework.
result Recovered entire precision-recall curves and exposed metric pitfalls.
TTUR improves GAN training, converging to local Nash equilibrium.
problem Proving convergence of GAN training.
method Two time-scale update rule (TTUR) with stochastic gradient descent.
result TTUR converges to a local Nash equilibrium under mild assumptions.
MFIN networks improve crypto trading with multiple features.
problem Selecting and processing multiple features for effective trading.
method End-to-end framework using Multi-Factor Inception Networks (MFINs).
result MFINs learn uncorrelated, higher-Sharpe strategies not captured by traditional factors.
Discriminator optimizes to approximate optimal transport for better image generation.
problem Improving the quality of generated images using GANs.
method Trains discriminator to optimize a lower bound of Wasserstein distance, approximating optimal transport.
result Trained discriminator improves inception score and FID metrics.
New method evaluates text-to-image synthesis for realism, variety, and semantic accuracy.
problem Lack of metrics revealing semantic accuracy in text-to-image synthesis.
method Uses Inception network representations and t-SNE visualization for semantic evaluation.
result Classification accuracy of generated images to real images' visual concepts correlates with semantic accuracy.
New method boosts GANs by creating new classes from clustering, improving sample quality.
problem Improving GAN sample quality with class information.
method Clustering representations learned by GAN to create new classes, enhancing conditional GANs.
result Generated samples reach state-of-the-art Inception scores for CIFAR-10 and STL-10 datasets.
Paper tackles GAN instability in audio and speech signals using a new similarity metric.
problem Improving stability of LS-GANs for audio and speech signals.
method Proposes a new similarity metric in unitary space of Schur decomposition for 2D audio and speech representations.
result Enhanced stability in training with less mode collapse compared to baseline GANs.
Paper finds effective building blocks for CNNs, improving model performance and size.
problem Finding optimal deep model architectures and parameters.
method Search framework for discovering effective building blocks for CNNs.
result Discovered models are smaller and perform comparably to state-of-the-art models.
InceptionGCN improves disease prediction on graph data.
problem Improving disease prediction accuracy on graph data.
method Introduced a new spectral domain architecture with inception modules and varying kernel sizes.
result Significantly improved disease prediction results on two datasets.
Spider GAN accelerates GAN training with a new approach.
problem Stable training of Generative adversarial networks (GANs).
method Spider GAN leverages a novel approach to identify closely related datasets (friendly neighborhoods) and uses a new measure (signed inception distance) to accelerate GAN training.
result Spider GAN achieves faster convergence and state-of-the-art FID values with one-fifth of the training iterations.
Image classification system identifies bumble bee species from images.
problem Manual identification of bumble bee species is time-consuming and requires expert knowledge.
method Transfer learning using Inception, VGG16, VGG19, and ResNet models.
result Inception and VGG classifiers achieved up to 23% accuracy for single species identification.
BigGAN achieves state-of-the-art image synthesis on ImageNet.
problem Generating high-fidelity images from complex datasets like ImageNet.
method Trained a large-scale GAN with orthogonal regularization and a truncation trick.
result Improved Inception Score (IS) of 166.5 and Frechet Inception Distance (FID) of 7.4.
TSGAN models time series data with limited data, outperforming competitors.
problem Lack of quality time series data for machine learning.
method Proposes Time Series GAN (TSGAN) for synthetic time series generation.
result TSGAN outperforms competitors in FID metric and qualitative classification.
Jeffrey guidance extends diffusion-model control to more complex applications.
problem Controlling diffusion models beyond simple cases like conditional sampling.
method Leveraging Jeffrey's rule of conditioning to update marginal distributions towards a target distribution.
result Significant reductions in FID on CIFAR-10 and FFHQ with Inception embeddings as the target.