Paper tackles selfie cartoonization with a new GAN.
problem Cartoonization of selfies with artistic abstraction and exaggeration.
method Proposes scGAN with attentive adversarial network (AAN) for specific facial region emphasis.
result Method generates cartoon portraits with improved robustness and different styles.
Generative adversarial networks with attention improve financial time series simulation.
problem Limited real financial data for training and evaluation of trading strategies.
method Two generative adversarial networks (GANs) using convolutional networks with attention and transformers.
result Attention-based GANs better reproduce stylized facts and smooth returns autocorrelation.
RoGAT enhances GAT robustness against adversarial attacks.
problem Vulnerability of GAT to adversarial attacks.
method Dynamic adjustment of edge weights and features, with an extra attention score.
result RoGAT outperforms other defensive methods in robustness tests.
Paper proposes AoA, a new adversarial attack method that significantly increases transferability.
problem Developing universal adversarial attacks on deep neural networks.
method AoA attacks the semantic property of attention in DNNs, enhancing transferability by altering the loss function.
result AoA generates adversarial samples that defeat 13 well-trained DNNs, achieving over 85% error rate.
Network embedding represents nodes in a continuous vector space and preserves structure information from the Network. Existing methods usually adopt a "one-size-fits-all" approach when concerning multi-scale structure information, such as first- and second-order proximity of nodes, ignoring the fact that different scal…
Proposes a method to compress deep networks using adversarial training and attention mechanisms.
problem Lack of efficient methods to compress deep networks while preserving important information.
method Adversarial training with task-driven attention mechanism for effective intermediate supervision.
result Demonstrates superior performance on benchmark datasets compared to state-of-the-art methods.
Improved acoustic modeling with attentive adversarial learning.
problem Domain variability in acoustic modeling.
method Proposes an attentive ADIT method with an attention mechanism to improve domain-invariance of deep features.
result Improves deep feature domain-invariance and senone-discriminativity over ADIT.
Improved GAN performance with a novel local attention mechanism.
problem Enhancing the performance of Generative Adversarial Networks (GANs).
method Introducing a two-dimensional local attention mechanism that preserves geometry and locality, and using information flow graphs for design.
result Significant improvements in FID and Inception scores, from 18.65 to 15.94 on ImageNet.
UAG defends GNNs against adversarial attacks by quantifying and explaining uncertainties.
problem Lack of uncertainty quantification in GNNs makes them vulnerable to adversarial attacks.
method UAG uses Bayesian Uncertainty Technique (BUT) and Uncertainty-aware Attention Technique (UAT).
result UAG outperforms state-of-the-art solutions in defending adversarial attacks on GNNs.
Cross-domain sentiment classification (CDSC) is an importance task in domain adaptation and sentiment classification. Due to the domain discrepancy, a sentiment classifier trained on source domain data may not works well on target domain data. In recent years, many researchers have used deep neural network models for c…
Bayesian attention improves model performance and robustness.
problem Limited exploration of stochastic attention in neural networks.
method Introduces Bayesian attention belief networks using gamma and Weibull distributions.
result Outperforms deterministic and stochastic attention methods in accuracy and robustness.
DAAN dynamically adapts adversarial learning for better domain adaptation.
problem Dynamic evaluation of global vs local domain distributions for adversarial learning.
method Dynamic Adversarial Adaptation Network (DAAN) that dynamically learns domain-invariant representations.
result DAAN achieves better classification accuracy compared to state-of-the-art methods.
With rapid progress and significant successes in a wide spectrum of applications, deep learning is being applied in many safety-critical environments. However, deep neural networks have been recently found vulnerable to well-designed input samples, called adversarial examples. Adversarial examples are imperceptible to …
Proposes a time-aware attention model for CTR prediction.
problem Lack of temporal signals in existing CTR prediction models.
method Time-aware attention model with absolute and relative temporal signals, regularized adversarial sampling.
result Significantly improves CTR prediction performance.
We introduce an adversarial method for producing high-recall explanations of neural text classifier decisions. Building on an existing architecture for extractive explanations via hard attention, we add an adversarial layer which scans the residual of the attention for remaining predictive signal. Motivated by the impo…
Paper investigates Lipschitz constants of self-attention modules in neural networks.
problem Lipschitz constants of self-attention modules in neural networks.
method Proved standard dot-product self-attention is not Lipschitz for unbounded input domain. Proposed L2 self-attention that is Lipschitz. Derived upper bound on L2 self-attention's Lipschitz constant.
result Proved standard self-attention is not Lipschitz for unbounded input domain and proposed an alternative L2 self-attention that is Lipschitz.
Aligns attention distributions for improved accuracy and robustness.
problem Improving the accuracy and robustness of neural networks using attention mechanisms.
method Alignment attention that encourages key and query distributions to match within each head.
result Alignment attention leads to better accuracy, uncertainty estimation, and robustness across various tasks.
Adversarial machine learning in the context of image processing and related applications has received a large amount of attention. However, adversarial machine learning, especially adversarial deep learning, in the context of malware detection has received much less attention despite its apparent importance. In this pa…
The paper improves NLI models' robustness by adding external knowledge to the attention mechanism.
problem NLI models' performance drops significantly on simple adversarial examples.
method Proposes a method to enhance NLI models' robustness by incorporating external knowledge into the attention mechanism.
result The method significantly improves the robustness of NLI models, achieving human-level performance on adversarial data.
In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as a function of only spatially local points in lower-resolution feature maps. In …
MAGIC generates image collages from set templates using attention and set representations.
problem Generating image collages from set templates is challenging for classical models.
method Memory Attentive Generation of Image Collages (MAGIC) using Set-Transformer layers and set-pooling.
result MAGIC can generate image collages from set templates in one forward pass.
DefNet defends GNNs against adversarial attacks by identifying and mitigating vulnerabilities.
problem Vulnerability of GNNs to adversarial attacks.
method Investigates latent vulnerabilities in GNN layers, proposes dual-stage aggregation and bottleneck perceptron, and uses adversarial contrastive learning for training.
result DefNet significantly improves GNN robustness under various adversarial attacks.
AdvImmune improves certifiable robustness of GNNs against adversarial attacks.
problem Vulnerability of graph neural networks to adversarial attacks.
method Proposes AdvImmune, an algorithm that optimizes with meta-gradient to improve certifiable robustness.
result Remarkably improves the ratio of robust nodes by 12%, 42%, 65% with an affordable immune budget of only 5% edges.
Proposes a novel network for CTR prediction by learning modality-specific and modality-invariant representations.
problem Learning good representation of items from multimodal features in E-commerce is challenging due to redundant information across modalities.
method Introduces a Multimodal Adversarial Representation Network (MARN) that calculates modality-specific weights and learns modality-invariant representations.
result Consistently achieves remarkable improvements over state-of-the-art methods in CTR prediction.
PML-GAN tackles noisy multi-label annotations using adversarial learning.
problem Learning multi-label models from noisy, overcomplete annotations.
method PML-GAN uses a disambiguation network and a generative adversarial network to map noisy labels to clean labels and data samples.
result PML-GAN achieves state-of-the-art performance on partial multi-label learning datasets.
TAnoGan detects anomalies in time series data using GANs.
problem Anomaly detection in time series data.
method Generative Adversarial Networks (GAN) for unsupervised anomaly detection.
result TAnoGan outperforms traditional and neural network models in anomaly detection.
Quantized neural networks are vulnerable to adversarial attacks.
problem Adversarial robustness of quantized neural networks.
method Investigated adversarial robustness of quantized neural networks under different threat models.
result Quantization does not offer robust protection and results in gradient masking.
Adversarial fog tests autonomous navigation models.
problem Neural networks are fooled by adversarial perturbations, but fog naturally creates similar perturbations.
method Introduced a new type of adversarial perturbation using generative models and Cycle-Consistent Generative Adversarial Networks.
result Generated adversarial fog images help test autonomous navigation models.
Machine learning models have been shown vulnerable to adversarial attacks launched by adversarial examples which are carefully crafted by attacker to defeat classifiers. Deep learning models cannot escape the attack either. Most of adversarial attack methods are focused on success rate or perturbations size, while we a…
PA-GNN enhances GNN robustness against poisoning attacks using clean graph knowledge.
problem Improving robustness of GNNs against poisoning attacks.
method PA-GNN uses a penalized aggregation mechanism and meta-optimization to transfer robustness from clean graphs.
result PA-GNN significantly improves GNN robustness against poisoning attacks on real-world graphs.
Graph neural networks are vulnerable to adversarial attacks by manipulating graph structure.
problem Vulnerability of Graph Neural Networks to adversarial attacks.
method Categorization and review of existing attacks and defenses.
result Developed a repository for empirical studies on graph adversarial attacks and defenses.
Deep neural networks (DNNs)-powered Electrocardiogram (ECG) diagnosis systems recently achieve promising progress to take over tedious examinations by cardiologists. However, their vulnerability to adversarial attacks still lack comprehensive investigation. The existing attacks in image domain could not be directly app…
Improved non-intrusive load monitoring with a novel neural network.
problem Accurately disaggregating household electricity consumption without dedicated meters.
method Developed a scale- and context-aware network with multi-scale features and contextual information.
result Significantly improved accuracy compared to state-of-the-art methods.
Study explores bias-variance in adversarial machine learning.
problem Understanding adversarial machine learning's impact on bias and variance.
method Investigates bias-variance trade-offs in deep neural networks using MSE and cross-entropy.
result Derives bias-variance trade-offs for classification and regression.
Improves deep learning models' robustness with reverse adversarial examples.
problem Deep learning models' fragility to adversarial examples.
method Inspired by brain mechanisms, proposes reverse adversarial examples method.
result Average 19.02% accuracy improvement on unseen data transformation.
Recent studies show that widely used deep neural networks (DNNs) are vulnerable to carefully crafted adversarial examples. Many advanced algorithms have been proposed to generate adversarial examples by leveraging the Lp distance for penalizing perturbations. Researchers have explored different defense met…
A novel method using saliency maps detects adversarial attacks effectively.
problem Vulnerability of neural networks to adversarial attacks.
method Combining saliency maps with additional noises and inconsistency strategy.
result High detection success rate of adversarial attacks on various datasets.
MD-CGAN models forecast time series with probabilistic posterior distributions.
problem Limited applications of GANs in time series forecasting, especially with probabilistic predictions.
method Mixture Density Conditional Generative Adversarial Model (MD-CGAN) using Gaussian mixture output.
result MD-CGAN outperforms benchmarks, especially in noisy time series.
New algorithm improves robustness by more regularization on less robust samples.
problem Improving robustness against adversarial attacks.
method Proposes a new adversarial training algorithm that applies more regularization to data vulnerable to adversarial attacks.
result Empirically superior to other existing algorithms, achieving state-of-the-art performance in generalization and robustness.
PDA improves deep neural networks' robustness against adversarial and common corruptions.
problem Deep neural networks' lack of robustness against common corruptions and adversarial attacks.
method Progressive Data Augmentation (PDA) that injects diverse adversarial noises during training.
result PDA-trained networks are more robust against both adversarial and common corruptions.
CorGAN generates synthetic healthcare records while preserving privacy.
problem Generating realistic synthetic healthcare records while maintaining privacy.
method Combining Convolutional Generative Adversarial Networks and Convolutional Autoencoders to capture correlations between medical features.
result CorGAN generates synthetic data with performance similar to real data in various ML settings.
Linearized attention fails to converge to NTK limit even at large widths.
problem Understanding the convergence of attention mechanisms to the kernel regime.
method Analyzes linearized attention and its relationship to the NTK limit, considering practical widths and conditions.
result Linearized attention does not converge to its NTK limit at any practical width, revealing a fundamental trade-off.
New method uses random discriminators to train GANs more efficiently.
problem Difficulty in training Generative Adversarial Networks (GANs).
method Proposes a new generative network using random discriminators.
result The method leads to a more stable and efficient optimization problem.
GANs analyzed for performance and training issues.
problem Performance and training issues of GANs.
method SDE approximations for training GANs.
result Improved understanding of GANs through analytical perspectives.
Adversarial training has been successfully applied to build robust models at a certain cost. While the robustness of a model increases, the standard classification accuracy declines. This phenomenon is suggested to be an inherent trade-off. We propose a model that employs feature prioritization by a nonlinear attention…
The robustness of neural networks to adversarial examples has received great attention due to security implications. Despite various attack approaches to crafting visually imperceptible adversarial examples, little has been developed towards a comprehensive measure of robustness. In this paper, we provide a theoretical…
New method improves robustness of smoothed classifiers against adversarial attacks.
problem Improving robustness of smoothed classifiers against adversarial attacks.
method Proposes worst-case adversarial loss over input distributions as a robustness certificate, and uses duality and smoothness properties to provide an easy-to-compute upper bound.
result Shows superior robustness performance over state-of-the-art certified or heuristic methods.
Geometric approach improves probabilistic robustness in neural networks.
problem Widespread lack of robustness in deep neural networks to adversarial examples.
method Geometric view on Probabilistically Robust Learning (PRL) and introduction of new perimeters.
result Existence of solutions and properties of modified PRL models.