A method to combine saliency metrics for better CNN pruning decisions.
problem Improving CNN pruning decisions by combining multiple saliency metrics.
method Proposes a method to compose different saliency metrics for better CNN pruning decisions.
result The composition of saliencies avoids many poor pruning choices identified by individual saliencies.
The study evaluates saliency metrics for image classifier outputs, finding inconsistencies and unreliability.
problem Inconsistencies and unreliability in saliency metrics for evaluating pixel relevance.
method Investigated existing saliency metrics, calculated and compared their consistency, and applied psychometric testing methods.
result Saliency metrics can be statistically unreliable and inconsistent, affecting comparative rankings.
New hypothesis and method reduce noise in saliency maps.
problem Noisy saliency maps from deep neural networks.
method Proposed a new hypothesis and Rectified Gradient method.
result Rectified Gradient effectively reduces saliency map noise.
Convolutional-deconvolution networks can be adopted to perform end-to-end saliency detection. But, they do not work well with objects of multiple scales. To overcome such a limitation, in this work, we propose a recurrent attentional convolutional-deconvolution network (RACDNN). Using spatial transformer and recurrent …
DANCE improves saliency maps by adding subtle input variations.
problem Poor performance of saliency methods in saturated gradients, adversarial perturbations, and inter-feature dependence.
method Two-step procedure: 1) Perturbation mechanism, 2) Aggregation of saliency maps.
result DANCE saliency method outperforms existing methods qualitatively and quantitatively.
A taxonomy of saliency metrics helps in pruning deep neural networks.
problem Difficulty in separating saliency metric effectiveness from pruning algorithms.
method Proposed a taxonomy based on four orthogonal components.
result Constructed metrics can outperform existing state-of-the-art metrics.
XRAI improves saliency maps for deep neural networks.
problem Improving understanding of deep neural networks through better saliency methods.
method XRAI is a region-based attribution method built upon integrated gradients, with new evaluation methods and sanity checks.
result XRAI produces better results than other saliency methods for common models and the ImageNet dataset.
Study evaluates saliency maps on artificial data with different backgrounds.
problem Objective evaluation of saliency methods on artificial data with varying backgrounds.
method Developed a framework to generate artificial data with synthetic lesions and a known ground truth map, evaluated two data sets with different backgrounds (Perlin noise and 2D brain MRI slices).
result Heatmaps vary strongly between saliency methods and backgrounds.
Bayesian optimisation generates saliency maps for black-box models.
problem Generating saliency maps for models without access to parameters.
method Bayesian optimisation sampling method to find global salient regions.
result Approach outperforms grid-based methods and performs similarly to gradient-based methods.
New nonlinear saliency maps improve deep neural network interpretability.
problem Lack of understanding why and how deep neural networks make decisions.
method Developed novel nonlinear saliency maps to better interpret deep neural networks.
result Nonlinear saliency maps provide more specific drivers of classification on complex examples.
New method for visualizing high-level concepts in generative models.
problem Challenges in evaluating and visualizing concepts in generative models.
method Introduces a method to compute concept saliency maps for latent representations of known or novel high-level concepts.
result Concept saliency maps highlight input features important for high-level concepts.
Input-cell attention improves RNN saliency detection over time.
problem Vanishing saliency in RNNs makes them unreliable for detecting important features at arbitrary time intervals.
method Proposes input-cell attention, a novel RNN cell structure that uses a fixed-size matrix embedding to attend to different inputs from current or previous time steps.
result Input-cell attention produces a saliency map that can detect important features regardless of their occurrence in time.
In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model generalises well to unseen images and requires a single forward pass to perform …
The paper benchmarks saliency methods for time series predictions.
problem Benchmarking saliency methods for time series predictions.
method Compared saliency-based interpretability methods across diverse neural architectures.
result Saliency methods fail to reliably identify feature importance over time in time series data.
Study validates saliency maps of GNNs using selective inference.
problem Reliability of GNN saliency maps in graph-structured data.
method Statistical testing framework with selective inference to control Type I error rate.
result Valid p-values for salient subgraphs, ensuring meaningful information. Adversarial robust models have more interpretable saliency maps.
problem Understanding the relationship between adversarial robustness and saliency map interpretability.
method Quantifying the alignment between input images and saliency maps, hypothesizing and testing the relationship with linear and neural network models.
result The alignment between input images and saliency maps increases as the distance to the decision boundary grows, especially in linear models.
In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make decisions by identifying significant pixels for prediction. A model shows wrong classi…
New method improves interpretability of fMRI decoding models.
problem Uninterpretable deep neural networks in fMRI decoding.
method Adversarial training to make DNNs robust to noise and improved saliency map methods.
result Saliency maps from adversarial-trained DNNs are more interpretable than those from other methods.
A new LDA variant improves multi-label classification performance.
problem Improving multi-label classification performance.
method Saliency-based weights redefine between-class and within-class scatter matrices for multi-label classification.
result The proposed method leads to performance improvements in various multi-label classification problems.
New approach makes adversarial examples less suspicious without changing perceptual salience.
problem Robustness of deep neural networks to unsuspicious adversarial examples.
method Splitting images into foreground and background, allowing larger perturbations in background while maintaining low cognitive salience.
result Dual-perturbation attacks are effective against classifiers robust to conventional attacks and adversarial training yields more robust classifiers.
Saliency methods aim to explain the predictions of deep neural networks. These methods lack reliability when the explanation is sensitive to factors that do not contribute to the model prediction. We use a simple and common pre-processing step ---adding a constant shift to the input data--- to show that a transformatio…
Method uses ANN to estimate incentive salience from large behavioral data.
problem Estimating incentive salience in naturalistic settings.
method Artificial Neural Networks (ANNs) for latent state approximation.
result ANNs produce better representations for predicting future behaviour.
New saliency evaluations focus on completeness and soundness, improving explanations.
problem Current saliency evaluations focus on completeness but ignore soundness.
method Introduces new intrinsic evaluation metrics based on completeness and soundness.
result Simple saliency method matches or outperforms prior methods in new evaluations.
A simple fix helps saliency methods pass sanity checks.
problem Saliency methods fail simple sanity checks.
method Compute saliency maps for all labels, use competition to identify and remove less relevant pixels.
result CGI method is efficient, requires no additional training, and uses only the input and gradient.
Develops a new feature selection method using deep-learning saliency.
problem Lack of instance-level feature selection information.
method Saliency-based Feature Selection (SFS) method.
result SFS method provides instance-level feature selection information.
Puzzle Mix optimizes mixup by leveraging saliency and local statistics.
problem Overfitting and adversarial vulnerability of deep networks.
method Puzzle Mix alternates between multi-label and saliency-based objectives for optimal mixing masks.
result Puzzle Mix outperforms other mixup methods in generalization and adversarial robustness.
1-Lipschitz neural networks produce clearer, more focused Saliency Maps for explainable AI.
problem Noisy and limited Saliency Maps from traditional neural networks.
method Dual loss of optimal transport problem for 1-Lipschitz neural networks.
result Saliency Maps from 1-Lipschitz networks are highly concentrated and less noisy, aligning with human explanations.
Enhances counterfactual explanations with more valid and informative saliency maps.
problem Lack of valid counterfactual explanations in existing models.
method Introduces a modified approach to CELS model by removing mask normalization.
result Demonstrates higher validity and more informative counterfactual explanations.
Visualizes ConvNets without confounding effects.
problem Misinterpretation of saliency maps due to confounding variables.
method Univariate statistical tests and partial back-propagation to remove confounding effects.
result Visualization of confounder-free saliency maps.
Deep learning predicts chess player attention using eye-tracking and game data.
problem Predicting chess player attention during game.
method Convolutional neural networks with skip-layer architecture and autoencoder.
result Deep features from natural images help in predicting saliency maps for chess.
Proposes a method to quantify the reliability of salient regions in deep learning models using p-values.
problem Difficulty in assessing the reliability of saliency maps generated by deep learning models.
method Proposes a selective inference framework to quantify the reliability of salient regions as selected hypotheses by deep learning models.
result The method can provably control the probability of false positive detections of salient regions.
New tool for interpreting neural nets, explaining model behavior.
problem Interpreting neural network responses and explaining model behavior.
method Full-Gradient representation and FullGrad saliency map approximation.
result FullGrad method explains model behavior more comprehensively and accurately than other methods.
Neural network classifies breast cancer lesions using global and local image features.
problem Classifying breast cancer lesions in medical images with high resolution and small regions of interest.
method Proposes a neural network that combines global saliency maps and local patches for pixel-level saliency maps.
result Achieves radiologist-level performance in screening mammography interpretation.
Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To address this problem, we propose classifier-agnostic saliency map extraction, which fi…
Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work, we propose an actionable methodology to evaluate what kinds of explanations a g…
A new data-level recombination strategy improves RGB-D salient object detection.
problem RGB-D salient object detection struggles with depth information.
method Proposes a novel data-level recombination strategy to fuse RGB and depth data before feature extraction.
result Achieves a new state-of-the-art performance in RGB-D salient object detection.
Enhanced deep learning model improves tumor segmentation in ultrasound images.
problem Challenges in integrating patient-specific medical priors into deep learning models.
method Integrates visual saliency into a U-Net architecture with attention blocks.
result Achieved a Dice similarity coefficient of 90.5 percent on a dataset of 510 images.
Develops methods to show model confidence and feature importance in medical imaging.
problem Ensuring safety and understanding model confidence in medical applications.
method Creates a pipeline to visualize uncertainty and saliency maps for deep neural networks.
result Demonstrates how deep neural networks can be made more transparent and safe for medical applications.
Combining global and local explanations improves user understanding of RL agents.
problem Challenges in explaining agent behavior due to large state spaces and delayed rewards.
method Integrating strategy summaries with saliency maps to provide both global and local explanations.
result Summaries including important states significantly improve user understanding of RL agents.
Predicts failure of autonomous vehicle steering control models.
problem Evaluating and predicting failure of machine learning models in safety-critical applications.
method Trains a student model to predict the main model's error based on saliency maps.
result Preliminary results show the failure predictor model works on autonomous vehicle steering control systems.
Electron Cryo-Tomography (ECT) allows 3D visualization of subcellular structures at the submolecular resolution in close to the native state. However, due to the high degree of structural complexity and imaging limits, the automatic segmentation of cellular components from ECT images is very difficult. To complement an…
Certifiable defense method improves robustness of deep learning interpretation.
problem Vulnerability of gradient-based saliency maps to adversarial attacks.
method Sparsified SmoothGrad method, extending certifiably robust smooth classifier bounds.
result Sparsified SmoothGrad method is certifiably robust against adversarial perturbations.
A novel method using saliency maps detects adversarial attacks effectively.
problem Vulnerability of neural networks to adversarial attacks.
method Combining saliency maps with additional noises and inconsistency strategy.
result High detection success rate of adversarial attacks on various datasets.
Bayesian explanations are more resilient to adversarial attacks than deterministic ones.
problem Stability of saliency-based explanations under adversarial attacks in Neural Networks.
method Empirical and theoretical analysis of Bayesian vs deterministic Neural Networks.
result Bayesian explanations are more stable under adversarial perturbations and direct attacks.
Study identifies and mitigates causes of image misclassifications in CNN models.
problem Improving model interpretability and accuracy in image classification.
method Trained six CNN architectures on CIFAR-10, used conditional confusion matrices and misclassification networks to identify morphological similarity and non-essential information interference as causes of misclassification. Developed a method to reduce misclassifications by erasing pixels within top 5% saliency map bounding boxes.
result Identified two causes of misclassification: morphological similarity and non-essential information interference, and developed a method to reduce misclassifications caused by the latter.
Improved saliency maps for deep neural networks with reduced noise.
problem Noisy explanations in Integrated Gradients for deep neural networks.
method SmoothTaylor, adaptive noising, and SmoothGrad techniques.
result SmoothTaylor and adaptive noising generate better quality saliency maps.
CRITS improves time series classification with interpretable local explanations.
problem Lack of detailed explanations in time series classification models.
method CRITS uses convolutional kernels, max-pooling, and rectified linear units to extract feature weights.
result CRITS provides intrinsically interpretable local explanations without requiring gradients or random perturbations.
The Jacobian-based Saliency Map Attack is a family of adversarial attack methods for fooling classification models, such as deep neural networks for image classification tasks. By saturating a few pixels in a given image to their maximum or minimum values, JSMA can cause the model to misclassify the resulting adversari…