New framework learns phoneme metric from perception data.
problem Learn metric for phoneme similarity from data.
method Learning algorithms to derive metric from behavioral data.
result Framework outperforms previous metrics in phoneme prediction.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “perceptual saliency”
New approach makes adversarial examples less suspicious without changing perceptual salience.
problem Robustness of deep neural networks to unsuspicious adversarial examples.
method Splitting images into foreground and background, allowing larger perturbations in background while maintaining low cognitive salience.
result Dual-perturbation attacks are effective against classifiers robust to conventional attacks and adversarial training yields more robust classifiers.
A method to combine saliency metrics for better CNN pruning decisions.
problem Improving CNN pruning decisions by combining multiple saliency metrics.
method Proposes a method to compose different saliency metrics for better CNN pruning decisions.
result The composition of saliencies avoids many poor pruning choices identified by individual saliencies.
The study evaluates saliency metrics for image classifier outputs, finding inconsistencies and unreliability.
problem Inconsistencies and unreliability in saliency metrics for evaluating pixel relevance.
method Investigated existing saliency metrics, calculated and compared their consistency, and applied psychometric testing methods.
result Saliency metrics can be statistically unreliable and inconsistent, affecting comparative rankings.
New hypothesis and method reduce noise in saliency maps.
problem Noisy saliency maps from deep neural networks.
method Proposed a new hypothesis and Rectified Gradient method.
result Rectified Gradient effectively reduces saliency map noise.
Convolutional-deconvolution networks can be adopted to perform end-to-end saliency detection. But, they do not work well with objects of multiple scales. To overcome such a limitation, in this work, we propose a recurrent attentional convolutional-deconvolution network (RACDNN). Using spatial transformer and recurrent …
DANCE improves saliency maps by adding subtle input variations.
problem Poor performance of saliency methods in saturated gradients, adversarial perturbations, and inter-feature dependence.
method Two-step procedure: 1) Perturbation mechanism, 2) Aggregation of saliency maps.
result DANCE saliency method outperforms existing methods qualitatively and quantitatively.
A taxonomy of saliency metrics helps in pruning deep neural networks.
problem Difficulty in separating saliency metric effectiveness from pruning algorithms.
method Proposed a taxonomy based on four orthogonal components.
result Constructed metrics can outperform existing state-of-the-art metrics.
XRAI improves saliency maps for deep neural networks.
problem Improving understanding of deep neural networks through better saliency methods.
method XRAI is a region-based attribution method built upon integrated gradients, with new evaluation methods and sanity checks.
result XRAI produces better results than other saliency methods for common models and the ImageNet dataset.
Study evaluates saliency maps on artificial data with different backgrounds.
problem Objective evaluation of saliency methods on artificial data with varying backgrounds.
method Developed a framework to generate artificial data with synthetic lesions and a known ground truth map, evaluated two data sets with different backgrounds (Perlin noise and 2D brain MRI slices).
result Heatmaps vary strongly between saliency methods and backgrounds.
Bayesian optimisation generates saliency maps for black-box models.
problem Generating saliency maps for models without access to parameters.
method Bayesian optimisation sampling method to find global salient regions.
result Approach outperforms grid-based methods and performs similarly to gradient-based methods.
When saliency goes off on a tangent: Interpreting Deep Neural Networks with nonlinear saliency mapscs.LG
New nonlinear saliency maps improve deep neural network interpretability.
problem Lack of understanding why and how deep neural networks make decisions.
method Developed novel nonlinear saliency maps to better interpret deep neural networks.
result Nonlinear saliency maps provide more specific drivers of classification on complex examples.
New method for visualizing high-level concepts in generative models.
problem Challenges in evaluating and visualizing concepts in generative models.
method Introduces a method to compute concept saliency maps for latent representations of known or novel high-level concepts.
result Concept saliency maps highlight input features important for high-level concepts.
Input-cell attention improves RNN saliency detection over time.
problem Vanishing saliency in RNNs makes them unreliable for detecting important features at arbitrary time intervals.
method Proposes input-cell attention, a novel RNN cell structure that uses a fixed-size matrix embedding to attend to different inputs from current or previous time steps.
result Input-cell attention produces a saliency map that can detect important features regardless of their occurrence in time.
In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model generalises well to unseen images and requires a single forward pass to perform …
The paper benchmarks saliency methods for time series predictions.
problem Benchmarking saliency methods for time series predictions.
method Compared saliency-based interpretability methods across diverse neural architectures.
result Saliency methods fail to reliably identify feature importance over time in time series data.
Study validates saliency maps of GNNs using selective inference.
problem Reliability of GNN saliency maps in graph-structured data.
method Statistical testing framework with selective inference to control Type I error rate.
result Valid -values for salient subgraphs, ensuring meaningful information.
Adversarial robust models have more interpretable saliency maps.
problem Understanding the relationship between adversarial robustness and saliency map interpretability.
method Quantifying the alignment between input images and saliency maps, hypothesizing and testing the relationship with linear and neural network models.
result The alignment between input images and saliency maps increases as the distance to the decision boundary grows, especially in linear models.
In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make decisions by identifying significant pixels for prediction. A model shows wrong classi…
New method improves interpretability of fMRI decoding models.
problem Uninterpretable deep neural networks in fMRI decoding.
method Adversarial training to make DNNs robust to noise and improved saliency map methods.
result Saliency maps from adversarial-trained DNNs are more interpretable than those from other methods.
The paper evaluates saliency methods for image predictions, finding some inadequate.
problem The reliability of saliency methods in explaining model predictions.
method Proposed a methodology to evaluate saliency methods based on their independence from model and data.
result Some saliency methods are independent of both model and data, making them inadequate for certain tasks.
New SSIM measure improves adversarial attacks' perceptual quality.
problem Lack of perceptual quality in traditional adversarial attacks.
method Replaced norms with SSIM measure for better quality.
result SSIM-constrained attacks achieve better quality and similar success rate.
A new LDA variant improves multi-label classification performance.
problem Improving multi-label classification performance.
method Saliency-based weights redefine between-class and within-class scatter matrices for multi-label classification.
result The proposed method leads to performance improvements in various multi-label classification problems.
Perceptual Kalman Filters: Online State Estimation under a Perfect Perceptual-Quality Constraintcs.LG
Perceptual Kalman filters maintain human-perceptual quality while processing data.
problem Maintaining human-perceptual quality in signal processing under temporal constraints.
method An optimal causal filtering approach under a perfect perceptual-quality constraint.
result Adding perceptual quality constraints introduces a dilemma that requires sacrificing MSE for temporal consistency.
Saliency methods aim to explain the predictions of deep neural networks. These methods lack reliability when the explanation is sensitive to factors that do not contribute to the model prediction. We use a simple and common pre-processing step ---adding a constant shift to the input data--- to show that a transformatio…
Method uses ANN to estimate incentive salience from large behavioral data.
problem Estimating incentive salience in naturalistic settings.
method Artificial Neural Networks (ANNs) for latent state approximation.
result ANNs produce better representations for predicting future behaviour.
New saliency evaluations focus on completeness and soundness, improving explanations.
problem Current saliency evaluations focus on completeness but ignore soundness.
method Introduces new intrinsic evaluation metrics based on completeness and soundness.
result Simple saliency method matches or outperforms prior methods in new evaluations.
New finding: Perceptually-aligned gradients occur in adversarially-robust classifiers.
problem Understanding adversarial robustness in neural networks.
method Investigated perceptual alignment in adversarially-trained and smoothed classifiers.
result Perceptually-aligned gradients are a general property of robust classifiers.
A simple fix helps saliency methods pass sanity checks.
problem Saliency methods fail simple sanity checks.
method Compute saliency maps for all labels, use competition to identify and remove less relevant pixels.
result CGI method is efficient, requires no additional training, and uses only the input and gradient.
Develops a new feature selection method using deep-learning saliency.
problem Lack of instance-level feature selection information.
method Saliency-based Feature Selection (SFS) method.
result SFS method provides instance-level feature selection information.
New method defends against unseen threat models using perceptual adversarial training.
problem Lack of precise mathematical characterization of human perception in adversarial attacks.
method Adversarial training against the set of all imperceptible adversarial examples approximated by deep neural networks.
result Perceptual Adversarial Training (PAT) achieves state-of-the-art robustness against multiple diverse adversarial attacks.
Puzzle Mix optimizes mixup by leveraging saliency and local statistics.
problem Overfitting and adversarial vulnerability of deep networks.
method Puzzle Mix alternates between multi-label and saliency-based objectives for optimal mixing masks.
result Puzzle Mix outperforms other mixup methods in generalization and adversarial robustness.
1-Lipschitz neural networks produce clearer, more focused Saliency Maps for explainable AI.
problem Noisy and limited Saliency Maps from traditional neural networks.
method Dual loss of optimal transport problem for 1-Lipschitz neural networks.
result Saliency Maps from 1-Lipschitz networks are highly concentrated and less noisy, aligning with human explanations.
Enhances counterfactual explanations with more valid and informative saliency maps.
problem Lack of valid counterfactual explanations in existing models.
method Introduces a modified approach to CELS model by removing mask normalization.
result Demonstrates higher validity and more informative counterfactual explanations.
Visualizes ConvNets without confounding effects.
problem Misinterpretation of saliency maps due to confounding variables.
method Univariate statistical tests and partial back-propagation to remove confounding effects.
result Visualization of confounder-free saliency maps.
Deep learning investigation for chess player attention prediction using eye-tracking and game datastat.ML
Deep learning predicts chess player attention using eye-tracking and game data.
problem Predicting chess player attention during game.
method Convolutional neural networks with skip-layer architecture and autoencoder.
result Deep features from natural images help in predicting saliency maps for chess.
Proposes a method to quantify the reliability of salient regions in deep learning models using p-values.
problem Difficulty in assessing the reliability of saliency maps generated by deep learning models.
method Proposes a selective inference framework to quantify the reliability of salient regions as selected hypotheses by deep learning models.
result The method can provably control the probability of false positive detections of salient regions.
Perceptual ad-blocking is vulnerable to attacks, creating new security risks.
problem Vulnerability of perceptual ad-blocking to attacks and new security risks.
method Analysis and creation of adversarial examples to bypass perceptual ad-blocking.
result Perceptual ad-blocking can be bypassed using adversarial examples, introducing new security risks.
New tool for interpreting neural nets, explaining model behavior.
problem Interpreting neural network responses and explaining model behavior.
method Full-Gradient representation and FullGrad saliency map approximation.
result FullGrad method explains model behavior more comprehensively and accurately than other methods.
Neural network classifies breast cancer lesions using global and local image features.
problem Classifying breast cancer lesions in medical images with high resolution and small regions of interest.
method Proposes a neural network that combines global saliency maps and local patches for pixel-level saliency maps.
result Achieves radiologist-level performance in screening mammography interpretation.
Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To address this problem, we propose classifier-agnostic saliency map extraction, which fi…
Study shows perceptual boost of visual attention varies with task difficulty and size.
problem Understanding how task-dependent the perceptual boost of visual attention is in natural settings.
method Designed and trained neural networks on various visual tasks, comparing results to baseline.
result Perceptual boost of attention is stronger with more difficult tasks and weaker with larger task sets.
This work introduces a new threat model for adversarial attacks using perceptual metrics.
problem Insufficient threat models for capturing imperceivable adversarial examples.
method Leverage quantitative perceptual metrics (LPIPS, SSIM) to define a novel threat model.
result Combined attacks retain perceptual distortion but induce higher misclassification rates.
PerceptNet: Learning Perceptual Similarity of Haptic Textures in Presence of Unorderable Tripletscs.LG
PerceptNet learns haptic signal similarity using human data.
problem Designing haptic icons requires accurate perceptual similarity estimation.
method Deep neural network projecting signals to an embedding space with a triplet loss.
result Our method effectively models perceptual dissimilarity compared to alternatives.
A new data-level recombination strategy improves RGB-D salient object detection.
problem RGB-D salient object detection struggles with depth information.
method Proposes a novel data-level recombination strategy to fuse RGB and depth data before feature extraction.
result Achieves a new state-of-the-art performance in RGB-D salient object detection.
Enhanced deep learning model improves tumor segmentation in ultrasound images.
problem Challenges in integrating patient-specific medical priors into deep learning models.
method Integrates visual saliency into a U-Net architecture with attention blocks.
result Achieved a Dice similarity coefficient of 90.5 percent on a dataset of 510 images.
Develops methods to show model confidence and feature importance in medical imaging.
problem Ensuring safety and understanding model confidence in medical applications.
method Creates a pipeline to visualize uncertainty and saliency maps for deep neural networks.
result Demonstrates how deep neural networks can be made more transparent and safe for medical applications.
Local and Global Explanations of Agent Behavior: Integrating Strategy Summaries with Saliency Mapscs.LG
Combining global and local explanations improves user understanding of RL agents.
problem Challenges in explaining agent behavior due to large state spaces and delayed rewards.
method Integrating strategy summaries with saliency maps to provide both global and local explanations.
result Summaries including important states significantly improve user understanding of RL agents.