Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

336598130 · Jun 202019922001200920172026
48 results for black-box attribution

Proposes a method for explaining black-box models with nested feature attributions.

problem Making black-box models transparent and trustworthy.
method Model-agnostic local explanation method exploiting nested feature structure and consistency property.
result Accurate and consistent HiFAs and LoFAs estimated using fewer model queries.

We interpret black box predictive models using causal attribution.

problem Interpreting models trained using machine learning in high-stakes applications.
method Estimate causal effects of model inputs on output using observational data.
result Effective interpretation of black box predictive models via causal attribution.

WCAM assesses neural network reliability by attributing decisions to wavelet scales.

problem Challenges in evaluating neural network reliability and feature robustness.
method Introduces WCAM, a wavelet-based attribution method to assess decision reliability.
result WCAM reveals where and on what scales a model focuses, enabling reliable decision assessment.

Multi-party machine learning leaks global dataset properties even with black-box access.

problem Leakage of global dataset properties in multi-party machine learning.
method Demonstrated leakage of sensitive attribute distributions in pooled data.
result A curious party can infer sensitive attribute distributions in other parties' data with high accuracy.

Data-trained predictive models see widespread use, but for the most part they are used as black boxes which output a prediction or score. It is therefore hard to acquire a deeper understanding of model behavior, and in particular how different features influence the model prediction. This is important when interpreting…

2016-02-23abs ↗pdf ↗

PredDiff measures prediction changes while marginalizing features, offering new insights into interaction effects.

problem Understanding interaction effects in black-box models.
method Model-agnostic, local attribution method based on probability theory.
result Introduced a new measure for interaction effects between arbitrary feature subsets.

Our work investigates disagreement in neural network feature attribution methods.

problem Disagreement among feature attribution methods for neural networks.
method Investigates the fundamental and distributional behavior of feature attribution methods.
result Illustrates the impact of scaling and encoding techniques on explanation quality.

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary information or make the system more vulnerable. This work shows that such attri…

2017-11-06abs ↗pdf ↗

Machine learning algorithms are increasingly involved in sensitive decision-making process with adversarial implications on individuals. This paper presents mdfa, an approach that identifies the characteristics of the victims of a classifier's discrimination. We measure discrimination as a violation of multi-differenti…

2019-03-18abs ↗pdf ↗

Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two new approaches and corresponding packages for such attribution, namely live and …

2018-04-05abs ↗pdf ↗

New method interprets deep neural networks for better recommendation system understanding.

problem Making deep neural networks explainable for better user trust and understanding.
method Proposes a novel formulation of interpretable deep neural networks using masked weights and hidden features.
result Demonstrates models achieving close predictive performance with informative attributions.

Attributed graphs, which contain rich contextual features beyond just network structure, are ubiquitous and have been observed to benefit various network analytics applications. Graph structure optimization, aiming to find the optimal graphs in terms of some specific measures, has become an effective computational tool…

2019-05-31abs ↗pdf ↗

Interpretable ML methods for better decision-making with explanations.

problem Lack of transparency in black-box ML models.
method Use of Formal Concept Analysis and cooperative game theory to assess attribute importance and reduce attribute count.
result Developed methods to assess attribute importance and reduce attribute count in ML models.

In this paper we propose a method to obtain global explanations for trained black-box classifiers by sampling their decision function to learn alternative interpretable models. The envisaged approach provides a unified solution to approximate non-linear decision boundaries with simpler classifiers while retaining the o…

2018-11-19abs ↗pdf ↗

CD-RCA method identifies causal relationships in prediction errors without predefined graphs.

problem Challenges in diagnosing prediction errors due to lack of transparency in black-box models.
method Causal-Discovery-based Root-Cause Analysis (CD-RCA) method that estimates causal relationships without predefined causal graphs.
result CD-RCA outperforms heuristic attribution methods in identifying variable contributions to prediction errors.

Face recognition models can be inferred from student models, posing privacy risks.

problem Privacy threats in transfer learning models for face recognition.
method Membership inference attacks and attribute inference from aggregate-level information.
result Sensitive attributes can be inferred from student models, even with limited auxiliary information.

This research discovers model architecture and training dataset characteristics through strategic input probing.

problem Discovering model architecture and training dataset characteristics in black box models.
method Structured input probes and model outputs are used to train a deep classifier for image and text classification.
result The approach successfully distinguishes between different image and text datasets and architectures.

Deep learning techniques are rapidly advanced recently, and becoming a necessity component for widespread systems. However, the inference process of deep learning is black-box, and not very suitable to safety-critical systems which must exhibit high transparency. In this paper, to address this black-box limitation, we …

2019-03-13abs ↗pdf ↗

While great progress has been made at making neural networks effective across a wide range of visual tasks, most models are surprisingly vulnerable. This frailness takes the form of small, carefully chosen perturbations of their input, known as adversarial examples, which represent a security threat for learned vision …

2019-06-10abs ↗pdf ↗

Signed Evidence Flow (SEF) combines fitted prediction with signed feature attributions to measure evidence conflict and stability.

problem Modern data analysis lacks mechanisms to show the clarity, conflict, or stability of evidence behind predictions.
method Signed Evidence Flow (SEF) combines fitted prediction with signed feature attributions.
result SEF measures conflict and stability, and shows that conflict can improve loss prediction beyond confidence.

Study examines XAI methods for ECG analysis to improve model transparency.

problem Lack of transparency in deep learning models for ECG analysis.
method Investigates post-hoc XAI methods for local and global perspectives, establishes sanity checks, and demonstrates knowledge discovery.
result Quantitative evidence supports expert rules for sensible attribution methods and demonstrates XAI's utility for knowledge discovery.

Reduces risk of model inversion by reducing sensitive feature influence.

problem Model inversion attacks reveal sensitive individual data from trained models.
method Privacy-guided training to reduce sensitive feature influence in tree-based models.
result Training models to reduce sensitive feature influence reduces the risk of inference attacks.

Most accurate recommender systems are black-box models, hiding the reasoning behind their recommendations. Yet explanations have been shown to increase the user's trust in the system in addition to providing other benefits such as scrutability, meaning the ability to verify the validity of recommendations. This gap bet…

2016-06-22abs ↗pdf ↗

Study shows explanation disparities in machine learning models are influenced by data and model properties.

problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.

Proposes a Taylor framework to unify and analyze attribution methods.

problem Lack of a unified guideline for feature contribution assignment in machine learning models.
method Introduces a Taylor attribution framework to model the attribution problem and reformulates fourteen mainstream methods.
result Empirically validates the Taylor reformulations and reveals a positive correlation between performance and principles followed.