We introduce a new method to explain Gaussian processes using Shapley values.
problem Explaining the uncertainty in Gaussian process models.
method Extending Shapley values to stochastic cooperative games for Gaussian processes.
result Our method generates explanations that are random variables and satisfy favorable axioms.
New insights on Shapley value precision for tabular data predictions.
problem Precision of Shapley value explanations for individual observations.
method Conditional Shapley value estimation methods for tabular data.
result Shapley value explanations are less precise for outer observations.
Shapley values for feature importance lead to mathematical and practical issues.
problem Mathematical and practical issues with Shapley values for feature importance.
method Game-theoretic formulations of feature importance using Shapley values.
result Mathematical problems arise when using Shapley values for feature importance.
ManifoldShap improves model explanations by restricting evaluations to the data manifold.
problem Inaccurate and misleading model explanations due to reliance on out-of-distribution data.
method Restricts model evaluations to the data manifold to avoid off-manifold perturbations.
result ManifoldShap provides more accurate and intuitive explanations than existing methods.
Pref-SHAP explains preferences using Shapley values.
problem Challenging problem of preference explanation in machine learning.
method Shapley value-based model explanation framework for pairwise comparison data.
result Richer and more insightful explanations obtained over baseline.
A new method simplifies feature explanation for complex models.
problem Explain predictions from complex models efficiently with many features.
method groupShapley: groups features for Shapley value computation.
result Equivalent to summing feature-wise Shapley values within groups.
Mathematical proofs for Shapley explanations clarify their properties.
problem Clarify the essential axioms and properties of Shapley values in machine learning.
method Mathematical rigor and axiomatic characterization.
result The symmetry axiom is essential for Shapley values, contradicting Lundberg and Lee's claim.
Improved Shapley Values for tree-based models, more accurate than existing methods.
problem Inaccurate Shapley Values in tree-based models leading to poor explanations.
method Introduced two new estimators exploiting tree structure, derived correct approach for categorical variables.
result More accurate Shapley Values for tree-based models, demonstrated through simulations.
A method uses Shapley values and Mahalanobis distances to explain multivariate outliers.
problem Explaining multivariate outlyingness in data.
method Decomposing squared Mahalanobis distance using Shapley values.
result Shapley values provide variable contributions to outlying observations.
FastSHAP speeds up Shapley value estimation for black-box models.
problem Efficiently calculating Shapley values for complex models.
method Uses a learned explainer model in a single forward pass.
result Generates high-quality explanations with significant speedup.
The paper explores how Shapley value for a feature can vary based on model outcomes and feature distribution.
problem The uniqueness of Shapley value in explaining model predictions.
method Analyzes the relationship between feature distribution and Shapley value, and compares Shapley values for different model outcomes.
result Shapley value for a feature depends on more than just its mean and can vary significantly based on model outcome.
Paper compares two local explanation methods for machine learning models.
problem Comparing two local explanation methods for machine learning models.
method Integrated Gradients and Baseline Shapley methods.
result Additional insights on comparative behavior for tabular data and neural networks.
New methods for estimating conditional Shapley values compared and evaluated.
problem Estimating precise conditional Shapley values for tabular data models.
method Developed new and extended methods using Monte Carlo integration and regression.
result Recommendations for choosing between Monte Carlo and regression methods based on data distribution.
The paper proposes criteria and methods for evaluating and aggregating feature-based model explanations.
problem Lack of quantitative evaluation criteria for feature-based model explanations.
method Developed quantitative evaluation criteria (low sensitivity, high faithfulness, low complexity), devised a framework for aggregation, and derived a new aggregate Shapley value explanation function.
result A new aggregate Shapley value explanation function that minimizes sensitivity.
Develops Shapley explainability solutions respecting data manifold.
problem Tenable assumption of uncorrelated features in Shapley explainability.
method Two solutions: generative modelling and direct learning of Shapley value-function.
result On-manifold Shapley explainability overcomes drawbacks of 'off-manifold' values.
DistShap parallelizes GNN explanation for large graphs.
problem Computational expense in attributing GNN predictions to specific edges or features.
method Distributed Shapley values across multiple GPUs for scalable GNN explanations.
result DistShap outperforms existing methods and scales to models with millions of features.
Paper uses VAEAC to estimate Shapley values for complex models with mixed features.
problem Estimating Shapley values for models with dependent mixed features.
method Uses variational autoencoder with arbitrary conditioning (VAEAC) to model feature dependencies.
result VAEAC approach outperforms state-of-the-art methods for various settings.
New method uses SHapley Additive Explanations to identify anomaly detectors with complementary behaviors.
problem Challenges in unsupervised anomaly detection due to diverse data distributions and lack of labels.
method Characterize anomaly detectors using SHapley Additive Explanations to measure feature importance and similarity.
result Detectors with similar explanations produce correlated anomaly scores, while those with divergent explanations are complementary.
G-SHAP generates multiple types of explanations for machine learning models.
problem Understanding model predictions and their differences across groups.
method Generalization of SHAP method to produce additional types of explanations.
result G-SHAP produces explanations for classification, intergroup differences, and model failure.
Paper uses Shapley values to explain how clusters of training data affect predictions.
problem Explaining how training data clusters impact predictions from black-box models.
method Extends Shapley values to cluster importance, using coalitional game theory.
result Shows how different clusters of training data contribute to model predictions.
Paper identifies problematic baselines in Shapley value explanations and proposes a reweighting mechanism.
problem Identifying and addressing the suboptimality of baselines in Shapley value feature importance analysis.
method Analyzed suboptimality of baselines, identified problematic baseline, generalized uninformativeness, and designed a reweighting mechanism.
result Proposed uncertainty-based reweighting mechanism effectively accelerates computation and improves explanation quality.
The paper adds explanation to predictive process monitoring.
problem Equipping predictive business process monitoring with explanation capabilities.
method Used game theory of Shapley Values to obtain robust explanations.
result First time explanations given in predictive business process monitoring.
Proposes simplified SHAP for faster black-box model explanations.
problem Computational expense of SHAP for models with many features.
method Ensemble of random SHAPs with feature selection and point generation.
result Efficiency and properties demonstrated through numerical experiments.
Study shows group structures are crucial for financial model explanations.
problem Inconsistent explanations from existing explainable machine learning methods.
method Examined group structures in financial datasets and developed group versions of Shapley values.
result Group versions of Shapley values provide consistent explanations.
This paper analyzes errors in Shapley value-based model explanations.
problem Biased or unreliable explanations from existing SVA methods.
method Error theoretical analysis framework decomposing errors into observation and structural biases.
result Trade-off between observation and structural biases in SVA explanations.
SVEHNN explains DNN diagnoses of Alzheimer's disease from neuroanatomy and biomarkers.
problem Interpreting deep neural networks for medical diagnosis, especially in the clinic.
method Shapley Value Explanation of Heterogeneous Neural Networks (SVEHNN) for local explanations.
result SVEHNN provides interpretable explanations for DNN diagnoses with reduced runtime.
Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values is a game theoretic concept that can be used for this purpose. The Shapley valu…
PWSHAP provides targeted explanations for complex models.
problem Inability of black-box models to explain targeted effects in sensitive domains.
method Augments model with DAG, uses Shapley values for causal pathway identification.
result Establishes error bounds and demonstrates resolution, interpretability, and locality.
The paper explains credit decisions using Shapley decomposition for adverse actions.
problem Identifying predictors responsible for adverse credit decisions.
method Develops a simple and intuitive approach based on Shapley decomposition for models with low-order interactions.
result Shows the approach generalizes to Shapley decomposition and Baseline Shapley.
New method improves model explainability.
problem Improper model explanations fail to reflect true data-generating process.
method Shapley Marginal Surplus for Strong Models
result Significant outperformance in inferential capabilities.
SurvFD and SurvSHAP-IQ provide interpretable survival models by analyzing feature interactions.
problem Non-additivity of hazard and survival functions limits standard additive explanation methods.
method SurvFD decomposes higher-order effects into time-dependent and time-independent components, extending Shapley interactions to time-indexed functions.
result SurvFD and SurvSHAP-IQ offer a new perspective on survival explanations, explicitly characterizing feature interactions.
Shapley values criticized for feature selection, leading to new insights.
problem Using Shapley values for feature selection is problematic.
method Introduced and critiqued Shapley values as feature selection tools, using counterexamples and simulations.
result Shapley values may not always align with feature selection goals.
RESHAPE explains financial statement anomalies by aggregating explanations from AENNs.
problem Detecting and explaining accounting anomalies in financial audits is challenging.
method Proposes RESHAPE to explain model output on an aggregated attribute-level.
result RESHAPE provides more comprehensible explanations compared to existing methods.
Introduces joint Shapley values to measure feature importance in models.
problem Measuring the importance of feature sets in machine learning models.
method Extends Shapley's axioms to measure a set of features' average contribution to a model's prediction.
result Joint Shapley values provide unique insights and are more consistent with local intuitions.
A new method explains mixed features for predictive models using conditional inference trees.
problem Explaining complex machine learning models with mixed features.
method Proposes a method to explain mixed features (continuous, discrete, ordinal, categorical) using conditional inference trees.
result Our method often outperforms current industry standards in various simulation studies and real-world financial data.
ControlSHAP stabilizes Shapley value approximations using control variates.
problem High computational cost of exact Shapley values in blackbox models.
method ControlSHAP uses Monte Carlo control variates to stabilize Shapley value approximations.
result Significant reduction in Monte Carlo variability of Shapley estimates.
Unified framework for feature-based explanations using ANOVA and game theory.
problem Differences between feature-based explanations methods limit their applicability.
method Introduces a unified framework combining fANOVA and cooperative game theory.
result Uncovered similarities and differences between various explanation techniques.
Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its precise, rigorous foundation: it provides a common, model-agnostic language for AI e…
New methods using vine copulas improve accuracy of feature dependence in predictive models.
problem Inaccurate feature dependence assumptions in Shapley values lead to incorrect explanations.
method Proposed two new approaches based on vine copulas to model feature dependence.
result Vine copula approaches give more accurate approximations to true Shapley values.
Instantly interprets black-box models using additive models.
problem Efficiency and representation power of SHAP explanations.
method Variational perspective linking GAM models and SHAP explanations; InstaSHAP method.
result Automatic computation of Shapley values in a single forward pass.
The paper develops statistical inference methods for SHAP values.
problem Lack of statistical inference for SHAP values in model-agnostic feature importance.
method Semi-parametric approach using U-statistics and Neyman orthogonal scores for functionals of nested regressions.
result Asymptotically normal estimates of the pth powers of SHAP values for various p.
An imprecise SHAP method explains class probabilities with limited data.
problem Explaining class probabilities with limited training data.
method New approach for computing feature marginal contributions and general approach to interval-valued Shapley values.
result The imprecise SHAP method improves explanation of class probabilities.
SISR improves feature attribution in complex payoff schemes.
problem Distorted feature attributions due to non-additive payoff functions and high-dimensional feature spaces.
method Sparse Isotonic Shapley Regression (SISR) learns a monotonic transformation to restore additivity and enforces L0 sparsity.
result SISR achieves strong support recovery and stable attributions across various payoff schemes.
A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game theory. While existing papers focus on the axiomatic motivation of Shapley values…
Study examines explainable machine learning for monotonic models, finding Integrated gradients better for strong monotonicity.
problem Applying explainable machine learning to science-informed models.
method Proposed axioms for monotonicity, tested Shapley value and Integrated gradients methods.
result Integrated gradients provides better explanations for strong monotonicity.
Study proposes explainable analytics for manufacturing process planning.
problem Improving data-driven decision-making in manufacturing.
method Combines process mining, machine learning, and XAI. Uses deep learning for prediction and Shapley values/ICE plots for explanations.
result Enhanced decision-making capabilities through local post-hoc explanations.
Method finds counterfactual explanations for random forest models.
problem Limited interpretability of random forest models in regulated industries.
method Similarity learning exploiting random forest's feature representation.
result Generated explanations are sparser and more useful than Shapley values.
Improved local feature attributions using neighbourhood reference distributions.
problem Misleading results from global population in local model behaviour.
method Formulation of neighbourhood reference distributions and self-normalised importance sampling.
result Neighbourhood Shapley values provide meaningful sparse feature attributions.