Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that popular feature attribution methods are inconsistent, meaning they can lower a featur…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “SHAP attribution”
SHAP Distance assesses semantic fidelity of synthetic tabular data.
problem Semantic fidelity of synthetic tabular data is not well evaluated.
method SHAP Distance, defined as cosine distance between global SHAP attribution vectors.
result SHAP Distance detects semantic discrepancies overlooked by standard measures.
This paper analyzes SHAP values using Fourier expansions for model interpretability.
problem Understanding and interpreting SHAP values in complex models.
method Developed a spectral framework using Fourier expansions for SHAP values in various model regimes.
result SHAP values are Lipschitz continuous in the deterministic regime and converge to Gaussian process values in the probabilistic regime.
This research simplifies computation of feature attribution methods under certain conditions.
problem Computational complexity of feature attribution methods, especially power indices.
method Identifying conditions for polynomial computation and introducing new indices.
result Conditions for efficient computation of feature attribution methods are identified.
RKHS-SHAP uses Shapley values for kernel methods to provide feature attributions.
problem Feature attribution for kernel methods is often heuristic and not individualised.
method RKHS-SHAP uses Shapley values from coalition game theory to compute feature attributions for kernel machines efficiently.
result RKHS-SHAP can compute both Interventional and Observational Shapley values.
Study evaluates consistency of feature attribution in deep learning for multi-omics data.
problem Challenges in interpretability of deep learning models in biological research.
method Investigation of Shapley Additive Explanations (SHAP) on multi-view deep learning models applied to multi-omics data.
result SHAP rankings are sensitive to architecture and random initialization, suggesting caution.
Paper proposes efficient SHAP computation methods.
problem Efficient computation of SHAP values for machine learning models.
method Develops polynomial time methods for SHAP computation based on model structure.
result Exact SHAP computation in polynomial time for various model structures.
RoSHAP stabilizes feature attribution in machine learning models.
problem Stochastic variation in feature attribution measures.
method Modeling feature attribution score distribution and estimating it through bootstrap resampling and kernel density estimation.
result RoSHAP provides stable feature rankings and improves model performance.
Study shows safely discarding features based on aggregate SHAP values is sound.
problem Discarding features based on aggregate SHAP values without proper justification.
method Investigated the soundness of discarding features based on aggregate SHAP values, proposing to aggregate SHAP values over the extended support.
result A small aggregate SHAP value implies safely discarding the corresponding feature.
A framework to explain decoder-only sequence classification models using intermediate predictions.
problem Explaining predictions of decoder-only sequence classification models.
method Progressive Inference framework with Single Pass-Progressive Inference and Multi Pass-Progressive Inference methods.
result Significantly better attributions compared to prior work on text classification tasks.
No feature ranking can be faithful, stable, and complete when features are collinear.
problem The impossibility of creating a feature ranking that is simultaneously faithful, stable, and complete when features are collinear.
method Proving the impossibility, quantifying it for four model classes, resolving it via ensemble averaging (DASH), and machine-verifying it with Lean 4 theorems.
result No method lies outside the dichotomy of faithful-complete methods (unstable, with rankings that flip up to 50% of the time) and ensemble methods (stable, reporting ties for symmetric features).
New framework for fairness in machine learning models using SHAP values and adversarial learning.
problem Fairness of model predictions, especially for unprivileged groups.
method Develops a new fairness definition and a framework using SHAP values and adversarial learning to mitigate bias.
result Models produced are fairer and performant, demonstrating the approach on various datasets.
Note that a newer expanded version of this paper is now available at: arXiv:1802.03888 It is critical in many applications to understand what features are important for a model, and why individual predictions were made. For tree ensemble methods these questions are usually answered by attributing importance values to i…
The paper develops statistical inference methods for SHAP values.
problem Lack of statistical inference for SHAP values in model-agnostic feature importance.
method Semi-parametric approach using U-statistics and Neyman orthogonal scores for functionals of nested regressions.
result Asymptotically normal estimates of the pth powers of SHAP values for various p.
Unified framework for linear attribution methods in deep learning.
problem Separate theoretical foundations of XAI attribution methods.
method GRALIS (Gradient-Riesz Averaged Locally-Integrated Shapley) framework.
result Unified representation theory for linear attribution methods.
Study predicts soccer player market values using machine learning and SHAP for interpretability.
problem Predicting accurate market values for professional soccer players.
method Ensemble machine learning models, SHAP for interpretability, Boruta for feature selection.
result GBDT model achieved high predictive accuracy (R-squared 0.901, RMSE 3,221,632.175).
New framework improves attribution of predictive uncertainties in classification models.
problem Improper attribution of predictive uncertainties in classification tasks.
method Combines path integrals, counterfactual explanations, and generative models.
result Framework outperforms existing alternatives in quantitative evaluations.
Enhances local explainability and trust scores using RF proximities.
problem Improving local explainability and trust in random forest models.
method Rewriting RF predictions as weighted sums of training targets using proximities.
result Proximities provide a novel method to assess model predictions' correctness.
Proposes simplified SHAP for faster black-box model explanations.
problem Computational expense of SHAP for models with many features.
method Ensemble of random SHAPs with feature selection and point generation.
result Efficiency and properties demonstrated through numerical experiments.
SHAP explains boosted trees with additively modeled features.
problem Explaining predictions of boosted trees models with additively modeled features.
method SHAP values for additively modeled features in boosted trees models.
result SHAP dependence plot matches partial dependence plot for additively modeled features.
Proposes -table for statistical SHAP explanations in regression models.
problem Lack of clear directional summaries, uncertainty, and fidelity in SHAP feature importance.
method SHAP importance selection, fitting a standardized linear surrogate, reporting coefficients, uncertainty, fidelity, and stability.
result Extends SHAP into a statistical global explanation with direction, uncertainty, fidelity, and stability.
A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game theory. While existing papers focus on the axiomatic motivation of Shapley values…
X-SHAP assesses multiplicative variable contributions in machine learning models.
problem Understanding multiplicative interactions in machine learning models.
method Model-agnostic method that extends SHAP to assess multiplicative contributions.
result X-SHAP proves useful in capturing multiplicative feature importance.
XAI-Bench releases synthetic datasets for evaluating feature attribution methods.
problem Evaluating and comparing feature attribution methods is challenging.
method Released synthetic datasets and benchmarking library.
result Efficiently evaluates feature attribution methods across various metrics.
Enhanced loss function boosts fraud detection in auto insurance claims.
problem Class imbalance in auto insurance fraud detection.
method Structured three-stage training framework integrating convex surrogate, non-convex intermediate, and standard focal loss.
result Improves minority-class F1-scores and AUC compared to baseline methods.
An imprecise SHAP method explains class probabilities with limited data.
problem Explaining class probabilities with limited training data.
method New approach for computing feature marginal contributions and general approach to interval-valued Shapley values.
result The imprecise SHAP method improves explanation of class probabilities.
LLMs can help explain credit risk models but not autonomously.
problem Leveraging LLMs for post-hoc explainability in credit risk models.
method Comparison of LLM outputs with SHAP and coefficient-based attributions on three LMs.
result LLMs reliably preserve feature-importance rankings but poorly align with autonomous explanations.
New findings show local attributions can't be both robust and provide recourse.
problem Ensuring machine learning systems are accountable and provide actionable recourse options.
method Formal definition of recourse sensitivity and counterexamples for popular attribution methods.
result It is impossible for any single attribution method to be both robust and provide recourse.
Data-driven advice for interpreting local and global model predictions in bioinformatics problemsstat.ML
New methods compare local and global feature importance scores for bioinformatics models.
problem Improving feature importance estimation in tree-based models.
method Comparison of SHAP values and Conditional Feature Contributions (CFCs) for 164 bioinformatics problems.
result SHAP values and CFCs yield similar rankings and interpretations for random forests.
A neural network approach for efficient conditional SHAP calculations.
problem Efficiently calculating conditional SHAP values for various models.
method Surrogate neural network approach for conditional SHAP.
result Efficiently calculates conditional SHAP values for neural networks and other regression models.
The paper explores SHAP scores and their connection to functional ANOVA, highlighting challenges in approximations.
problem Estimating SHAP scores and understanding their limitations.
method Using the connection to functional ANOVA, the paper outlines the challenges in SHAP approximations and their relation to feature distribution and ANOVA terms.
result Challenges in SHAP approximations are primarily due to feature distribution and the number of ANOVA terms estimated.
G-SHAP generates multiple types of explanations for machine learning models.
problem Understanding model predictions and their differences across groups.
method Generalization of SHAP method to produce additional types of explanations.
result G-SHAP produces explanations for classification, intergroup differences, and model failure.
mSHAP explains predictions of two-part models, improving fairness and interpretability.
problem Interpreting predictions from two-part models, especially in insurance.
method mSHAP: a method for computing SHAP values of two-part models using the SHAP values of individual models.
result mSHAP is exponentially faster than kernelSHAP for computing approximate SHAP values.
CatNet controls FDR in LSTM models using SHAP feature importance and Gaussian mirrors.
problem Controlling False Discovery Rate (FDR) in LSTM models with feature selection.
method CatNet uses SHAP values for feature importance and Gaussian Mirror algorithm for FDR control. It introduces a kernel-based independence measure to handle feature correlations.
result CatNet reduces overfitting and improves model interpretability on simulated and real-world data.
New method explains survival analysis models using median-SHAP.
problem Need for explainable AI in medical applications, especially for survival analysis.
method Introduces median-SHAP for explaining survival analysis models.
result Conventionally used mean anchor point can lead to misleading interpretations; median-SHAP provides a better approach.
SX-GeoTree improves spatially coherent explanations in geospatial regression trees.
problem Capturing spatial dependence and producing robust explanations in tabular prediction models.
method Integrates three objectives: impurity reduction, spatial residual control, and explanation robustness via modularity maximization on a consensus similarity network.
result Improves residual spatial evenness and doubles attribution consensus (modularity: Fujian 0.19 vs 0.09; Seattle 0.10 vs 0.05).
Study evaluates SHAP for credit card default model consistency.
problem Model transparency and fairness in credit card default prediction models.
method Evaluates SHAP stability in credit card default prediction models via a case study.
result SHAP consistency is related to variable importance level.
Neural networks predict US recessions with SHAP method.
problem Forecasting US recessions using machine learning.
method Long short-term memory (LSTM) and gated recurrent unit (GRU) models compared to linear models. SHAP method applied for interpretation.
result Neural networks can capture business cycle asymmetries and nonlinearities.
The paper uses SHAP for interpreting machine learning models in hospital data.
problem Interpreting machine learning models in healthcare.
method SHAP for feature importance and feature packing techniques.
result SHAP provides better interpretability of machine learning models in healthcare.
New method uses SHAP for biomarker identification in CATE models.
problem Identifying predictive biomarkers from observational data.
method Surrogate estimation approach using SHAP values for CATE meta-learners.
result SHAP accurately identifies biomarkers in high-dimensional data.
Instantly interprets black-box models using additive models.
problem Efficiency and representation power of SHAP explanations.
method Variational perspective linking GAM models and SHAP explanations; InstaSHAP method.
result Automatic computation of Shapley values in a single forward pass.
SHAP clustering explains model predictions by grouping similar feature contributions.
problem Lack of explainability in black-box models.
method SHAP values for feature contributions, supervised clustering of SHAP values.
result Insight into pathways leading to similar predictions.
New Fourier analysis method for non-uniform Boolean hypercube.
problem Non-uniform probability measures on the Boolean hypercube.
method ANOVA-based decomposition, explicit basis, least squares problem.
result Generalization of Fourier analysis for arbitrary probability measures.
Two XAI methods, SHAP and LIME, are discussed for tabular data models.
problem Making machine learning models transparent and trustworthy.
method SHAP and LIME methods for explaining model predictions.
result SHAP and LIME are model-dependent and sensitive to feature collinearity.
In the past years, many new explanation methods have been proposed to achieve interpretability of machine learning predictions. However, the utility of these methods in practical applications has not been researched extensively. In this paper we present the results of a human-grounded evaluation of SHAP, an explanation…
New methods ensure feature importance rankings are correct with high probability.
problem Stability issues in feature importance scores due to random sampling.
method Hypothesis testing-based techniques to assess and verify the stability of top-ranked features.
result Ensures the most important features are correct with high-probability guarantees.
We solve the ANOVA decomposition for categorical inputs.
problem Lack of a closed-form expression for ANOVA decomposition with categorical dependent variables.
method Bridge functional analysis with discrete Fourier analysis to derive a closed-form decomposition.
result Closed-form decomposition for categorical inputs without assumptions.
RESHAPE explains financial statement anomalies by aggregating explanations from AENNs.
problem Detecting and explaining accounting anomalies in financial audits is challenging.
method Proposes RESHAPE to explain model output on an aggregated attribute-level.
result RESHAPE provides more comprehensible explanations compared to existing methods.