Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4183124165 · May 202619922001200920172026
48 results for SHAP scores

The paper explores SHAP scores and their connection to functional ANOVA, highlighting challenges in approximations.

problem Estimating SHAP scores and understanding their limitations.
method Using the connection to functional ANOVA, the paper outlines the challenges in SHAP approximations and their relation to feature distribution and ANOVA terms.
result Challenges in SHAP approximations are primarily due to feature distribution and the number of ANOVA terms estimated.

Study shows safely discarding features based on aggregate SHAP values is sound.

problem Discarding features based on aggregate SHAP values without proper justification.
method Investigated the soundness of discarding features based on aggregate SHAP values, proposing to aggregate SHAP values over the extended support.
result A small aggregate SHAP value implies safely discarding the corresponding feature.

XGBoost fails to accurately identify relevant features, while interpretable methods do.

problem Accurately identifying relevant features in black-box models like XGBoost.
method Comparison of variable importance methods (CART, Optimal Trees, XGBoost, SHAP) across various experiments.
result Interpretable methods outperform black-box models in feature selection accuracy.

Proposes approximating computationally expensive explainability techniques using conformal regression.

problem Computational expense of score-based explainability techniques limits their applicability in time-critical contexts.
method Uses conformal prediction framework to approximate SHAP and TreeSHAP explanations.
result Significantly improves execution time and produces tight validity guarantees.

New framework for fairness in machine learning models using SHAP values and adversarial learning.

problem Fairness of model predictions, especially for unprivileged groups.
method Develops a new fairness definition and a framework using SHAP values and adversarial learning to mitigate bias.
result Models produced are fairer and performant, demonstrating the approach on various datasets.

The paper develops statistical inference methods for SHAP values.

problem Lack of statistical inference for SHAP values in model-agnostic feature importance.
method Semi-parametric approach using U-statistics and Neyman orthogonal scores for functionals of nested regressions.
result Asymptotically normal estimates of the pth powers of SHAP values for various p.

In the past years, many new explanation methods have been proposed to achieve interpretability of machine learning predictions. However, the utility of these methods in practical applications has not been researched extensively. In this paper we present the results of a human-grounded evaluation of SHAP, an explanation…

2019-07-07abs ↗pdf ↗

New methods compare local and global feature importance scores for bioinformatics models.

problem Improving feature importance estimation in tree-based models.
method Comparison of SHAP values and Conditional Feature Contributions (CFCs) for 164 bioinformatics problems.
result SHAP values and CFCs yield similar rankings and interpretations for random forests.

Study shows how financial report sentiment impacts bank profitability.

problem Understanding causal effects of financial report sentiment on bank profitability.
method Causal forest machine learning methodology, FinancialBERT sentiment scores, SHAP analysis, comprehensive dataset.
result Statistically significant causal associations between balance sheet and expense management variables and profitability.

Proposes φφ-table for statistical SHAP explanations in regression models.

problem Lack of clear directional summaries, uncertainty, and fidelity in SHAP feature importance.
method SHAP importance selection, fitting a standardized linear surrogate, reporting coefficients, uncertainty, fidelity, and stability.
result Extends SHAP into a statistical global explanation with direction, uncertainty, fidelity, and stability.

An imprecise SHAP method explains class probabilities with limited data.

problem Explaining class probabilities with limited training data.
method New approach for computing feature marginal contributions and general approach to interval-valued Shapley values.
result The imprecise SHAP method improves explanation of class probabilities.

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders, point out the outliers, saving experts the time-consuming task of examining normal …

2019-03-06abs ↗pdf ↗

RoSHAP stabilizes feature attribution in machine learning models.

problem Stochastic variation in feature attribution measures.
method Modeling feature attribution score distribution and estimating it through bootstrap resampling and kernel density estimation.
result RoSHAP provides stable feature rankings and improves model performance.

This paper analyzes SHAP values using Fourier expansions for model interpretability.

problem Understanding and interpreting SHAP values in complex models.
method Developed a spectral framework using Fourier expansions for SHAP values in various model regimes.
result SHAP values are Lipschitz continuous in the deterministic regime and converge to Gaussian process values in the probabilistic regime.

Transformer model outperforms classical methods in childhood anemia prediction across diverse countries.

problem Generalizing childhood anemia prediction models across different countries and data scarcity.
method Transformer-based tabular foundation model compared to classical supervised methods using DHS data.
result Transformer model achieves lower Brier score and ECE in low-data settings, outperforming classical models.

The study develops a machine learning system for credit scoring and default prediction.

problem Developing a robust credit rating and default prediction system.
method Combines NLP, AE, GBM, DE, and SHAP/LIME for model interpretability.
result Obtained excellent out-of-sample performance in credit rating and default prediction.

G-SHAP generates multiple types of explanations for machine learning models.

problem Understanding model predictions and their differences across groups.
method Generalization of SHAP method to produce additional types of explanations.
result G-SHAP produces explanations for classification, intergroup differences, and model failure.

SHAP Distance assesses semantic fidelity of synthetic tabular data.

problem Semantic fidelity of synthetic tabular data is not well evaluated.
method SHAP Distance, defined as cosine distance between global SHAP attribution vectors.
result SHAP Distance detects semantic discrepancies overlooked by standard measures.

Enhanced loss function boosts fraud detection in auto insurance claims.

problem Class imbalance in auto insurance fraud detection.
method Structured three-stage training framework integrating convex surrogate, non-convex intermediate, and standard focal loss.
result Improves minority-class F1-scores and AUC compared to baseline methods.

CatNet controls FDR in LSTM models using SHAP feature importance and Gaussian mirrors.

problem Controlling False Discovery Rate (FDR) in LSTM models with feature selection.
method CatNet uses SHAP values for feature importance and Gaussian Mirror algorithm for FDR control. It introduces a kernel-based independence measure to handle feature correlations.
result CatNet reduces overfitting and improves model interpretability on simulated and real-world data.

Introduces a new feature importance measure using Gram-Schmidt decorrelation.

problem Determining feature influence strength and nature in datasets.
method Gram-Schmidt decorrelation and random forest regression.
result Empirical comparison of new estimators with established methods.

New method explains survival analysis models using median-SHAP.

problem Need for explainable AI in medical applications, especially for survival analysis.
method Introduces median-SHAP for explaining survival analysis models.
result Conventionally used mean anchor point can lead to misleading interpretations; median-SHAP provides a better approach.

New methods ensure feature importance rankings are correct with high probability.

problem Stability issues in feature importance scores due to random sampling.
method Hypothesis testing-based techniques to assess and verify the stability of top-ranked features.
result Ensures the most important features are correct with high-probability guarantees.

The paper uses SHAP for interpreting machine learning models in hospital data.

problem Interpreting machine learning models in healthcare.
method SHAP for feature importance and feature packing techniques.
result SHAP provides better interpretability of machine learning models in healthcare.

The paper compares ML models for credit scoring and investment decisions using explainable AI.

problem The opacity of machine learning models in financial services.
method Comparison of various machine learning models (single classifiers, ensembles, neural networks) and explainability techniques (LIME, SHAP).
result Ensemble classifiers and neural networks outperform in credit scoring models.

XPER methodology decomposes credit scoring model performance.

problem Monitoring and understanding the key drivers of credit scoring model performance.
method XPER methodology based on Shapley values, decomposing performance metrics into feature contributions.
result A small number of features explain a large part of model performance.

We solve the ANOVA decomposition for categorical inputs.

problem Lack of a closed-form expression for ANOVA decomposition with categorical dependent variables.
method Bridge functional analysis with discrete Fourier analysis to derive a closed-form decomposition.
result Closed-form decomposition for categorical inputs without assumptions.

Proposes a new method to explain model predictions for consumer recourse.

problem Current explanation methods fail to provide meaningful recourse to decision subjects.
method Develops feature responsiveness scores to highlight actionable features.
result Standard practices can undermine decision subjects by highlighting unresponsive features.

Paper proposes a new method to evaluate AI model interpretability in bond default prediction.

problem Lack of standardized method to assess inherent interpretability of AI models.
method Uses LIME and SHAP to assess feature contributions in bond default prediction.
result Consistent results with intuitive understanding of model interpretability.

Paper proposes hybrid approach for transparent credit scoring models.

problem Lack of transparency in machine learning models limits their use in regulated environments.
method Post-hoc interpretation of black-box models guides feature selection, followed by training glass-box models.
result Reduces feature usage from 106 to 10 while maintaining comparable performance.