Optimal allocation between explainable and black box models for high performance and explainability.
problem Balancing explainability and performance in model ensembles.
method Optimal allocation of observations between explainable and black box models to maximize ensemble performance and explainability.
result Learned allocations maintain high ensemble performance and explainability, sometimes outperforming individual models.
Improved local explainer aggregation for interpretable machine learning models.
problem Improving the interpretability of black box machine learning models.
method Non-convex optimization and integer optimization framework for local explainer aggregation.
result Our method outperforms existing methods in terms of coverage and fidelity, particularly in multi-class settings.
Artificial Intelligence (AI) has become an integral part of domains such as security, finance, healthcare, medicine, and criminal justice. Explaining the decisions of AI systems in human terms is a key challenge--due to the high complexity of the model, as well as the potential implications on human interests, rights, …
RelEx explains relational models without gradient access.
problem Lack of explainability for relational models like GNNs and SRL.
method Model-agnostic explainer for relational models using only outputs.
result Comparable or better performance compared to GNN-Explainer.
Defines globalness measure for explainers using optimal transport.
problem Challenges in evaluating and comparing explainability methods.
method Axiomatic definition and proof of Wasserstein Globalness measure.
result Wasserstein Globalness measure facilitates meaningful comparison and selection of explainers.
Meta-learning framework improves explainability of GNNs.
problem Improving explainability of graph neural networks.
method Meta-learning framework to steer GNN training towards interpretable minima.
result Models are easier to explain by different algorithms without sacrificing accuracy.
New feature mapping approach improves recommendation accuracy and explainability.
problem Balancing recommendation accuracy and explainability using metadata.
method Maps uninterpretable features to interpretable aspect features, minimizing both prediction and interpretation losses.
result Strong performance in recommendation and explainability, eliminating metadata need.
Proposes counterfactual explainability for causal attribution, extending variance analysis methods.
problem Lack of mechanistic understanding in existing tools for explaining complex models.
method Extends global sensitivity analysis methods to causal explanations using directed acyclic graphs.
result Developed methods to estimate counterfactual explainability and applied to income inequality analysis.
Explainable machine learning offers the potential to provide stakeholders with insights into model behavior by using various methods such as feature importance scores, counterfactual explanations, or influential training data. Yet there is little understanding of how organizations use these methods in practice. This st…
Survey reviews explainability in AI for healthcare, emphasizing trust and transparency.
problem Lack of transparency hinders AI adoption in healthcare.
method Comprehensive literature review to guide explainable AI design.
result Quantitative evaluation metrics are needed for some explainability properties.
ExKMC improves explainable k-means clustering by balancing accuracy and simplicity.
problem Limited explainable methods for unsupervised learning.
method Develops ExKMC, a new algorithm that uses a decision tree with k′ leaves to explain k-means clustering, trading explainability for accuracy. result ExKMC produces a low-cost clustering that outperforms existing methods.
New method explains high-dimensional text classifiers.
problem Limited explainability tools for high-dimensional inputs and neural networks.
method Theoretical high-dimensional properties in neural networks.
result Improved explainability for neural network classifiers.
Develops Shapley explainability solutions respecting data manifold.
problem Tenable assumption of uncorrelated features in Shapley explainability.
method Two solutions: generative modelling and direct learning of Shapley value-function.
result On-manifold Shapley explainability overcomes drawbacks of 'off-manifold' values.
New method explains survival analysis models using median-SHAP.
problem Need for explainable AI in medical applications, especially for survival analysis.
method Introduces median-SHAP for explaining survival analysis models.
result Conventionally used mean anchor point can lead to misleading interpretations; median-SHAP provides a better approach.
This paper reviews methods to improve AI explainability in finance.
problem Lack of explainability in AI models, especially in finance.
method Categorizes methods to improve explainability of deep learning models.
result Provides a comparative survey of methods to enhance AI explainability.
This work explores explainability in quantum machine learning.
problem Limited understanding of quantum machine learning models.
method Identifies research avenues and proposes two explanation methods.
result Provides a clear perspective on explainability in quantum learning.
Develops a measure for subjective explainability of ML predictions.
problem Ensuring transparency and trust in automated decision-making.
method Information-theoretic concepts applied to conditional entropy of predictions given user feedback.
result EERM principle balances subjective explainability and risk.
Surrogate explainers of black-box machine learning predictions are of paramount importance in the field of eXplainable Artificial Intelligence since they can be applied to any type of data (images, text and tabular), are model-agnostic and are post-hoc (i.e., can be retrofitted). The Local Interpretable Model-agnostic …
Proposes a method for explaining tabular data using copulas.
problem Lack of ground truth for explainability in complex datasets.
method Uses copulas to specify statistical properties and build intuition.
result Demonstrates improved explainability on logistic regression and correlation use cases.
Explanations in Machine Learning come in many forms, but a consensus regarding their desired properties is yet to emerge. In this paper we introduce a taxonomy and a set of descriptors that can be used to characterise and systematically assess explainable systems along five key dimensions: functional, operational, usab…
Defines explainability as reasoning under background knowledge.
problem Lack of agreed definitions in explainable AI.
method Reviews philosophical and social foundations, translates to tech realm.
result Defines explainability as logical reasoning under background knowledge.
This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., the explainer uses interpretable visual concepts to explain features in middle conv-layers of a CNN. Given feature maps of a conv-layer of the CNN, the explaine…
Explainable AI improves human decision accuracy but does not enhance it significantly.
problem Improving human decision-making through explainable AI.
method Comparing human decision accuracy with and without AI predictions, including or excluding explanations.
result Providing AI predictions improves human decision accuracy, but explanations do not significantly enhance it.
EXoN creates an explainable latent space for semi-supervised learning.
problem Creating an explainable latent space for semi-supervised learning.
method EXoN combines VAE with SCI (Soft-label Consistency Interpolation) to create an explainable latent space.
result EXoN reduces the cost of investigating representation patterns on the latent space.
Improves recommender system explainability by clarifying representation learning.
problem Lack of explainability in recommender systems.
method Proposes a novel explainable recommendation model by improving transparency in representation learning.
result The proposed model learns interpretable representations that are faithful to explanations.
XEM improves multivariate time series classification with explainable models.
problem Multivariate time series classification challenges.
method Hybrid ensemble method combining explicit boosting-bagging and implicit divide-and-conquer.
result XEM outperforms state-of-the-art MTS classifiers on public datasets.
Paper describes anomaly detection and explainability for multivariate functional data.
problem Anomaly detection and explainability in multivariate functional data.
method Transform series into features, use Isolation Forest, compute SHAP coefficients, and use supervised decision tree.
result Method performs well on simulated and real industry data.
This guide simplifies explainable deep learning for beginners.
problem Difficulty in understanding deep learning model decisions.
method Introduces three dimensions for explainable deep learning methods.
result Clarifies evaluations for model explanations.
CoxSE combines deep learning with self-explaining neural networks for survival analysis.
problem Improving predictive power of Cox Proportional Hazards model while maintaining explainability.
method Proposes CoxSE, a locally explainable Cox proportional hazards model using SENN, and CoxSENAM, a hybrid model with NAM.
result CoxSE provides more stable and consistent explanations while maintaining predictive power.
Graph neural network explainer identifies causal subgraphs ensuring predictions.
problem Spurious correlations in GNN explainers.
method Proposes {
ame}, a GNN causal explainer via causal inference.
result Significantly outperforms existing GNN explainers in exact groundtruth explanation identification.
New method explains predictive uncertainty by focusing on second-order effects.
problem Explaining predictive uncertainty in machine learning models.
method CovLRP, CovGI, etc., based on second-order effects.
result Predictive uncertainty is dominated by second-order effects.
New framework for explainable AI on high-dimensional data.
problem Challenges in explainability with high-dimensional data.
method Two modules: latent representation and Shapley paradigm adaptation.
result Interpretable model explanations for high-dimensional data.
Local surrogate model improves time series forecasts and provides interpretable explanations.
problem Improving time series forecasting accuracy while maintaining interpretability.
method A local surrogate model is used to correct the base model's predictions, making the corrections interpretable by re-fitting the base model to the error-predicted data.
result The method can discover and explain underlying patterns in the data, improving both accuracy and interpretability.
Proposes a simple method to explain aleatoric uncertainty in neural networks.
problem Lack of transparent explanations for uncertainty estimates in AI models.
method Adapting a neural network with Gaussian output to estimate predictive variance and applying explainers to the variance output.
result The proposed method explains uncertainty more reliably than complex approaches and outperforms them in most settings.
SMT-EX enhances SMT for explaining surrogate models of mixed-variable design problems.
problem Making decisions and understanding complex systems using surrogate models of mixed-variable design problems.
method Integrates explainability techniques into SMT, including Shapley Additive Explanations, Partial Dependence Plot, and Individual Conditional Expectations.
result Demonstrates versatility in addressing diverse problem characteristics.
ADS explains object differences by quantifying and removing underlying properties.
problem Explaining differences between two object images.
method Align-Deform-Subtract (ADS) framework that uses semantic alignments and iterative quantification/removal of differences.
result ADS provides disentangled error measures explaining object differences in terms of underlying properties.
survex explains machine learning survival models, improving model transparency.
problem Lack of tools to explain machine learning survival models.
method Introduces survex R package using explainable AI techniques.
result Improves model reliability and detects biases in survival models.
Enhances explainability of AI models without sacrificing accuracy.
problem Lack of interpretability in black-box models like Deep Neural Networks and Gradient Boosting.
method Co-supervised Local Model Synthesis (SynthTree) using Mixture of Linear Models (MLM).
result Statistical models significantly enhance explainability of AI models.
Study examines explainable machine learning for monotonic models, finding Integrated gradients better for strong monotonicity.
problem Applying explainable machine learning to science-informed models.
method Proposed axioms for monotonicity, tested Shapley value and Integrated gradients methods.
result Integrated gradients provides better explanations for strong monotonicity.
Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been implemented in numerous open source and commercial packages and explainable ML i…
ProtoX-AD: A self-explainable time series anomaly detection framework
problem Lack of explainability in self-supervised time series anomaly detection
method Learning transformation-aware latent representations and interpretable prototypes
result Achieves detection performance comparable to black-box methods while offering more consistent and semantically meaningful explanations
Machine learning predicts homicide clearance rates with SHAP explaining key features.
problem Predicting and explaining homicide clearance rates in the US.
method Nine algorithmic approaches compared; XGBoost selected. SHAP used for feature importance.
result XGBoost best predicts national homicide clearance rates; SHAP reveals key features.
New approach to explain fairness in machine learning models.
problem Detect, understand, and mitigate unfairness in machine learning models.
method Shapley value paradigm and meta algorithm for training-time fairness interventions.
result Meta algorithm provides insight into accuracy-fairness trade-off.
The paper shows how uncertainty quantification improves counterfactual explainability in AI.
problem Lack of foundational concepts in transparency research.
method Integrates uncertainty quantification into counterfactual explainability.
result Demonstrates competitive performance of an uncertainty-based explainer.
A new method explains mixed features for predictive models using conditional inference trees.
problem Explaining complex machine learning models with mixed features.
method Proposes a method to explain mixed features (continuous, discrete, ordinal, categorical) using conditional inference trees.
result Our method often outperforms current industry standards in various simulation studies and real-world financial data.
Paper proposes a method to make image model explanations robust to distortions.
problem Ensuring robustness of explanations for images under distortions.
method Embedding perceptual distances in surrogate explainers to evaluate and improve robustness.
result Surrogate explanations become more coherent and robust to distortions.
We adapt Shapley values to explain model uncertainty, connecting it to information theory.
problem Explaining uncertainty in model predictions.
method Adapted Shapley value framework to quantify feature contributions to predictive uncertainty.
result Deep connections between Shapley values and information theory quantities.
New framework assesses and benchmarks ML methods for multivariate time series.
problem Benchmarking and explaining performance of machine learning methods.
method Proposes a new framework with systematized performance-explainability characteristics.
result Illustrates application to multivariate time series classifiers.