Proposes counterfactual explainability for causal attribution, extending variance analysis methods.
problem Lack of mechanistic understanding in existing tools for explaining complex models.
method Extends global sensitivity analysis methods to causal explanations using directed acyclic graphs.
result Developed methods to estimate counterfactual explainability and applied to income inequality analysis.
The paper shows how uncertainty quantification improves counterfactual explainability in AI.
problem Lack of foundational concepts in transparency research.
method Integrates uncertainty quantification into counterfactual explainability.
result Demonstrates competitive performance of an uncertainty-based explainer.
Counterfactuals help compare different scenarios in CI and XAI.
problem Comparing how counterfactuals are used in causal inference and explainable AI.
method Formal definition and comparison of counterfactuals in CI and XAI.
result Identified opportunities for cross-fertilization between CI and XAI.
This paper reviews counterfactual explanations for machine learning models.
problem Making machine learning models understandable to humans.
method Categorization and evaluation of counterfactual explanation algorithms.
result A rubric for evaluating counterfactual explanations.
Improves global counterfactual explanations for model recourse.
problem Inability to provide explanations beyond local instances.
method Investigates and improves Actionable Recourse Summaries (AReS) for global counterfactual explanations.
result Develops more efficient and interactive explainability tools.
Paper introduces Native Guide for generating time series counterfactual explanations.
problem Lack of explainability for time series data in AI systems.
method Model-agnostic, instance-based counterfactual generation for time series classification.
result Native Guide produces better counterfactual explanations than benchmarks.
We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e., changing the inputs in the set changes the decision) and is irreducible (i.e., …
Method for explaining machine learning survival models using counterfactuals.
problem Tackles the challenge of explaining survival models in machine learning.
method Introduces a condition based on the difference of mean times to event for counterfactual explanation. Reduces the problem to a convex optimization problem for Cox models and applies Particle Swarm Optimization for other models.
result Demonstrates the effectiveness of the proposed method through numerical experiments.
Survey of counterfactual explanations for time series classification.
problem Generating plausible and actionable counterfactuals for time series data.
method Review of various counterfactual generation methods for time series classification.
result Highlight unique challenges and strengths of existing methods.
New approach to counterfactual reasoning in AI and psychology.
problem Challenges to conventional counterfactual reasoning in AI and psychology.
method Formalizes a backtracking approach to counterfactuals within the SCM framework.
result First general account and algorithmisation of backtracking counterfactuals.
Although deep reinforcement learning agents have produced impressive results in many domains, their decision making is difficult to explain to humans. To address this problem, past work has mainly focused on explaining why an action was chosen in a given state. A different type of explanation that is useful is a counte…
Method generates counterfactual explanations for graph classifiers.
problem Generating high-quality explanations for graph predictions.
method Permutation equivariant graph variational autoencoder to traverse latent space.
result Empirically validated model is high-performing and robust.
New definition of patient-specific root causes of disease using counterfactuals.
problem Lack of rigorous mathematical formulation for automatic detection of root causes.
method Proposes a counterfactual definition matching clinical intuition and uses Shapley values for causal contribution scores.
result Adapts to disease prevalence, accounts for noisy labels, and admits fast computation.
CONFETTI improves interpretability of deep learning models for MTS by providing counterfactual explanations.
problem Lack of transparency in deep learning models for multivariate time series classification.
method CONFETTI is a novel multi-objective counterfactual explanation method that balances prediction confidence, proximity, and sparsity.
result CONFETTI outperforms state-of-the-art methods in various metrics, improving interpretability and decision support.
R package for counterfactual explanation methods.
problem Lack of unified interfaces for counterfactual explanation methods.
method Developed a modular R6-based interface for three existing counterfactual methods and proposed extensions.
result Comparison of implemented methods' quality and runtime behavior.
Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a different prediction. We posit that effective counterfactual explanations shoul…
Paper introduces a method to explain concept drift using counterfactual explanations.
problem Understanding the features where concept drift occurs for better model adjustment.
method Formal definition and algorithm based on counterfactual explanations.
result Demonstrates usefulness of the method in various examples.
Proposes a framework to explain KS deterioration in credit risk models.
problem Inconsistent and ad hoc diagnosis of KS decline in credit risk models.
method Counterfactual diagnostic framework attributing KS decline to sampling variability, portfolio composition, covariate shift, and residual deterioration.
result The proposed approach provides more interpretable and governance-relevant explanations than threshold-based review alone.
CLEAR learns causal graphs from attention in recommender systems to explain user behavior.
problem Understanding why specific recommendations are made in recommender systems.
method CLEAR learns session-specific causal graphs from attention in pre-trained neural recommenders, addressing latent confounders.
result CLEAR provides counterfactual explanations that are shorter and more effective than naive methods.
The increasing deployment of machine learning as well as legal regulations such as EU's GDPR cause a need for user-friendly explanations of decisions proposed by machine learning models. Counterfactual explanations are considered as one of the most popular techniques to explain a specific decision of a model. While the…
Paper proposes counterfactual explanations for ML on multivariate time series data.
problem Lack of user trust and difficulty in debugging ML frameworks using multivariate time series data.
method Proposes a novel explainability technique for providing counterfactual explanations.
result Outperforms state-of-the-art explainability methods in metrics like faithfulness and robustness.
GLOBE-CE offers efficient global counterfactual explanations.
problem Lack of reliable and scalable global counterfactual explanations.
method Translation-based approach for global counterfactual explanations.
result GLOBE-CE performs significantly better than current methods across multiple metrics.
Due to the increasing use of machine learning in practice it becomes more and more important to be able to explain the prediction and behavior of machine learning models. An instance of explanations are counterfactual explanations which provide an intuitive and useful explanations of machine learning models. In this su…
The increasing use of machine learning in practice and legal regulations like EU's GDPR cause the necessity to be able to explain the prediction and behavior of machine learning models. A prominent example of particularly intuitive explanations of AI models in the context of decision making are counterfactual explanati…
New method explains anomalies in multivariate time series data.
problem Understanding and explaining anomalies in multivariate time series data.
method Counterfactual reasoning applied to MDI-detected anomalous intervals.
result Our method accurately identifies and explains anomalies in various extreme events.
Develops logic programs for explaining classification model decisions.
problem Creating explanations for decisions made by classification models.
method Answer-set programs for computing counterfactual interventions.
result Maximum responsibility causal explanations can be computed.
New approach to counterfactual reasoning avoids demographic interventions.
problem Limitations of traditional counterfactual reasoning in AI systems.
method Backtracking counterfactual approach instead of interventional.
result Allows addressing social concerns without demographic interventions.
Generative models explain machine learning predictions with counterfactual instances.
problem Generating human-interpretable insights into machine learning model predictions.
method Sparse counterfactual explanations using conditional generative models.
result Single forward pass generates batches of counterfactual instances.
FRED explains text model predictions by identifying key words and providing counterfactual examples.
problem Lack of interpretable methods for text models that are complex, lack foundations, and have unguaranteed performance.
method FRED identifies minimal influential word sets, assigns token importance, and generates counterfactual examples.
result FRED provides reliable and effective explanations for text model predictions.
Generative adversarial approach for satellite image time series land cover classification.
problem Enhance interpretability of land cover classification models.
method Generative adversarial counterfactual approach for multi-class land cover classification.
result Discovery of interesting information on land cover class relationships and sparser, interpretable solutions.
DECE visualizes machine learning decisions with counterfactual explanations.
problem Making machine learning models transparent and explainable.
method Interactive visualization system supporting counterfactual explanations at instance- and subgroup-levels.
result DECE enables users to explore and understand machine learning model decisions.
TimeVQVAE-AD detects anomalies in time series data with high accuracy and provides explainable results.
problem Detecting and explaining anomalies in time series data accurately.
method Masked latent generative modeling in time-frequency domain.
result TimeVQVAE-AD outperforms existing methods in anomaly detection and explainability.
1-Lipschitz neural networks produce clearer, more focused Saliency Maps for explainable AI.
problem Noisy and limited Saliency Maps from traditional neural networks.
method Dual loss of optimal transport problem for 1-Lipschitz neural networks.
result Saliency Maps from 1-Lipschitz networks are highly concentrated and less noisy, aligning with human explanations.
Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the causal model of the data and the derived intervened causal models, that represent th…
This study analyzes counterfactual explanations for student success models.
problem Improving trust in machine learning models for student success prediction.
method Comparison of counterfactual generation methods (WhatIf, Multi-Objective, Nearest Instance) for student success prediction models.
result WhatIf Counterfactual Explanations are more effective for student success prediction models.
ALMANACS benchmarks explainability methods on simulatability.
problem Evaluating the effectiveness of explainability methods for language models.
method ALMANACS is a simulatability benchmark that evaluates explainability methods on twelve safety-relevant topics.
result No explainability method outperforms the explanation-free control across all topics.
With the advent of GDPR, the domain of explainable AI and model interpretability has gained added impetus. Methods to extract and communicate visibility into decision-making models have become legal requirement. Two specific types of explanations, contrastive and counterfactual have been identified as suitable for huma…
Post-hoc interpretability approaches have been proven to be powerful tools to generate explanations for the predictions made by a trained black-box model. However, they create the risk of having explanations that are a result of some artifacts learned by the model instead of actual knowledge from the data. This paper f…
AI techniques explain synthetic tabular data weaknesses.
problem Challenges in evaluating synthetic tabular data quality.
method Apply explainable AI to a binary detection classifier.
result Reveals inconsistencies, unrealistic dependencies, or missing patterns in synthetic data.
Survey on combining causal models with deep generative models for improved explainability and fairness.
problem Deep generative models lack explainability, induce spurious correlations, and poor out-of-distribution extrapolation.
method Structural causal models (SCMs) combined with deep generative models to address shortcomings.
result Causal generative models offer robustness, fairness, and interpretability.
COMRECGC finds common recourse for global counterfactual explanations in GNNs.
problem Finding common recourse for global counterfactual explanations in GNNs.
method Formalized the common recourse explanation problem and designed COMRECGC algorithm.
result COMRECGC outperforms strong baselines on four real-world graph datasets.
As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a favorable decision. Counterfactual explanations -- "how the world would have (had) to b…
Attack reveals model details from counterfactual explanations.
problem Extracting model details from counterfactual explanations.
method Adversary uses counterfactual explanations to build high-fidelity model.
result High-fidelity and high-accuracy model extraction possible.
Multi-SpaCE generates valid counterfactual explanations for multivariate time series data.
problem Lack of transparency in deep learning models for multivariate time series data.
method Multi-objective counterfactual explanation method using NSGA-II for multivariate time series data.
result Ensures perfect validity and superior performance compared to existing methods.
Machine learning promises to revolutionize clinical decision making and diagnosis. In medical diagnosis a doctor aims to explain a patient's symptoms by determining the diseases \emph{causing} them. However, existing diagnostic algorithms are purely associative, identifying diseases that are strongly correlated with a …
The paper detects and identifies bias in data using a counterfactual approach.
problem Detecting and identifying bias in data, especially in medical image classification.
method A global explanation framework using the counterfactual approach to identify bias causing artifacts.
result Black frames significantly influence Convolutional Neural Network's prediction, changing benign to malignant.
The paper tackles one-for-many counterfactual explanations using column generation.
problem Minimizing the number of explanations needed for a group of instances with sparsity constraints.
method Developed a novel column generation framework to efficiently search for explanations for any black-box classifier.
result The column generation framework outperforms existing methods in scalability, computational performance, and solution quality.
Quantum oracles help identify counterfactuals better than classical ones.
problem Identifying unknown causal parameters in causal models.
method Using quantum oracles to query and identify all causal parameters and counterfactuals.
result Quantum oracles enable identification of all two-way joint counterfactuals and tighter bounds on higher-order counterfactuals.