Counterfactual data augmentations may not ensure OOD robustness if performed by a context-guessing machine.
problem Deep learning models lack out-of-distribution robustness due to reliance on spurious features.
method Theoretical analysis and demonstration of counterfactual data augmentations performed by a context-guessing machine.
result Counterfactual data augmentations by a context-guessing machine do not lead to robust OOD classifiers.
MCCE generates realistic counterfactual explanations for tabular data.
problem Creating valid and actionable counterfactual explanations for complex tabular data.
method MCCE models the joint distribution of features and decision using an autoregressive generative model with decision trees. It samples counterfactuals and removes invalid ones.
result MCCE outperforms state-of-the-art methods on various performance metrics and is faster.
Counterfactual explanations can be obtained by identifying the smallest change made to a feature vector to qualitatively influence a prediction; for example, from 'loan rejected' to 'awarded' or from 'high risk of cardiovascular disease' to 'low risk'. Previous approaches often emphasized that counterfactuals should be…
Proposes an efficient method for ordered counterfactual explanations.
problem Insufficient explanation of perturbation vectors for executing actions.
method Mixed-Integer Linear Optimization (MILP) approach for evaluating and extracting optimal pairs of actions and orders.
result Demonstrated effectiveness of the proposed method on real datasets.
Proposes MOC method for better counterfactual explanations in ML models.
problem Difficulties in balancing multiple objectives for counterfactual explanations.
method Translates counterfactual search into a multi-objective optimization problem.
result Returns diverse counterfactuals with different trade-offs and maintains feature diversity.
Paper introduces a method to explain concept drift using counterfactual explanations.
problem Understanding the features where concept drift occurs for better model adjustment.
method Formal definition and algorithm based on counterfactual explanations.
result Demonstrates usefulness of the method in various examples.
The paper introduces CPICFs for better counterfactual explanations in high-dimensional spaces.
problem Creating useful counterfactual explanations for complex machine learning models.
method Modeling individual knowledge and using conformal prediction intervals to identify informative counterfactuals.
result CPICFs provide more informative counterfactuals by considering individual knowledge and prediction uncertainty.
Method finds counterfactual explanations for random forest models.
problem Limited interpretability of random forest models in regulated industries.
method Similarity learning exploiting random forest's feature representation.
result Generated explanations are sparser and more useful than Shapley values.
Proposes a method for clearer counterfactual explanations of deep networks.
problem Unclear explanations from current counterfactual methods.
method Gradual construction of explanations through masking and composition steps.
result Produces human-friendly, interpretable explanations with fewer modifications.
Generative adversarial approach for satellite image time series land cover classification.
problem Enhance interpretability of land cover classification models.
method Generative adversarial counterfactual approach for multi-class land cover classification.
result Discovery of interesting information on land cover class relationships and sparser, interpretable solutions.
New method deconfounds deep learning feature representations using counterfactual approach.
problem Improving model stability in deep learning models under dataset shifts.
method Adopting last layer features of DNNs trained with softmax activation for logistic regression, and applying counterfactual deconfounding.
result Counterfactual deconfounding can be applied to DNN feature representations, improving model stability.
R package for counterfactual explanation methods.
problem Lack of unified interfaces for counterfactual explanation methods.
method Developed a modular R6-based interface for three existing counterfactual methods and proposed extensions.
result Comparison of implemented methods' quality and runtime behavior.
The paper tackles spurious correlations in machine learning models and introduces counterfactual invariance.
problem Spurious correlations in machine learning models that depend on irrelevant parts of input data.
method The paper uses causal inference to stress test models and introduces counterfactual invariance as a formal requirement.
result Counterfactual invariance is a requirement for models to be robust to irrelevant perturbations in input data.
Proposes CCME framework for estimating heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects in complex distributions.
method Embeds conditional distributions into RKHS, develops meta-estimators for CCME.
result Establishes finite-sample convergence rates and double robustness for CCME estimators.
We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e., changing the inputs in the set changes the decision) and is irreducible (i.e., …
Paper tackles counterfactual sentence detection and evaluation.
problem Detect and evaluate counterfactual sentences in natural language.
method Used a BERT base model for classification and a hybrid BERT Multi-Layer Perceptron for sequence identification. Introduced cascaded linear inputs to improve performance.
result Achieved an F1 score of 85.00% in Task 1 and 83.90% in Task 2.
This paper tackles confounding biases in data augmentation.
problem Mitigating spurious correlations and confounding variables in training data.
method Formal analysis and counterfactual data augmentation.
result Removing confounding biases leads to invariant features and better generalization.
New method debiases counterfactual distributions using observational data.
problem Estimating counterfactual distributions under interventions without relying on observational data.
method Flow-matching approach to learn counterfactual distributions from observational data.
result Deconfounding flows outperform existing debiased counterfactual distribution estimators.
Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the causal model of the data and the derived intervened causal models, that represent th…
Introduces PCG for better counterfactual explanations in vision models.
problem Ambiguity in latent-space optimization methods for counterfactual explanations.
method Constructs counterfactuals by tracing geodesics under a perceptually Riemannian metric.
result PCG outperforms baselines and reveals hidden failure modes.
A deep RL approach generates counterfactual instances efficiently.
problem Efficient generation of counterfactual instances for large datasets and diverse models.
method Deep reinforcement learning to optimize counterfactual instances in a single forward pass.
result Model-agnostic and scalable counterfactual generation.
New methods create counterfactuals for image regression models.
problem Creating interpretable explanations for regression models in images.
method Two methods using diffusion-based generative models to create counterfactuals.
result Diffusion-based methods produce realistic, semantic, and smooth counterfactuals.
EXOC framework uses auxiliary variables for counterfactual fairness in machine learning.
problem Balancing fairness and predictive accuracy in models with sensitive attributes.
method EXOC framework uses auxiliary variables to define an auxiliary node and a control node for counterfactual fairness.
result EXOC framework outperforms state-of-the-art approaches in achieving counterfactual fairness.
Interventional domain adaptation improves feature transferability by removing spurious correlations.
problem Improper feature transferability due to spurious correlations in domain adaptation.
method Intervention strategy using unlabeled target data to generate counterfactual features and train discriminability invariance.
result Consistent performance improvements over state-of-the-art approaches in various domain adaptation tasks.
To construct interpretable explanations that are consistent with the original ML model, counterfactual examples---showing how the model's output changes with small perturbations to the input---have been proposed. This paper extends the work in counterfactual explanations by addressing the challenge of feasibility of su…
GLOBE-CE offers efficient global counterfactual explanations.
problem Lack of reliable and scalable global counterfactual explanations.
method Translation-based approach for global counterfactual explanations.
result GLOBE-CE performs significantly better than current methods across multiple metrics.
BRACE generates efficient counterfactual explanations by integrating causal reasoning.
problem Challenges in traditional counterfactual explanations, especially neglecting causal relationships.
method Backtracking counterfactuals with causal reasoning.
result Our method provides deeper insights into model outputs and is computationally efficient.
This study analyzes counterfactual explanations for student success models.
problem Improving trust in machine learning models for student success prediction.
method Comparison of counterfactual generation methods (WhatIf, Multi-Objective, Nearest Instance) for student success prediction models.
result WhatIf Counterfactual Explanations are more effective for student success prediction models.
The paper tackles counterfactual inference with multioutput deep kernels in high-dimensional settings.
problem Performing counterfactual inference with observational data in high-dimensional settings with multiple actions and outcomes.
method The paper presents a general class of counterfactual multi-task deep kernels models based on Structural Causal Models (SCM) and Gaussian Processes.
result The models estimate causal effects and learn policies efficiently, scaling well with high dimensions.
Proposes counterfactual explanations for deep two-sample tests on high-dimensional data.
problem Limited interpretability of deep two-sample tests on high-dimensional data.
method Combines diffusion autoencoder and pretrained deep two-sample test model to generate counterfactuals.
result Counterfactual transformations increase p-values, indicating closer distribution similarity.
Proposes a deep learning framework for estimating counterfactual outcomes.
problem Challenges in estimating individual outcomes under different treatments.
method Deep variational Bayesian framework integrating factual and similar subjects' outcomes.
result Rigorously integrates individual features and similar subjects' responses for counterfactual outcomes.
This paper introduces collective counterfactual explanations for groups of instances in classification models.
problem Understanding how classification models make decisions for groups of instances.
method Novel Mathematical Optimization models to find collective counterfactual explanations that minimize total perturbation cost.
result Detects critical features for entire dataset classification and handles outliers.
Counterfactual evaluation of novel treatment assignment functions (e.g., advertising algorithms and recommender systems) is one of the most crucial causal inference problems for practitioners. Traditionally, randomized controlled trials (A/B tests) are performed to evaluate treatment assignment functions. However, such…
A new method for generating counterfactual explanations in high-dimensional datasets.
problem Creating realistic counterfactual explanations in complex, high-dimensional data.
method A discretized approach using binary search and boundary approximation.
result Our method reduces the distance between counterfactuals by 5% to 50% in terms of the L2 norm.
ACE improves counterfactual explanations with fewer model queries.
problem Inefficient sampling for counterfactual explanations in machine learning models.
method Adaptive sampling combining Bayesian estimation and stochastic optimization.
result ACE achieves superior evaluation efficiency compared to state-of-the-art methods.
Quantum oracles help identify counterfactuals better than classical ones.
problem Identifying unknown causal parameters in causal models.
method Using quantum oracles to query and identify all causal parameters and counterfactuals.
result Quantum oracles enable identification of all two-way joint counterfactuals and tighter bounds on higher-order counterfactuals.
This paper proposes a novel approach for constructing effective personalized policies when the observed data lacks counter-factual information, is biased and possesses many features. The approach is applicable in a wide variety of settings from healthcare to advertising to education to finance. These settings have in c…
The paper shows how uncertainty quantification improves counterfactual explainability in AI.
problem Lack of foundational concepts in transparency research.
method Integrates uncertainty quantification into counterfactual explainability.
result Demonstrates competitive performance of an uncertainty-based explainer.
Attack reveals model details from counterfactual explanations.
problem Extracting model details from counterfactual explanations.
method Adversary uses counterfactual explanations to build high-fidelity model.
result High-fidelity and high-accuracy model extraction possible.
With the advent of GDPR, the domain of explainable AI and model interpretability has gained added impetus. Methods to extract and communicate visibility into decision-making models have become legal requirement. Two specific types of explanations, contrastive and counterfactual have been identified as suitable for huma…
CEILS generates feasible counterfactual explanations by considering causal impacts.
problem Current counterfactual explanations lack feasibility and causal impact consideration.
method CEILS integrates causal reasoning into existing counterfactuals generation algorithms.
result CEILS provides feasible recommendations to achieve desired outcomes.
Estimates outcomes under hypothetical scenarios using a flexible framework.
problem Adapting to sudden shifts in treatment patterns.
method Doubly robust estimator using incremental interventions.
result Achieves n \sqrt{n} n -consistency and asymptotic normality. The paper tackles one-for-many counterfactual explanations using column generation.
problem Minimizing the number of explanations needed for a group of instances with sparsity constraints.
method Developed a novel column generation framework to efficiently search for explanations for any black-box classifier.
result The column generation framework outperforms existing methods in scalability, computational performance, and solution quality.
New framework improves attribution of predictive uncertainties in classification models.
problem Improper attribution of predictive uncertainties in classification tasks.
method Combines path integrals, counterfactual explanations, and generative models.
result Framework outperforms existing alternatives in quantitative evaluations.
Develops methods for making deep learning models more interpretable by answering counterfactual questions.
problem Lack of interpretability in deep learning models, especially in high-stakes applications.
method Introduces causal interpretability, a framework for building models that are causally interpretable by design.
result Identifies a fundamental tradeoff between causal interpretability and predictive accuracy.
Researchers use human-in-the-loop to create counterfactually augmented data, improving model performance.
problem Creating ML models less reliant on spurious patterns in NLP datasets.
method A human-in-the-loop process to curate counterfactually augmented data (CAD), prohibiting unnecessary edits.
result Models trained on CAD appear to rely less on semantically irrelevant words and generalize better out of domain.
CausAdv detects adversarial examples using causal reasoning.
problem Vulnerability of CNNs to adversarial perturbations.
method Causal framework based on counterfactual reasoning.
result Adversarial examples exhibit different CI distributions compared to clean samples.
Proposes a sparsity algorithm to improve corporate credit ratings.
problem Improving credit ratings of publicly traded companies.
method Formulates counterfactual explanation as an optimization problem and proposes a sparsity algorithm to maximize sparsity.
result The sparsity algorithm can capture features that improve credit ratings.