New definition of interpretability makes model design more actionable.
problem Current definitions of interpretability are not actionable and inform users poorly.
method Proposes a new definition of interpretability that is general, simple, and actionable.
result New definition reveals necessary properties for designing interpretable models.
Proposes a decision-theoretic approach for enhancing model interpretability in Bayesian frameworks.
problem Challenges the traditional approach of restricting model structure for interpretability in Bayesian frameworks.
method Introduces an interpretability utility function and a two-step method involving a reference model and a proxy model.
result Demonstrates that the proposed method generates more accurate models with the same level of interpretability.
Interpretability of ML models improves healthcare decisions.
problem Ensuring machine learning models are understandable for healthcare users.
method Classifying interpretability into local and global approaches, and model-specific vs. model-agnostic methods.
result Examples of practical interpretability in healthcare, including prediction and treatment optimization.
Model-agnostic interpretation methods can mislead if not used carefully.
problem Misinterpretation of machine learning models due to improper use of techniques.
method General pitfalls of model-agnostic interpretation methods.
result Many pitfalls exist when using global interpretation techniques for machine learning models.
Interpreting machine learning models helps understand adversarial attacks and defenses.
problem Understanding model vulnerability to adversarial attacks.
method Model interpretation techniques to explore adversarial attacks and defenses.
result Interpretation methods can be applied to adversarial attacks and defenses.
Hybrid model combines interpretable and black-box models for better transparency and performance.
problem Balancing interpretability and predictive performance in machine learning models.
method Proposes a Hybrid Predictive Model (HPM) integrating an interpretable model with a black-box model, using principled objective functions and customized training algorithms.
result Hybrid models achieve an efficient trade-off between transparency and predictive performance.
Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet the task of interpretation appears underspecified. Papers provide diverse and s…
InterpretML simplifies machine learning interpretability for users and researchers.
problem Making machine learning models understandable to non-experts.
method Unified Python package exposing interpretability algorithms and visualization.
result First implementation of Explainable Boosting Machine, a powerful, interpretable model.
LIMIS improves locally interpretable models by selecting and distilling key instances.
problem Low fidelity of locally interpretable models.
method LIMIS uses instance-wise subsampling guided by policy gradient and reward to improve fidelity.
result LIMIS near-matches black-box model accuracy while significantly improving fidelity.
Regularizes black-box models to improve interpretability.
problem Improving interpretability of black-box models without sacrificing accuracy.
method Regularizes a black-box model at training time to connect model explainability, explanation system, and quality metrics.
result Substantial improvement in explanation fidelity and stability across various datasets and explanation systems, with slight accuracy trade-off.
Proposes a model to interpret complex ML algorithms.
problem Complex ML models are hard to interpret.
method Uses model-based regression trees and interpretable main-effects models.
result Surrogate model provides interpretable results with good predictive performance.
Researchers review challenges in interpreting additive models, especially neural additive models.
problem Challenges in interpreting additive models, particularly neural additive models.
method Review of generalized additive models and discussion of nonidentifiability.
result Challenges in claiming interpretability or suitability for safety-critical applications of additive models.
Meta-learning approach to learn interpretable models from human feedback.
problem Tackling the challenge of making machine learning models interpretable.
method A meta-learning approach where a model of non-trivial proxies of human interpretability is learned from human feedback, then incorporated into the ML training process to optimize for interpretability.
result The approach leads to formulas that are either significantly more or equally accurate while being more interpretable.
The paper uses model-based trees to create interpretable surrogate models for complex machine learning models.
problem Interpreting complex machine learning models.
method Using model-based trees to partition feature space and create interpretable models.
result Model-based trees generate optimal surrogate models that balance interpretability and performance.
The paper defines a mathematical framework for measuring model interpretability.
problem Improving trust and understanding in machine learning models for complex decisions.
method Constructing interpretable steps in a sequence for various models, generalizing to a family of consistent measures.
result A formal definition of interpretability allows quantifying the tradeoff with predictive accuracy.
A framework learns interpretable models with minimal accuracy loss.
problem Tackles interpretability in deep learning models.
method Jointly learns a predictive model and its interpretation model with minimal loss of accuracy.
result Generates interpretable models with minimal loss of accuracy.
VALC provides concept-level interpretations of FLMs, overcoming word-level limitations.
problem Lack of higher-level structure interpretation in FLMs' attention weights.
method Formal definition of conceptual interpretation, variational Bayesian framework (VALC).
result VALC finds optimal language concepts for FLM predictions, providing concept-level interpretations.
Shallow trees in ensemble models make models more interpretable and sometimes better.
problem Lack of transparency in high-performing tree ensemble models.
method Developed an interpretation algorithm to convert tree ensembles into functional ANOVA representations. Proposed strategies to enhance interpretability.
result Shallow trees in ensemble models can lead to better generalization performance and improved interpretability.
MonoNet enforces monotonicity to improve model interpretability.
problem Lack of interpretability in complex machine learning models.
method Enforces monotonicity between features and outputs in deep learning models.
result Enforcing monotonicity allows for better understanding of model predictions.
The study explores statistical methods to interpret radiological models and identify key features.
problem Interpreting complex radiological models for clinical use.
method Exploration of statistical techniques to assess relationships between radiomic features.
result Identification of key relationships and features for improved interpretability.
New method learns to encode predictions within interpretations, improving evaluation.
problem Need for interpretable machine learning, but existing methods are slow or lack fidelity.
method Amortized explanation methods that learn a global selector model optimizing fidelity of interpretations.
result Predictions can be encoded within interpretations, detected by EVAL-X.
Survey on causal interpretability models for machine learning.
problem Understanding and explaining the decisions made by machine learning models.
method Comprehensive survey on causal interpretable models.
result Evaluation metrics for interpretability are discussed.
New framework learns interpretable rule ensembles without sacrificing accuracy.
problem Trade-off between accuracy and interpretability in rule ensembles.
method Introduces local interpretability and a regularizer to promote it, using coordinate descent with local search.
result Learns rule ensembles with fewer rules to explain individual predictions, maintaining comparable accuracy.
Develops methods for making deep learning models more interpretable by answering counterfactual questions.
problem Lack of interpretability in deep learning models, especially in high-stakes applications.
method Introduces causal interpretability, a framework for building models that are causally interpretable by design.
result Identifies a fundamental tradeoff between causal interpretability and predictive accuracy.
DyS model improves survival analysis accuracy and interpretability.
problem Accurate and interpretable survival analysis models for healthcare.
method Feature-sparse Generalized Additive Model combining feature selection and interpretable prediction.
result DyS model outperforms other survival analysis models in interpretability and accuracy.
Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.
problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.
Model interpretability is a requirement in many applications in which crucial decisions are made by users relying on a model's outputs. The recent movement for "algorithmic fairness" also stipulates explainability, and therefore interpretability of learning models. And yet the most successful contemporary Machine Learn…
We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In this work, we optimize for interpretability by directly including humans in the …
Proposes FairCORELS for fair, interpretable rule lists.
problem Fairness in interpretable models for high-stakes decisions.
method Multi-objective variant of CORELS, supporting fairness measures.
result Outperforms state-of-the-art fair classification techniques.
RCAV quantifies model sensitivity to semantic concepts, improving interpretability methods.
problem Lack of semantic interpretability in image classification models.
method RCAV calculates concept gradients and ascent steps to assess model sensitivity to semantic concepts.
result RCAV yields more accurate and robust interpretations of model behavior.
The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on two definitions of interpretability that have been introduced in the machine learn…
Paper proposes a new method to evaluate AI model interpretability in bond default prediction.
problem Lack of standardized method to assess inherent interpretability of AI models.
method Uses LIME and SHAP to assess feature contributions in bond default prediction.
result Consistent results with intuitive understanding of model interpretability.
Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational formulation of black-box interpretation, general interpretability research rely hea…
New definition of interpretability for deep neural networks.
problem Vague definition of interpretability for deep neural networks.
method Proposed a new definition of human predictability for interpretability of DNNs.
result Our definition will help to the research of interpretability of DNNs.
Interpretable companion model for black-box classifiers.
problem Dilemma between interpretable and black-box models.
method Trains a companion model from data and black-box model predictions, optimizing a combination of accuracy and complexity.
result Companion model provides interpretable predictions with a slight accuracy loss for user choice.
SEMs fail to provide robust explanations to adversarial inputs.
problem Lack of robustness in interpretability of self-explaining models.
method Evaluation of current SEMs and creation of adversarial inputs.
result Adversarial inputs can cause significant changes in explanations without affecting model outputs.
Most research on the interpretability of machine learning systems focuses on the development of a more rigorous notion of interpretability. I suggest that a better understanding of the deficiencies of the intuitive notion of interpretability is needed as well. I show that visualization enables but also impedes intuitiv…
Automated feature engineering improves interpretable models without manual work.
problem Lack of interpretability in complex models causes trust and stability issues.
method Use elastic black-box models to create simpler, interpretable glass-box models.
result Extracted features from complex models improve linear model performance.
The paper proposes a new method for creating interpretable models using convex optimization.
problem Creating models that are both accurate and interpretable for decision-making.
method Formulates convex learning problems that combine interpretability with accuracy, using operator theory and parametric nonlinear models.
result Shows how to create efficient surrogate models that are both accurate and interpretable.
Paper investigates privacy-preserving model interpretation in Federated Learning.
problem Balancing model interpretability and data privacy in Federated Learning.
method Uses Shapley values to balance feature importance between host and guest parties in vertical Federated Learning.
result Proposes a method to reveal detailed feature importance for host features and a unified importance value for guest features, maintaining privacy.
The ability to interpret machine learning models has become increasingly important now that machine learning is used to inform consequential decisions. We propose an approach called model extraction for interpreting complex, blackbox models. Our approach approximates the complex model using a much more interpretable mo…
AWD distills neural network info into interpretable wavelets.
problem Imbalanced interpretability and efficiency in deep learning models.
method Adaptive wavelet distillation (AWD) penalizes neural network attributions in wavelet domain.
result AWD yields a concise, efficient, and interpretable model.
DeepCoDA provides personalized interpretability for complex health data.
problem Interpreting complex health data, especially compositional data, is challenging.
method DeepCoDA framework for high-dimensional compositional data, personalized interpretability through patient-specific weights.
result DeepCoDA maintains state-of-the-art performance and provides coherent, personalized interpretations.
NAMLSS models provide interpretable neural regression for location, scale, and shape.
problem Lack of interpretability in deep learning models for complex data distributions.
method Combines classical statistical methods with DNNs for distributional regression.
result Achieves visual interpretability and predictive power of deep learning models.
Interprets feature interactions in ad-click prediction models.
problem Improving interpretability of black-box recommender systems.
method Interprets feature interactions from a source model and encodes them in a target model.
result Interpretations significantly outperform existing recommender models.
Interpretation of a machine learning induced models is critical for feature engineering, debugging, and, arguably, compliance. Yet, best of breed machine learning models tend to be very complex. This paper presents a method for model interpretation which has the main benefit that the simple interpretations it provides …
Integrating causal machine learning with inherently interpretable models for decision support.
problem Providing causal insights and decision support through machine learning models.
method Proposing an approach that integrates causal machine learning with inherently interpretable models.
result The proposed approach achieves competitive performance in prediction and what-if analysis while offering transparency on the system structure, causal relationships among variables, and functional forms connecting them.
MALC combines interpretable linear models with black-box models for better predictions and transparency.
problem Combining interpretability with black-box models for better predictions.
method Formulates MALC as a convex optimization problem and uses accelerated proximal gradient method for training.
result MALC provides an efficient frontier balancing prediction accuracy and transparency.