This paper explores causal analysis in machine learning for better interpretability.
problem The lack of causality in traditional interpretable machine learning models.
method An overview of causal approaches for interpretable machine learning.
result Causal analysis improves the interpretability of machine learning models.
As machine learning systems become ubiquitous, there has been a surge of interest in interpretable machine learning: systems that provide explanation for their outputs. These explanations are often used to qualitatively assess other criteria such as safety or non-discrimination. However, despite the interest in interpr…
There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models allow healthcare experts to make reasonable and data-driven decisions to provide…
Survey on principles and challenges of interpretable machine learning.
problem Improving machine learning models' interpretability for high-stakes decisions.
method Identification and analysis of 10 technical challenges in interpretable machine learning.
result Identification of 10 technical challenges in interpretable machine learning.
The term "interpretability" is oftenly used by machine learning researchers each with their own intuitive understanding of it. There is no universal well agreed upon definition of interpretability in machine learning. As any type of science discipline is mainly driven by the set of formulated questions rather than by d…
Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a comprehensive understanding of the achievements and challenges is still lacking…
Integrating causal machine learning with inherently interpretable models for decision support.
problem Providing causal insights and decision support through machine learning models.
method Proposing an approach that integrates causal machine learning with inherently interpretable models.
result The proposed approach achieves competitive performance in prediction and what-if analysis while offering transparency on the system structure, causal relationships among variables, and functional forms connecting them.
Study finds machine learning interpretations are often unstable and unreliable.
problem Reliability of machine learning interpretations in high-stakes domains.
method Stability study on global interpretations using tabular data.
result Popular interpretation methods are frequently unstable, less stable than predictions, and not associated with prediction accuracy.
While the interpretability of machine learning models is often equated with their mere syntactic comprehensibility, we think that interpretability goes beyond that, and that human interpretability should also be investigated from the point of view of cognitive science. The goal of this paper is to discuss to what exten…
InterpretML is an open-source Python package which exposes machine learning interpretability algorithms to practitioners and researchers. InterpretML exposes two types of interpretability - glassbox models, which are machine learning models designed for interpretability (ex: linear models, rule lists, generalized addit…
Interpretable ML helps discover insights from big data.
problem Validating data-driven discoveries from complex datasets.
method Statistical and machine learning techniques for interpretable models.
result Challenges in validating data-driven discoveries remain.
Interpreting machine learning models helps understand adversarial attacks and defenses.
problem Understanding model vulnerability to adversarial attacks.
method Model interpretation techniques to explore adversarial attacks and defenses.
result Interpretation methods can be applied to adversarial attacks and defenses.
The ability to interpret machine learning models has become increasingly important now that machine learning is used to inform consequential decisions. We propose an approach called model extraction for interpreting complex, blackbox models. Our approach approximates the complex model using a much more interpretable mo…
Understanding why machine learning models behave the way they do empowers both system designers and end-users in many ways: in model selection, feature engineering, in order to trust and act upon the predictions, and in more intuitive user interfaces. Thus, interpretability has become a vital concern in machine learnin…
The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can be used to create more interpretable machine learning models. By proposing a nove…
A novel approach combines interpretability and performance in machine learning models.
problem Lack of transparency in black box machine learning models.
method Semiparametric approach using ideas from sufficient dimension reduction and influence function based estimators.
result Optimized model combining interpretability and performance, demonstrated through simulations and a real-world ICU patient data application.
New approach interprets machine learning models through feature space transformations.
problem Interpreting models with strongly dependent features in high-dimensional spaces.
method Feature space transformations, including PCA and partial orthogonalization.
result Enhances model interpretation tools for domain experts.
FiberNet integrates geometry into machine learning for clearer classification.
problem Lack of interpretability in traditional deep learning.
method Reformulates classification as geometric optimization on fiber bundles, introducing learnable Riemannian metrics and variational prototype optimization.
result Clear geometric interpretability and efficiency in classification.
This is the Proceedings of NIPS 2017 Symposium on Interpretable Machine Learning, held in Long Beach, California, USA on December 7, 2017
In recent years, machine learning researchers have focused on methods to construct flexible and interpretable prediction models. However, an interpretability evaluation, a relationship between generalization performance and an interpretability of the model and a method for improving the interpretability have to be cons…
The study predicts Kronecker coefficients using interpretable machine learning models.
problem Predicting Kronecker coefficients of the symmetric group.
method Employed interpretable machine learning models with input features of triples of partitions and b-loadings.
result Achieved an accuracy of approximately 83% and over 99% with transformer-based models.
Researchers introduce a method to assess the safety of interpretable machine learning models.
problem Ensuring safety in machine learning models that are easy to understand.
method Introduce maximum deviation as an optimization problem to find the largest deviation from a safe reference model.
result Interpretability helps in assessing the safety of machine learning models.
Brief history and challenges of interpretable machine learning.
problem Challenges in interpreting machine learning models, especially in scientific applications.
method Overview of state-of-the-art methods and discussion of challenges.
result Interpretable machine learning has a rich history but faces significant challenges.
The study designs inherently interpretable machine learning models for high-risk sectors.
problem The need for transparent and explainable machine learning models in regulated industries.
method Qualitative template based on feature effects and model architecture constraints for assessing inherent interpretability.
result Demonstrates the design and evaluation of an interpretable ReLU DNN model for predicting credit default.
Framework for interpreting ML models to reveal properties of real-world phenomena.
problem Lack of direct interpretability in modern ML models hinders scientific understanding.
method Developed 'property descriptors' grounded in statistical learning theory.
result Property descriptors can reveal relevant properties of joint probability distributions.
Matched Machine Learning combines machine learning and matching for causal inference.
problem Non-interpretable methods for causal inference.
method Combines machine learning and matching for interpretable causal inference.
result Performs as well as black-box machine learning methods and better than existing matching methods.
This is the Proceedings of NIPS 2016 Workshop on Interpretable Machine Learning for Complex Systems, held in Barcelona, Spain on December 9, 2016
Proposes a model to interpret complex ML algorithms.
problem Complex ML models are hard to interpret.
method Uses model-based regression trees and interpretable main-effects models.
result Surrogate model provides interpretable results with good predictive performance.
Our everyday interactions with pervasive systems generate traces that capture various aspects of human behavior and enable machine learning algorithms to extract latent information about users. In this paper, we propose a machine learning interpretability framework that enables users to understand how these generated t…
Survey on causal interpretability models for machine learning.
problem Understanding and explaining the decisions made by machine learning models.
method Comprehensive survey on causal interpretable models.
result Evaluation metrics for interpretability are discussed.
The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on two definitions of interpretability that have been introduced in the machine learn…
Interactive visualization helps understand complex machine learning models.
problem Low interpretability of machine learning models.
method Interactive slice visualization of predictor space, using interaction or touring algorithms.
result Enhances understanding and validation of machine learning model fits.
Model-agnostic interpretation methods can mislead if not used carefully.
problem Misinterpretation of machine learning models due to improper use of techniques.
method General pitfalls of model-agnostic interpretation methods.
result Many pitfalls exist when using global interpretation techniques for machine learning models.
Transfer learning improves sparse, interpretable probabilistic classification.
problem Sparse and interpretable models in transfer learning.
method Two transfer learning extensions integrated into sparse and interpretable probabilistic classification vector machine.
result Transfer learning extensions improve sparsity and performance.
The paper advocates for interpretable, accountable, reproducible machine learning in medicine.
problem Black box models in medicine lack transparency and regulatory approval.
method Intrinsically interpretable modeling approaches and collaborative learning paradigms.
result Interpretable machine learning models can support clinical decisions and gain regulatory approval.
Paper tackles interpretability issues in deep learning models.
problem Lack of understanding of deep learning models' decision-making processes.
method Integrates concepts from machine learning, quantum computation, and quantum field theory.
result Demonstrates a many valued quantum logic system in Convolutional Deep Belief Networks.
Framework optimizes model performance and interpretability for tabular data.
problem Balancing model performance and interpretability in machine learning models.
method Model-agnostic multi-objective optimization framework with evolutionary algorithm.
result Framework generates diverse models that trade off performance and interpretability efficiently.
Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.
problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.
Interpretation of a machine learning induced models is critical for feature engineering, debugging, and, arguably, compliance. Yet, best of breed machine learning models tend to be very complex. This paper presents a method for model interpretation which has the main benefit that the simple interpretations it provides …
The effectiveness of machine learning algorithms depends on the quality and amount of data and the operationalization and interpretation by the human analyst. In humanitarian response, data is often lacking or overburdening, thus ambiguous, and the time-scarce, volatile, insecure environments of humanitarian activities…
Novel framework explains machine learning models using ontology-based sampling.
problem Generating precise and insightful explanations for machine learning models.
method Ontology-based sampling technique and learnable anchor algorithm.
result Our approach generates more precise and insightful explanations.
A method interprets black-box models using an ensemble of gradient boosting machines.
problem Local and global interpretation of black-box models.
method An ensemble of gradient boosting machines (GBMs) to form a generalized additive model.
result Efficiency and properties demonstrated on synthetic and real datasets.
Selective neural network improves credit risk prediction while maintaining interpretability.
problem Improving credit risk prediction accuracy while maintaining interpretability for financial regulators.
method Introducing a neural network with a selective option to distinguish between linear and non-linear datasets.
result For most datasets, logistic regression is sufficient and interpretable, while for specific data portions, a shallow neural network model provides better accuracy.
Interpretable machine learning has gained much attention recently. Briefness and comprehensiveness are necessary in order to provide a large amount of information concisely when explaining a black-box decision system. However, existing interpretable machine learning methods fail to consider briefness and comprehensiven…
The paper connects machine learning interpretability with learning theory.
problem Performance and explanation generalization in local machine learning models.
method Theoretical analysis and empirical validation of local approximation explanations.
result Theoretical bounds on test-time accuracy and explanation generalization.
The study improves Bitcoin price prediction using hybrid machine learning and enhances interpretability.
problem Improving Bitcoin price prediction accuracy and interpretability.
method Hybrid machine learning algorithms (OLS, LASSO, LSTM, decision tree regressors) and preprocessing techniques for time-series data.
result Linear regression achieves the best performance in predicting Bitcoin prices.
Paper uses ML to predict SME defaults with interpretability.
problem Lack of interpretability in ML models for SME default prediction.
method Model-agnostic approach using Accumulated Local Effects and Shapley values.
result eXtreme Gradient Boosting algorithm provides highest classification power with interpretability.
New method learns to encode predictions within interpretations, improving evaluation.
problem Need for interpretable machine learning, but existing methods are slow or lack fidelity.
method Amortized explanation methods that learn a global selector model optimizing fidelity of interpretations.
result Predictions can be encoded within interpretations, detected by EVAL-X.