Interpretability of ML models improves healthcare decisions.
problem Ensuring machine learning models are understandable for healthcare users.
method Classifying interpretability into local and global approaches, and model-specific vs. model-agnostic methods.
result Examples of practical interpretability in healthcare, including prediction and treatment optimization.
Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.
problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.
Transforms ensemble predictions to maintain interpretability.
problem Loss of interpretability in deep ensembles.
method Proposes transformation ensembles that aggregate predictions while preserving interpretability.
result Transformation ensembles yield better predictions than individual models and maintain interpretability.
Locally adaptive interpretable regression improves linear regression's predictability.
problem Linear regression's predictability is limited; it lacks adaptability.
method Locally adaptive interpretable regression (LoAIR) uses neural networks to predict percentile of a Gaussian distribution for regression coefficients.
result LoAIR achieves comparable or better predictive performance than state-of-the-art baselines.
New method learns to encode predictions within interpretations, improving evaluation.
problem Need for interpretable machine learning, but existing methods are slow or lack fidelity.
method Amortized explanation methods that learn a global selector model optimizing fidelity of interpretations.
result Predictions can be encoded within interpretations, detected by EVAL-X.
Paper proposes a new method to evaluate AI model interpretability in bond default prediction.
problem Lack of standardized method to assess inherent interpretability of AI models.
method Uses LIME and SHAP to assess feature contributions in bond default prediction.
result Consistent results with intuitive understanding of model interpretability.
Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of choosing between high accuracy (black-box models) and interpretability (interpr…
KACDP model improves credit default prediction with enhanced interpretability.
problem Insufficient interpretability and limited performance in credit default prediction.
method Kolmogorov-Arnold Networks (KANs) for handling complex multi-dimensional data.
result KACDP model outperforms mainstream models in performance metrics.
New model improves prediction accuracy and interpretability for network-connected data.
problem Reduced effective sample size and poor prediction performance in network-connected data.
method Network-assisted Random Forest+ (RF+) with interpretable feature importance measures.
result Highly competitive prediction accuracy and interpretable feature importance.
Interpretable companion model for black-box classifiers.
problem Dilemma between interpretable and black-box models.
method Trains a companion model from data and black-box model predictions, optimizing a combination of accuracy and complexity.
result Companion model provides interpretable predictions with a slight accuracy loss for user choice.
Proposes SCD-split for CP to balance interpretability and efficiency.
problem Difficult interpretation of disconnected subintervals in CP prediction sets.
method Incorporates smoothing operations into CP framework.
result SCD-split balances interval length and subinterval number, theoretically provable.
Interprets feature interactions in ad-click prediction models.
problem Improving interpretability of black-box recommender systems.
method Interprets feature interactions from a source model and encodes them in a target model.
result Interpretations significantly outperform existing recommender models.
Proposes a score to compare rule-based algorithms' interpretability.
problem Lack of consensus on interpretability for predictive models.
method Defines a score with three terms: predictivity, stability, and simplicity, each quantified by simple formulas.
result Compares interpretability of rule-based and tree-based algorithms for regression and classification.
Dockless bike sharing systems need effective bike flow prediction models.
problem Imbalanced and dynamic use of bikes leads to mandatory rebalancing operations.
method Divide urban area into regions, model spatio-temporal bike flows, extract traffic patterns, and predict bike flows.
result Interpretable bike flow prediction model provides valuable insights into bike flow analysis.
NLS simplifies complex predictions into easy-to-understand solutions.
problem Hard-to-interpret predictions from advanced machine learning models.
method Uses a neural network with a local linear shape to output layer.
result NLS provides comparable predictive power to state-of-the-art models but is easier to interpret.
Meta-ANOVA simplifies complex models for better interpretability.
problem Complex models are hard to interpret, limiting their use in fields needing accountability.
method Transforms black-box models into interpretable ANOVA models by screening unnecessary interactions.
result Meta-ANOVA provides an interpretable model for any prediction model, proving asymptotic consistency.
AWD distills neural network info into interpretable wavelets.
problem Imbalanced interpretability and efficiency in deep learning models.
method Adaptive wavelet distillation (AWD) penalizes neural network attributions in wavelet domain.
result AWD yields a concise, efficient, and interpretable model.
A framework learns interpretable models with minimal accuracy loss.
problem Tackles interpretability in deep learning models.
method Jointly learns a predictive model and its interpretation model with minimal loss of accuracy.
result Generates interpretable models with minimal loss of accuracy.
Understanding black-box machine learning models is crucial for their widespread adoption. Learning globally interpretable models is one approach, but achieving high performance with them is challenging. An alternative approach is to explain individual predictions using locally interpretable models. For locally interpre…
NGSLL combines DNN accuracy with linear model interpretability.
problem Combining high accuracy of DNNs with interpretability of linear models.
method Neural generators of sparse local linear models (NGSLL) using DNNs to approximate non-linear functions.
result Effective in real-world datasets, achieving high predictive performance and interpretability.
Machine-generated interpretations do not improve users' guessing accuracy in image classifiers.
problem Determining the usefulness of machine-generated explanations for deep neural networks.
method Human evaluation of crowd workers guessing incorrectly predicted labels with and without visual interpretations.
result Showing machine-generated visual interpretations decreased average guessing accuracy by about 10%.
A framework uses preprocessing to improve psychiatric questionnaire predictions while maintaining interpretability.
problem Weak predictive accuracy and limited interpretability of psychiatric questionnaires.
method Two-stage method: stable preprocessing followed by a linear mapping.
result REFINE outperforms other interpretable approaches in psychiatric and non-psychiatric prediction tasks.
HRTPP improves TPP interpretability and accuracy in medical event modeling.
problem Lack of interpretability in TPPs for medical event sequences.
method Hybrid-Rule Temporal Point Processes (HRTPP) integrating temporal logic rules and numerical features.
result HRTPP outperforms state-of-the-art interpretable TPPs in predictive performance and clinical interpretability.
Deep learning predicts ICU mortality with enhanced interpretability.
problem Improving mortality prediction accuracy and clinician trust in AI.
method Trained a deep learning model on MIMIC-III to interpret nursing notes.
result Model reaches ROC of 0.8629, outperforming SAPS-II.
Deep neural networks (DNNs) are known as black-box models. In other words, it is difficult to interpret the internal state of the model. Improving the interpretability of DNNs is one of the hot research topics. However, at present, the definition of interpretability for DNNs is vague, and the question of what is a high…
FRED explains text model predictions by identifying key words and providing counterfactual examples.
problem Lack of interpretable methods for text models that are complex, lack foundations, and have unguaranteed performance.
method FRED identifies minimal influential word sets, assigns token importance, and generates counterfactual examples.
result FRED provides reliable and effective explanations for text model predictions.
Integrating causal machine learning with inherently interpretable models for decision support.
problem Providing causal insights and decision support through machine learning models.
method Proposing an approach that integrates causal machine learning with inherently interpretable models.
result The proposed approach achieves competitive performance in prediction and what-if analysis while offering transparency on the system structure, causal relationships among variables, and functional forms connecting them.
We introduce a method, KL-LIME, for explaining predictions of Bayesian predictive models by projecting the information in the predictive distribution locally to a simpler, interpretable explanation model. The proposed approach combines the recent Local Interpretable Model-agnostic Explanations (LIME) method with ideas …
CrystalCandle creates user-friendly explanations for machine learning models.
problem Low trust in predictive models due to lack of interpretability.
method End-to-end pipeline for model interpretation, including Model Importer, Interpreter, Narrative Generator, and Exporter.
result CrystalCandle leads to higher adoption rates and improved downstream metrics.
Develops methods for making deep learning models more interpretable by answering counterfactual questions.
problem Lack of interpretability in deep learning models, especially in high-stakes applications.
method Introduces causal interpretability, a framework for building models that are causally interpretable by design.
result Identifies a fundamental tradeoff between causal interpretability and predictive accuracy.
DyS model improves survival analysis accuracy and interpretability.
problem Accurate and interpretable survival analysis models for healthcare.
method Feature-sparse Generalized Additive Model combining feature selection and interpretable prediction.
result DyS model outperforms other survival analysis models in interpretability and accuracy.
Interpretable survival analysis improves heart failure risk prediction.
problem Improving heart failure risk prediction using survival analysis.
method Survival stacking, ControlBurn, Explainable Boosting Machines.
result Achieves state-of-the-art performance and provides novel insights.
Ploutos predicts stock movements with financial LLM, improving interpretability.
problem Combining textual and numerical data for stock prediction and lack of interpretability.
method Proposes Ploutos framework combining PloutosGen and PloutosGPT for interpretable predictions.
result Framework outperforms state-of-the-art methods in prediction accuracy and interpretability.
Local surrogate model improves time series forecasts and provides interpretable explanations.
problem Improving time series forecasting accuracy while maintaining interpretability.
method A local surrogate model is used to correct the base model's predictions, making the corrections interpretable by re-fitting the base model to the error-predicted data.
result The method can discover and explain underlying patterns in the data, improving both accuracy and interpretability.
Selective neural network improves credit risk prediction while maintaining interpretability.
problem Improving credit risk prediction accuracy while maintaining interpretability for financial regulators.
method Introducing a neural network with a selective option to distinguish between linear and non-linear datasets.
result For most datasets, logistic regression is sufficient and interpretable, while for specific data portions, a shallow neural network model provides better accuracy.
A hybrid model combines piecewise linear and neural components for interpretable predictions.
problem Post-hoc interpretable methods lead to contradictory explanations and lower prediction accuracy.
method Hybrid model with piecewise linear and neural components.
result The model achieves good interpretability and state-of-the-art accuracy.
The paper examines how calibration affects the interpretability of ML models in diabetes screening.
problem Interpreting complex ML models in healthcare, especially in diabetes screening.
method Examined the impact of model calibration on interpretability using three visualization techniques.
result Calibrated models provide clearer cause-effect relationships in ML predictions.
CONFINE enhances neural networks' interpretability without sacrificing accuracy.
problem Lack of interpretability in deep neural networks, especially in healthcare.
method CONFINE uses conformal prediction to generate prediction sets with robust uncertainty estimates.
result CONFINE achieves correct efficiency up to 3.3% higher than original accuracy.
Proposes GPR with local explanation for feature interpretation.
problem Lack of feature interpretation in Gaussian process regression.
method Introduces a locally linear model to explain feature contributions in GPR predictions.
result Achieves comparable predictive performance to GPR and superior interpretability.
NAMLSS models provide interpretable neural regression for location, scale, and shape.
problem Lack of interpretability in deep learning models for complex data distributions.
method Combines classical statistical methods with DNNs for distributional regression.
result Achieves visual interpretability and predictive power of deep learning models.
Archipelago provides interpretable explanations of feature interactions in machine learning models.
problem Interpreting the impact of feature interactions on predictions in machine learning models.
method Archipelago is a novel framework for extracting and attributing feature interactions in a scalable and interpretable manner.
result Archipelago provides significantly more interpretable explanations of feature interactions than comparable methods.
More and more AI services are provided through APIs on cloud where predictive models are hidden behind APIs. To build trust with users and reduce potential application risk, it is important to interpret how such predictive models hidden behind APIs make their decisions. The biggest challenge of interpreting such predic…
This paper explores how to interpret machine learning models in business process analytics.
problem The lack of interpretability in machine learning models used for predictive process analytics.
method Derives explanations using interpretable machine learning techniques to compare and contrast predictive models.
result Highlights scenarios where accuracy alone may not be sufficient in assessing the suitability of techniques used to encode event log data.
State of the art machine learning algorithms are highly optimized to provide the optimal prediction possible, naturally resulting in complex models. While these models often outperform simpler more interpretable models by order of magnitudes, in terms of understanding the way the model functions, we are often facing a …
The paper investigates interpretability techniques for deep learning models in medical data.
problem Understanding the logic behind predictions of black-box models in medical decision-making.
method Applied deep neural networks and random forests to a medical dataset. Used autoencoders and local interpretable models to provide insights.
result Local interpretable models and autoencoders provide meaningful insights into cancer predictions, identifying distinct and non-generalizable features.
The increasing size and complexity of scientific data could dramatically enhance discovery and prediction for basic scientific applications. Realizing this potential, however, requires novel statistical analysis methods that are both interpretable and predictive. We introduce Union of Intersections (UoI), a flexible, m…
Paper introduces a hybrid GPR model for more interpretable RUL prediction in aeroengine.
problem Challenges in interpreting and modeling uncertainty in RUL prediction models.
method Modified Gaussian Process Regression (GPR) with temporal feature extraction.
result Effective prediction of RUL intervals with transparent feature significance.
Simpler model outperforms deep learning for disease prediction.
problem Challenges of deep learning models in interpretability and feasibility.
method Developed a simpler tree-based model for EHR data.
result Improved performance over deep learning models while maintaining interpretability.