The paper examines how calibration affects the interpretability of ML models in diabetes screening.
problem Interpreting complex ML models in healthcare, especially in diabetes screening.
method Examined the impact of model calibration on interpretability using three visualization techniques.
result Calibrated models provide clearer cause-effect relationships in ML predictions.
Develops fair feature importance scores for tree-based models to interpret fairness.
problem Ensuring fairness in machine learning models, especially tree-based ones.
method Inspired by decision trees, proposes a novel fair feature importance score based on mean decrease in group bias.
result Valid interpretations of fairness for tree-based ensembles and surrogates of other ML systems.
Decisions by Machine Learning (ML) models have become ubiquitous. Trusting these decisions requires understanding how algorithms take them. Hence interpretability methods for ML are an active focus of research. A central problem in this context is that both the quality of interpretability methods as well as trust in ML…
Recent efforts in Machine Learning (ML) interpretability have focused on creating methods for explaining black-box ML models. However, these methods rely on the assumption that simple approximations, such as linear models or decision-trees, are inherently human-interpretable, which has not been empirically tested. Addi…
Model-agnostic interpretation methods can mislead if not used carefully.
problem Misinterpretation of machine learning models due to improper use of techniques.
method General pitfalls of model-agnostic interpretation methods.
result Many pitfalls exist when using global interpretation techniques for machine learning models.
Meta-learning approach to learn interpretable models from human feedback.
problem Tackling the challenge of making machine learning models interpretable.
method A meta-learning approach where a model of non-trivial proxies of human interpretability is learned from human feedback, then incorporated into the ML training process to optimize for interpretability.
result The approach leads to formulas that are either significantly more or equally accurate while being more interpretable.
Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.
problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.
Framework for interpreting ML models to reveal properties of real-world phenomena.
problem Lack of direct interpretability in modern ML models hinders scientific understanding.
method Developed 'property descriptors' grounded in statistical learning theory.
result Property descriptors can reveal relevant properties of joint probability distributions.
Systematic review of ML explainability in process mining.
problem Understanding the black-box nature of ML models in process mining.
method Systematic literature review using PRISMA framework.
result Identification of key trends and challenges in interpretability.
New method for interpreting complex ML models.
problem Interpreting complex black-box ML models.
method Functional decomposition of black-box predictions into simpler subfunctions.
result Main effects provide insights into feature contributions and interactions.
AutoML system boosts interpretability without sacrificing performance.
problem Laypeople struggle with interpreting complex ensembles of black-box models.
method Componentwise boosting algorithm for interpretable additive models.
result Interpretable models are competitive in performance and user-friendly.
Spin-opstrings from QMC simulations enable ML of quantum phases.
problem Capturing and predicting quantum phase transitions using ML.
method Spin-opstrings derived from QMC simulations used as ML input.
result Spin-opstrings accurately predict quantum phase transitions.
New method visualizes tabular feature semantics for better model understanding.
problem Lack of feature interaction interpretation in tabular ML models.
method Feature Vectors method for global tabular dataset interpretability.
result Visualizes semantic relationships among tabular features.
Interpretable ML methods for better decision-making with explanations.
problem Lack of transparency in black-box ML models.
method Use of Formal Concept Analysis and cooperative game theory to assess attribute importance and reduce attribute count.
result Developed methods to assess attribute importance and reduce attribute count in ML models.
WISCA generates consensus explanations from conflicting model-agnostic interpretability methods.
problem Conflicting explanations from diverse interpretability algorithms.
method WISCA integrates class probability and normalized attributions to generate consistent explanations.
result WISCA consistently aligns with the most reliable individual method, improving explanation reliability.
SMILE improves explainability of machine learning models.
problem Difficulty in understanding and trusting the conclusions of black-box machine learning models.
method Statistical Model-agnostic Interpretability with Local Explanations (SMILE).
result SMILE makes machine learning models more interpretable.
A human-in-the-loop ML framework for precision dosing reduces expert workload and removes bias.
problem High cost of data annotation and lack of appropriate data for ML models.
method Incorporates human experts into the model learning loop to improve interpretability and reduce bias.
result The approach learns interpretable rules from data and potentially lowers expert workload.
New insights into ML models' accuracy and generalization for scientific problems.
problem Quantifying accuracy and generalization of ML models in scientific applications.
method Rigorous numerical analysis and theoretical bounds for linear differential equations.
result Different ML models can have opposing generalization behaviors, contrary to intuition.
Proposes a model to interpret complex ML algorithms.
problem Complex ML models are hard to interpret.
method Uses model-based regression trees and interpretable main-effects models.
result Surrogate model provides interpretable results with good predictive performance.
A rigorous ML pipeline for binary classification in biomedical studies, focusing on pancreatic cancer.
problem Handling bias in ML models for complex biomedical data.
method Customizable ML analysis pipeline with 9 algorithms, hyperparameter optimization, and thorough evaluation.
result Comparison of ML algorithms to ExSTraCS, highlighting interpretability and bias handling.
Improved KernelSHAP via linear regression for ML model interpretation.
problem Efficiently estimating Shapley values in model-agnostic settings.
method Revisiting KernelSHAP via linear regression, developing techniques for convergence and uncertainty.
result Original KernelSHAP incurs negligible bias for significant variance reduction.
New ML algorithms improve model interpretability without sacrificing performance.
problem Lack of interpretability in complex machine learning models.
method Developed new algorithms based on fANOVA framework, including GAMI-Lin-T and GAMI-Net.
result GAMI-Lin-T and GAMI-Net perform comparably to EBM and better in interpretability.
Machine learning speeds up FLIM analysis in biomedical research.
problem Complex, slow, and computationally expensive FLIM analysis.
method Machine learning techniques for faster and smarter FLIM data extraction and interpretation.
result Higher accuracy in classifying and segmenting FLIM images compared to conventional methods.
This paper provides a guide to feature importance methods for better scientific inference.
problem Limited understanding of data-generating process due to opaque ML model mechanisms.
method Comprehensive review and new proofs of global feature importance methods.
result Facilitates a thorough understanding and concrete recommendations for FI methods.
New method for robustly interpreting ML models using quantile constraints and Wasserstein projections.
problem Assessing robustness of black-box models to input misspecification.
method Quantile-constrained Wasserstein projections for robust interpretability.
result Analytical solution for perturbation problem and smooth perturbations.
Two XAI methods, SHAP and LIME, are discussed for tabular data models.
problem Making machine learning models transparent and trustworthy.
method SHAP and LIME methods for explaining model predictions.
result SHAP and LIME are model-dependent and sensitive to feature collinearity.
Diamond method controls FDR for trustworthy feature interaction discovery in ML models.
problem Limited interpretability of ML models due to black box nature.
method Diamond method integrates model-X knockoffs framework to control FDR for non-additive interactions.
result Diamond method ensures accurate discovery of feature interactions with FDR control.
Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been implemented in numerous open source and commercial packages and explainable ML i…
Extracts factors from Treasury yields using ML techniques.
problem Understanding factors underlying Treasury yields.
method Nonnegative Matrix Factorization (NMF) and clustering.
result Factors identified through NMF and clustering.
Develops ML tool for macroeconomic forecasting with clear interpretations.
problem Forecasting and understanding macroeconomic parameters over time.
method Macroeconomic Random Forest (MRF) algorithm, Generalized Time-Varying Parameters (GTVPs).
result Clear forecasting gains and accurate predictions of unemployment and inflation.
Study uses ML to predict currency and bond returns from news sentiment.
problem Predicting financial returns from news sentiment.
method Pretrained FinBERT model on finance-specific language, XGBoost classifier, SHAP for interpretability.
result XGBoost strategy outperforms benchmarks with Sharpe ratios > 5.
Survey on principles and challenges of interpretable machine learning.
problem Improving machine learning models' interpretability for high-stakes decisions.
method Identification and analysis of 10 technical challenges in interpretable machine learning.
result Identification of 10 technical challenges in interpretable machine learning.
Study compares and contrasts various ML explanation methods, highlighting their disagreements and similarities.
problem Understanding and quantifying the differences between various machine learning explanation methods.
method Synthesized and visualized various explanation methods for global and local aspects of ML models.
result There is substantial agreement on the top features but less on specific rankings, and tree interpreter is comparable to SHAP for feature effects.
ML reduces high-dimensional data to reveal its underlying structure.
problem Handling large, high-dimensional data sets.
method Non-linear dimension reduction techniques.
result Reveals the geometric shape of high-dimensional data.
Interpretable ML models for missing data and visualisation.
problem Understanding and evaluating fairness in ML models.
method Introduced angle-based variants of Learning Vector Quantization (LVQ) models.
result Models can handle missing values and extract knowledge from datasets.
Survey on uncertainty in ML and DL, covering sources, quantification, and decision-making.
problem Understanding and quantifying uncertainty in ML and DL for risk-sensitive applications.
method Structured review of literature, categorizing uncertainty, assessing uncertainty quantification techniques.
result Broadened scope of uncertainty discussion and updated DL uncertainty quantification methods.
Improved interpretability methods for ML models using local regressions and variable importance.
problem Inability of existing interpretability methods to provide reliable explanations for ML models, especially in high-dimensional problems with irrelevant features and non-linear relationships.
method Introduces VarImp and SupClus methods using local regressions with weighted distance considering variable importance.
result VarImp and SupClus methods yield better explanations than state-of-the-art approaches, especially in high-dimensional problems with irrelevant features and non-linear relationships.
A review of ML and DL for ecological data analysis.
problem Understanding the strengths and limitations of ML and DL in ecological research.
method Historical overview, algorithm families, differences, universal principles, and emerging trends.
result ML and DL excel in prediction tasks but are still debated for causal inference.
Brief history and challenges of interpretable machine learning.
problem Challenges in interpreting machine learning models, especially in scientific applications.
method Overview of state-of-the-art methods and discussion of challenges.
result Interpretable machine learning has a rich history but faces significant challenges.
Understanding and interpreting how machine learning (ML) models make decisions have been a big challenge. While recent research has proposed various technical approaches to provide some clues as to how an ML model makes individual predictions, they cannot provide users with an ability to inspect a model as a complete e…
fintech-kMC simulates financial platforms for AI/ML model validation.
problem Validation of AI/ML models in real-world financial applications.
method Agent-based model with kinetic Monte Carlo engine.
result Generates realistic synthetic data for testing AI/ML models.
Molecular Dynamics (MD) simulation is widely used to analyze the properties of molecules and materials. Most practical applications, such as comparison with experimental measurements, designing drug molecules, or optimizing materials, rely on statistical quantities, which may be prohibitively expensive to compute from …
Interpretable ML helps discover insights from big data.
problem Validating data-driven discoveries from complex datasets.
method Statistical and machine learning techniques for interpretable models.
result Challenges in validating data-driven discoveries remain.
A new method selects robust features for ML models using causal discovery.
problem Challenges in feature selection for ML models with limited domain knowledge.
method Multidata causal feature selection using PC1 or PCMCI algorithms.
result The method improves model performance and provides interpretable drivers.
New method attributes feature uncertainty in ML models using cooperative game theory.
problem Lack of feature-level uncertainty attribution in explainable AI.
method Proposes a novel, model-agnostic uncertainty attribution method using cooperative game theory and conformal prediction.
result Demonstrates improved runtime efficiency and practical utility in real-world applications.
This paper reviews feature selection in KGs for improved ML model performance.
problem Improving feature selection in KGs for better machine learning model efficacy.
method Comprehensive review of feature selection methodologies in KGs.
result Advancement in scalability, accuracy, and interpretability of feature selection techniques.
NSA-Flow optimizes matrix representations for interpretability in complex data.
problem Balancing interpretability and model flexibility in high-dimensional data.
method Non-negative Stiefel Approximating Flow (NSA-Flow) unifies sparse matrix factorization and orthogonalization.
result NSA-Flow yields sparse, stable, and interpretable representations.
Overview of SML techniques with banking applications.
problem Credit risk modeling in banking.
method Tree-based ensemble algorithms, Feedforward NNs, hyper-parameter optimization, machine learning interpretability.
result Comparison of ML algorithm features and their application in banking.