Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

59117176234 · Jun 202019922001200920172026
48 results for ML interpretation

The paper examines how calibration affects the interpretability of ML models in diabetes screening.

problem Interpreting complex ML models in healthcare, especially in diabetes screening.
method Examined the impact of model calibration on interpretability using three visualization techniques.
result Calibrated models provide clearer cause-effect relationships in ML predictions.

Develops fair feature importance scores for tree-based models to interpret fairness.

problem Ensuring fairness in machine learning models, especially tree-based ones.
method Inspired by decision trees, proposes a novel fair feature importance score based on mean decrease in group bias.
result Valid interpretations of fairness for tree-based ensembles and surrogates of other ML systems.

Decisions by Machine Learning (ML) models have become ubiquitous. Trusting these decisions requires understanding how algorithms take them. Hence interpretability methods for ML are an active focus of research. A central problem in this context is that both the quality of interpretability methods as well as trust in ML…

2019-01-20abs ↗pdf ↗

Model-agnostic interpretation methods can mislead if not used carefully.

problem Misinterpretation of machine learning models due to improper use of techniques.
method General pitfalls of model-agnostic interpretation methods.
result Many pitfalls exist when using global interpretation techniques for machine learning models.

Meta-learning approach to learn interpretable models from human feedback.

problem Tackling the challenge of making machine learning models interpretable.
method A meta-learning approach where a model of non-trivial proxies of human interpretability is learned from human feedback, then incorporated into the ML training process to optimize for interpretability.
result The approach leads to formulas that are either significantly more or equally accurate while being more interpretable.

Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.

problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.

Framework for interpreting ML models to reveal properties of real-world phenomena.

problem Lack of direct interpretability in modern ML models hinders scientific understanding.
method Developed 'property descriptors' grounded in statistical learning theory.
result Property descriptors can reveal relevant properties of joint probability distributions.

New method for interpreting complex ML models.

problem Interpreting complex black-box ML models.
method Functional decomposition of black-box predictions into simpler subfunctions.
result Main effects provide insights into feature contributions and interactions.

Interpretable ML methods for better decision-making with explanations.

problem Lack of transparency in black-box ML models.
method Use of Formal Concept Analysis and cooperative game theory to assess attribute importance and reduce attribute count.
result Developed methods to assess attribute importance and reduce attribute count in ML models.

WISCA generates consensus explanations from conflicting model-agnostic interpretability methods.

problem Conflicting explanations from diverse interpretability algorithms.
method WISCA integrates class probability and normalized attributions to generate consistent explanations.
result WISCA consistently aligns with the most reliable individual method, improving explanation reliability.

SMILE improves explainability of machine learning models.

problem Difficulty in understanding and trusting the conclusions of black-box machine learning models.
method Statistical Model-agnostic Interpretability with Local Explanations (SMILE).
result SMILE makes machine learning models more interpretable.

A human-in-the-loop ML framework for precision dosing reduces expert workload and removes bias.

problem High cost of data annotation and lack of appropriate data for ML models.
method Incorporates human experts into the model learning loop to improve interpretability and reduce bias.
result The approach learns interpretable rules from data and potentially lowers expert workload.

New insights into ML models' accuracy and generalization for scientific problems.

problem Quantifying accuracy and generalization of ML models in scientific applications.
method Rigorous numerical analysis and theoretical bounds for linear differential equations.
result Different ML models can have opposing generalization behaviors, contrary to intuition.

A rigorous ML pipeline for binary classification in biomedical studies, focusing on pancreatic cancer.

problem Handling bias in ML models for complex biomedical data.
method Customizable ML analysis pipeline with 9 algorithms, hyperparameter optimization, and thorough evaluation.
result Comparison of ML algorithms to ExSTraCS, highlighting interpretability and bias handling.

Improved KernelSHAP via linear regression for ML model interpretation.

problem Efficiently estimating Shapley values in model-agnostic settings.
method Revisiting KernelSHAP via linear regression, developing techniques for convergence and uncertainty.
result Original KernelSHAP incurs negligible bias for significant variance reduction.

New ML algorithms improve model interpretability without sacrificing performance.

problem Lack of interpretability in complex machine learning models.
method Developed new algorithms based on fANOVA framework, including GAMI-Lin-T and GAMI-Net.
result GAMI-Lin-T and GAMI-Net perform comparably to EBM and better in interpretability.

Machine learning speeds up FLIM analysis in biomedical research.

problem Complex, slow, and computationally expensive FLIM analysis.
method Machine learning techniques for faster and smarter FLIM data extraction and interpretation.
result Higher accuracy in classifying and segmenting FLIM images compared to conventional methods.

This paper provides a guide to feature importance methods for better scientific inference.

problem Limited understanding of data-generating process due to opaque ML model mechanisms.
method Comprehensive review and new proofs of global feature importance methods.
result Facilitates a thorough understanding and concrete recommendations for FI methods.

New method for robustly interpreting ML models using quantile constraints and Wasserstein projections.

problem Assessing robustness of black-box models to input misspecification.
method Quantile-constrained Wasserstein projections for robust interpretability.
result Analytical solution for perturbation problem and smooth perturbations.

Diamond method controls FDR for trustworthy feature interaction discovery in ML models.

problem Limited interpretability of ML models due to black box nature.
method Diamond method integrates model-X knockoffs framework to control FDR for non-additive interactions.
result Diamond method ensures accurate discovery of feature interactions with FDR control.

Study uses ML to predict currency and bond returns from news sentiment.

problem Predicting financial returns from news sentiment.
method Pretrained FinBERT model on finance-specific language, XGBoost classifier, SHAP for interpretability.
result XGBoost strategy outperforms benchmarks with Sharpe ratios > 5.

Survey on principles and challenges of interpretable machine learning.

problem Improving machine learning models' interpretability for high-stakes decisions.
method Identification and analysis of 10 technical challenges in interpretable machine learning.
result Identification of 10 technical challenges in interpretable machine learning.

Study compares and contrasts various ML explanation methods, highlighting their disagreements and similarities.

problem Understanding and quantifying the differences between various machine learning explanation methods.
method Synthesized and visualized various explanation methods for global and local aspects of ML models.
result There is substantial agreement on the top features but less on specific rankings, and tree interpreter is comparable to SHAP for feature effects.

Survey on uncertainty in ML and DL, covering sources, quantification, and decision-making.

problem Understanding and quantifying uncertainty in ML and DL for risk-sensitive applications.
method Structured review of literature, categorizing uncertainty, assessing uncertainty quantification techniques.
result Broadened scope of uncertainty discussion and updated DL uncertainty quantification methods.

Improved interpretability methods for ML models using local regressions and variable importance.

problem Inability of existing interpretability methods to provide reliable explanations for ML models, especially in high-dimensional problems with irrelevant features and non-linear relationships.
method Introduces VarImp and SupClus methods using local regressions with weighted distance considering variable importance.
result VarImp and SupClus methods yield better explanations than state-of-the-art approaches, especially in high-dimensional problems with irrelevant features and non-linear relationships.

Brief history and challenges of interpretable machine learning.

problem Challenges in interpreting machine learning models, especially in scientific applications.
method Overview of state-of-the-art methods and discussion of challenges.
result Interpretable machine learning has a rich history but faces significant challenges.

Understanding and interpreting how machine learning (ML) models make decisions have been a big challenge. While recent research has proposed various technical approaches to provide some clues as to how an ML model makes individual predictions, they cannot provide users with an ability to inspect a model as a complete e…

2018-11-07abs ↗pdf ↗

Molecular Dynamics (MD) simulation is widely used to analyze the properties of molecules and materials. Most practical applications, such as comparison with experimental measurements, designing drug molecules, or optimizing materials, rely on statistical quantities, which may be prohibitively expensive to compute from …

2018-12-18abs ↗pdf ↗

A new method selects robust features for ML models using causal discovery.

problem Challenges in feature selection for ML models with limited domain knowledge.
method Multidata causal feature selection using PC1 or PCMCI algorithms.
result The method improves model performance and provides interpretable drivers.

New method attributes feature uncertainty in ML models using cooperative game theory.

problem Lack of feature-level uncertainty attribution in explainable AI.
method Proposes a novel, model-agnostic uncertainty attribution method using cooperative game theory and conformal prediction.
result Demonstrates improved runtime efficiency and practical utility in real-world applications.

This paper reviews feature selection in KGs for improved ML model performance.

problem Improving feature selection in KGs for better machine learning model efficacy.
method Comprehensive review of feature selection methodologies in KGs.
result Advancement in scalability, accuracy, and interpretability of feature selection techniques.

NSA-Flow optimizes matrix representations for interpretability in complex data.

problem Balancing interpretability and model flexibility in high-dimensional data.
method Non-negative Stiefel Approximating Flow (NSA-Flow) unifies sparse matrix factorization and orthogonalization.
result NSA-Flow yields sparse, stable, and interpretable representations.