Machine learning is used more and more often for sensitive applications, sometimes replacing humans in critical decision-making processes. As such, interpretability of these algorithms is a pressing need. One popular algorithm to provide interpretability is LIME (Local Interpretable Model-Agnostic Explanation). In this…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “LIME Explainability”
Improved LIME robustness against adversarial manipulation.
problem LIME's naive sampling strategy can be exploited to hide biased behavior.
method Training a GAN to generate more realistic synthetic data for explanations.
result Our method increases accuracy in detecting biased behavior compared to vanilla LIME.
Surrogate explainers of black-box machine learning predictions are of paramount importance in the field of eXplainable Artificial Intelligence since they can be applied to any type of data (images, text and tabular), are model-agnostic and are post-hoc (i.e., can be retrofitted). The Local Interpretable Model-agnostic …
Explainability is a gateway between Artificial Intelligence and society as the current popular deep learning models are generally weak in explaining the reasoning process and prediction results. Local Interpretable Model-agnostic Explanation (LIME) is a recent technique that explains the predictions of any classifier f…
The paper analyzes LIME for tabular data and proves its behavior in large samples.
problem Understanding the behavior of LIME in tabular data settings.
method Theoretical analysis of LIME's behavior in tabular data, proving its properties in the large sample limit.
result LIME provides explanations proportional to the coefficients of the function in linear cases, but can produce misleading explanations for partition-based models.
Green LIME reduces LIME's computational cost through optimal design of experiments.
problem Improving AI explainability in critical fields like healthcare.
method Optimal design of experiments to reduce LIME's computational cost.
result Significant reduction in computational effort of LIME.
We present a heuristic based algorithm to induce \textit{nonmonotonic} logic programs that will explain the behavior of XGBoost trained classifiers. We use the technique based on the LIME approach to locally select the most important features contributing to the classification decision. Then, in order to explain the mo…
Two XAI methods, SHAP and LIME, are discussed for tabular data models.
problem Making machine learning models transparent and trustworthy.
method SHAP and LIME methods for explaining model predictions.
result SHAP and LIME are model-dependent and sensitive to feature collinearity.
Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results. Explainability is not only a gateway between AI and society but also a powerful tool t…
The paper analyzes LIME for text data and provides theoretical guarantees.
problem LIME's lack of theoretical guarantees in explaining complex models.
method Theoretical analysis of LIME for text data, focusing on decision trees and linear models.
result LIME provides meaningful explanations for simple models like decision trees and linear models.
S-LIME stabilizes LIME for more reliable model explanations.
problem Instability of post hoc explanation methods like LIME.
method Uses hypothesis testing based on central limit theorem to stabilize explanations.
result Demonstrates effectiveness of S-LIME on simulated and real-world data.
OptiLIME improves LIME explanations by balancing stability and adherence.
problem LIME's instability and lack of reliability in explanations.
method OptiLIME uses a deterministic sampling approach and feature selection to maximize stability while retaining predefined adherence.
result OptiLIME provides more reliable and interpretable explanations.
We introduce a method, KL-LIME, for explaining predictions of Bayesian predictive models by projecting the information in the predictive distribution locally to a simpler, interpretable explanation model. The proposed approach combines the recent Local Interpretable Model-agnostic Explanations (LIME) method with ideas …
Local Interpretable Model-Agnostic Explanations (LIME) is a popular technique used to increase the interpretability and explainability of black box Machine Learning (ML) algorithms. LIME typically generates an explanation for a single prediction by any ML model by learning a simpler interpretable model (e.g. linear cla…
This paper enhances credit risk management using explainable AI techniques.
problem Lack of transparency and explainability in AI models for credit risk management.
method Implement LIME and SHAP for explaining ML-based credit scoring models.
result Demonstrates practical challenges and solutions for XAI methods in finance.
LIME is a popular approach for explaining a black-box prediction through an interpretable model that is trained on instances in the vicinity of the predicted instance. To generate these instances, LIME randomly selects a subset of the non-zero features of the predicted instance. After that, the perturbed instances are …
The problem of explaining deep learning models, and model predictions generally, has attracted intensive interest recently. Many successful approaches forgo global approximations in order to provide more faithful local interpretations of the model's behavior. LIME develops multiple interpretable models, each approximat…
Paper proposes LIME for explaining machine learning credit risk predictions.
problem Lack of explainability in machine learning models for credit risk.
method Uses LIME technique to explain machine learning predictions.
result LIME improves explainability of machine learning models in credit risk.
DCENWCNet improves WBC classification with LIME-based explainability.
problem Classifying white blood cells from blood images with high accuracy and interpretability.
method Integrates three CNN architectures with different settings to balance feature learning and performance.
result Achieves highest mean accuracy on the Rabbin-WBC dataset, outperforming state-of-the-art networks.
Supervised Machine Learning (SML) algorithms such as Gradient Boosting, Random Forest, and Neural Networks have become popular in recent years due to their increased predictive performance over traditional statistical methods. This is especially true with large data sets (millions or more observations and hundreds to t…
Deep convolutional neural networks have achieved great successes over recent years, particularly in the domain of computer vision. They are fast, convenient, and -- thanks to mature frameworks -- relatively easy to implement and deploy. However, their reasoning is hidden inside a black box, in spite of a number of prop…
As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such explanations are being leveraged by domain experts to diagnose systematic error…
Explainable Post hoc Portfolio Management Financial Policy of a Deep Reinforcement Learning agentcs.CE
Developed an explainable DRL model for financial portfolio management.
problem Inability of DRL agents to provide interpretable financial investment policies.
method Integrating PPO with feature importance techniques (SHAP, LIME) to enhance transparency.
result Ability to interpret DRL agent actions in prediction time.
End-to-end learning with deep neural networks, such as convolutional neural networks (CNNs), has been demonstrated to be very successful for different tasks of image classification. To make decisions of black-box approaches transparent, different solutions have been proposed. LIME is an approach to explainable AI relyi…
InterpretML is an open-source Python package which exposes machine learning interpretability algorithms to practitioners and researchers. InterpretML exposes two types of interpretability - glassbox models, which are machine learning models designed for interpretability (ex: linear models, rule lists, generalized addit…
GLIME improves LIME's stability and local fidelity.
problem LIME's instability and low local fidelity.
method Introducing GLIME, an enhanced framework that derives an equivalent formulation of LIME with faster convergence and improved stability.
result GLIME generates explanations with higher local fidelity and is independent of reference choice.
Explainable Artificial Intelligence (XAI)has received a great deal of attention recently. Explainability is being presented as a remedy for the distrust of complex and opaque models. Model agnostic methods such as LIME, SHAP, or Break Down promise instance-level interpretability for any complex machine learning model. …
SurvLIME explains survival models by approximating them with Cox models.
problem Explaining complex survival models in machine learning.
method Applies Cox proportional hazards model to approximate survival model locally.
result Demonstrates efficiency through numerical experiments.
A new method accounts for predictor dependencies in XAI feature rankings.
problem Assumption of predictor independence in XAI methods leads to unreliable feature rankings.
method Proposes a proxy method to modify XAI outcomes considering predictor dependencies.
result Allows more accurate feature ranking in models with correlated predictors.
Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two new approaches and corresponding packages for such attribution, namely live and …
Statistical stability indices for LIME: obtaining reliable explanations for Machine Learning modelscs.LG
Nowadays we are witnessing a transformation of the business processes towards a more computation driven approach. The ever increasing usage of Machine Learning techniques is the clearest example of such trend. This sort of revolution is often providing advantages, such as an increase in prediction accuracy and a reduce…
With the increasing number of deep learning applications, there is a growing demand for explanations. Visual explanations provide information about which parts of an image are relevant for a classifier's decision. However, highlighting of image parts (e.g., an eye) cannot capture the relevance of a specific feature val…
Unified framework for model explanation methods based on feature removal.
problem Unclear relationships and preferences among various model explanation methods.
method Characterizes removal-based explanations along three dimensions.
result Unified 26 existing methods, including widely used approaches.
The paper compares ML models for credit scoring and investment decisions using explainable AI.
problem The opacity of machine learning models in financial services.
method Comparison of various machine learning models (single classifiers, ensembles, neural networks) and explainability techniques (LIME, SHAP).
result Ensemble classifiers and neural networks outperform in credit scoring models.
A new method improves the interpretability of data-driven models in ironmaking processes.
problem Lack of transparency in machine learning models used in industrial processes.
method Combines Variational Autoencoder (VAE) with Local Interpretable Model-agnostic Explanations (LIME) for better model interpretability.
result Improved local fidelity of local interpretable linear models compared to LIME.
Proposes a new method to explain model predictions for consumer recourse.
problem Current explanation methods fail to provide meaningful recourse to decision subjects.
method Develops feature responsiveness scores to highlight actionable features.
result Standard practices can undermine decision subjects by highlighting unresponsive features.
Paper proposes a new method to evaluate AI model interpretability in bond default prediction.
problem Lack of standardized method to assess inherent interpretability of AI models.
method Uses LIME and SHAP to assess feature contributions in bond default prediction.
result Consistent results with intuitive understanding of model interpretability.
XAI-Bench releases synthetic datasets for evaluating feature attribution methods.
problem Evaluating and comparing feature attribution methods is challenging.
method Released synthetic datasets and benchmarking library.
result Efficiently evaluates feature attribution methods across various metrics.
Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a prediction, or when choosing whether to deploy a new model. Such understanding also pr…
Methods for interpreting machine learning black-box models increase the outcomes' transparency and in turn generates insight into the reliability and fairness of the algorithms. However, the interpretations themselves could contain significant uncertainty that undermines the trust in the outcomes and raises concern abo…
Study uses XAI and transformers for stock price prediction of top 100 BIST banks.
problem Enhancing interpretability and accuracy of stock price predictions.
method Combines transformer-based time series models with XAI techniques.
result Transformer models show strong predictive capabilities and provide feature transparency.
This paper improves NLP interpretability by using sentence segments instead of words.
problem Limitations of word-based sampling in explaining complex BERT models.
method Using sentence segments as elementary building blocks for NLP interpretability.
result Improved fidelity of the explainer on a benchmark classification task.
Despite the recent development in the topic of explainable AI/ML for image and text data, the majority of current solutions are not suitable to explain the prediction of neural network models when the datasets are tabular and their features are in high-dimensional vectorized formats. To mitigate this limitation, theref…
In this paper, we present a new explainability formalism designed to shed light on how each input variable of a test set impacts the predictions of machine learning models. Hence, we propose a group explainability formalism for trained machine learning decision rules, based on their response to the variability of the i…
We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e., changing the inputs in the set changes the decision) and is irreducible (i.e., …
LIMEtree offers faithful explanations for multiple classes in predictive models.
problem Generating explanations for several classes can be difficult due to conflicting evidence.
method LIMEtree uses multi-output regression trees for consistent and faithful explanations of multiple classes.
result LIMEtree provides diverse explanation types and outperforms LIME in evaluations.
A stability metric compares feature selection algorithms in machine learning.
problem Stability of feature selection algorithms in machine learning.
method Rank-based instability index to compare MDA, LIME, and SHAP algorithms.
result LIME and SHAP are more stable than MDA, with LIME being best for human interpretability.
Neural networks are among the most accurate supervised learning methods in use today, but their opacity makes them difficult to trust in critical applications, especially when conditions in training differ from those in test. Recent work on explanations for black-box models has produced tools (e.g. LIME) to show the im…