Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

62123185246 · Jun 202019922001200920172026
48 results for Text Interpretability

New method compares feature importance and rule extraction for text data interpretability.

problem Unexpected differences in explanations from feature importance and rule extraction methods.
method Proposes a new approach to compare explanations from different methods.
result Different methods can lead to unexpected explanations, even for simple models.

ProtoryNet interprets text sequences using prototype trajectories for better understanding.

problem Improving text classification interpretability and accuracy.
method ProtoryNet uses prototype trajectories to interpret text sequences, with prototype pruning for better interpretability.
result ProtoryNet outperforms baseline models and reduces performance gap compared to black-box models.

FRED explains text model predictions by identifying key words and providing counterfactual examples.

problem Lack of interpretable methods for text models that are complex, lack foundations, and have unguaranteed performance.
method FRED identifies minimal influential word sets, assigns token importance, and generates counterfactual examples.
result FRED provides reliable and effective explanations for text model predictions.

LFD method improves text classification by making features clearer and less label-leaking.

problem Creating interpretable text representations that are both predictive and understandable.
method LFD method: proposes lexical and semantic features from contrastive text pairs, screens candidates using κκ, and selects features by residual gain.
result LFD features achieve higher human-human and human-LLM agreement than baseline concepts and are less label-leaking.

Text clustering method replaces centroids with summaries for interpretability and scalability.

problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.

Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the adversarial examples are still probable and interpretable, and partly to the proble…

2019-05-30abs ↗pdf ↗

Proposes a VAE with a discrete bottleneck for better text generation.

problem VAEs struggle with latent variable auto-regressive decoding in text generation.
method Introduces a discretized bottleneck to enforce latent feature matching in a compact space.
result Demonstrates improved text generation capabilities across various tasks.

This paper improves NLP interpretability by using sentence segments instead of words.

problem Limitations of word-based sampling in explaining complex BERT models.
method Using sentence segments as elementary building blocks for NLP interpretability.
result Improved fidelity of the explainer on a benchmark classification task.

XGBoost learns a broad class of functions bridging empirical success and theory.

problem Understanding the function class implicitly learned by XGBoost.
method Introduced an infinite-dimensional function class and a complexity measure, showing optimizers of XGBoost are also optimizers of a penalized regression problem.
result Proved the least squares estimator achieves nearly minimax-optimal convergence rate over the function class.

A novel method extracts topological features from word embeddings for text classification.

problem High dimensional and noisy text representations in natural language processing.
method Persistent homology for topological data analysis on word embeddings.
result Topological features outperform conventional text mining features on long textual documents.

Interpretable representations improve explainable AI by translating complex data into understandable concepts.

problem Many explainers use interpretable representations but overlook their full potential and assumptions.
method An in-depth analysis of interpretable representations for tabular, image, and text data, identifying strengths, weaknesses, and desiderata.
result Linear model quantifies interpretable concepts' influence on black-box predictions, revealing their explanatory properties and manipulability.

ExpBERT uses natural language explanations to improve text interpretation.

problem Improving text interpretation for relation extraction tasks.
method Fine-tuning BERT on MultiNLI to interpret natural language explanations.
result ExpBERT matches a BERT baseline but requires less labeled data and improves performance.

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an interpretable model. We demonstrate the flexibility of CLE by explaining different models…

2019-10-02abs ↗pdf ↗

Study uses AI to refine loan assessments, improving credit default predictions.

problem Improving credit default prediction accuracy using AI-refined text.
method Comparative analysis of human-written and AI-refined loan assessments using deep learning techniques.
result AI-refined texts significantly enhance credit default predictions, especially when combined with structured data.

Document network embedding aims at learning representations for a structured text corpus i.e. when documents are linked to each other. Recent algorithms extend network embedding approaches by incorporating the text content associated with the nodes in their formulations. In most cases, it is hard to interpret the learn…

2020-01-10abs ↗pdf ↗

PAC-Bayesian theory improves text-to-image models by enforcing alignment and generalization.

problem Text-to-image models struggle with complex prompts, misaligning modifiers and neglecting certain elements.
method Proposes a Bayesian approach with custom priors over attention distributions to enforce desirable properties.
result Achieves state-of-the-art results across multiple metrics on standard benchmarks.

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are dynamically controlled by learning disentangled latent representations with designated…

2017-03-02abs ↗pdf ↗

Improved algorithm for misspecified MLMDPs with bounded regret and space/time complexities.

problem Misspecified linear Markov decision processes.
method Proposes an algorithm with three desirable properties: bounded regret, bounded space/time complexities, and no need for misspecification input.
result Regret scales as Kmax{εextmis,εexttol}K \max \{ \varepsilon_{ ext{mis}}, \varepsilon_{ ext{tol}} \}, improving existing bounds.

The paper distinguishes between conditional and marginal processes in language models and discusses conditions for usefulness.

problem The conditional nature of language models trained on observed sequences and the need for marginal text-only processes.
method Distinguishing between full conditional language process, marginal text-only process, and model-induced distribution; analyzing assumptions of stationarity and ergodicity.
result The marginal text-only law is useful only when the observed prefix is an approximately sufficient statistic for the latent circumstances relevant to continuation.

Early detection of preventable diseases is important for better disease management, improved inter-ventions, and more efficient health-care resource allocation. Various machine learning approacheshave been developed to utilize information in Electronic Health Record (EHR) for this task. Majorityof previous attempts, ho…

2018-08-15abs ↗pdf ↗

Clinical notes are text documents that are created by clinicians for each patient encounter. They are typically accompanied by medical codes, which describe the diagnosis and treatment. Annotating these codes is labor intensive and error prone; furthermore, the connection between the codes and the text is not annotated…

2018-02-15abs ↗pdf ↗

We propose a generic and interpretable learning framework for building robust text classification model that achieves accuracy comparable to full models under test-time budget constraints. Our approach learns a selector to identify words that are relevant to the prediction tasks and passes them to the classifier for pr…

2018-08-24abs ↗pdf ↗

We develop a model using deep learning techniques and natural language processing on unstructured text from medical records to predict hospital-wide 3030-day unplanned readmission, with c-statistic .70.70. Our model is constructed to allow physicians to interpret the significant features for prediction.

2017-11-29abs ↗pdf ↗

The study explores Legendrian invariants and half Giroux torsion in contact structures.

problem Understanding Legendrian invariants and their behavior with half Giroux torsion.
method Analysis of Legendrian links with non-vanishing contact invariants and the study of half Giroux torsion.
result Null-homologous links with irreducible complements have non-loose Legendrian realizations with non-zero invariants.

This study presents a multimodal machine learning model to predict ICD-10 diagnostic codes. We developed separate machine learning models that can handle data from different modalities, including unstructured text, semi-structured text and structured tabular data. We further employed an ensemble method to integrate all…

2018-10-31abs ↗pdf ↗