Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

61123184245 · Jun 202019922001200920172026
48 results for Interpretable Scientific Discovery

iKF method uncovers complex variable interactions for scientific discovery.

problem Limited interpretability of existing models in decision-making applications.
method Iterative Kings' Forests (iKF) method to uncover multi-order interactions.
result iKF provides strong interpretive power for explainable modeling.

New method extracts biological concepts from cell microscopy images.

problem Extracting meaningful concepts from vision foundation models trained on cell microscopy images.
method Sparse dictionary learning (DL) combined with PCA whitening pre-processing.
result Successfully retrieved biologically meaningful concepts like cell types and genetic perturbations.

Enhances KANs for accuracy and interpretability with multi-exit architecture.

problem Unclear optimal depth for KANs and difficulty in optimization and interpretation.
method Introduces multi-exit KANs with each layer having its own prediction branch.
result Multi-exit KANs outperform single-exit versions on various datasets.

Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine learning in the natural sciences, where the major goal is to obtain novel scientific insights and di…

2019-05-21abs ↗pdf ↗

SVGP KAN integrates sparse variational GP with KANs for scalable probabilistic inference.

problem Lack of probabilistic outputs in standard KANs and cubic scaling of Gaussian Process methods.
method Sparse Variational GP-KAN combines KAN topology with sparse variational inference and permutation-based importance analysis.
result Enables probabilistic KANs to handle larger datasets with linear computational complexity.

Automated detection of new, interesting, unusual, or anomalous images within large data sets has great value for applications from surveillance (e.g., airport security) to science (observations that don't fit a given theory can lead to new discoveries). Many image data analysis systems are turning to convolutional neur…

2018-06-21abs ↗pdf ↗

Diamond method controls FDR for trustworthy feature interaction discovery in ML models.

problem Limited interpretability of ML models due to black box nature.
method Diamond method integrates model-X knockoffs framework to control FDR for non-additive interactions.
result Diamond method ensures accurate discovery of feature interactions with FDR control.

iPrompt uses LLMs to generate natural-language explanations of data patterns.

problem Finding and explaining patterns in data using natural language.
method Interpretable autoprompting (iPrompt) that generates natural-language explanations based on LLMs.
result iPrompt can accurately find and explain data patterns, improving upon human-written prompts.

New insights into ML models' accuracy and generalization for scientific problems.

problem Quantifying accuracy and generalization of ML models in scientific applications.
method Rigorous numerical analysis and theoretical bounds for linear differential equations.
result Different ML models can have opposing generalization behaviors, contrary to intuition.

Paper presents a workflow for reliable unsupervised learning in science.

problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.

SGNNs use simulations to train neural networks, improving scientific forecasting and interpretability.

problem Combining precise theory and machine learning for robust scientific modeling.
method Pretraining neural networks on diverse mechanistic simulations as training data.
result SGNNs outperform data-driven and physics-constrained models in forecasting and interpretability.

New AI approach improves quantum device calibration by leveraging prior scientific discoveries.

problem Lack of abundant data in scientific disciplines hinders model generalizability.
method Introduces a new machine learning approach that combines prior scientific knowledge with data.
result Accuracy in predicting quantum device energy spectrum surpasses current state-of-the-art by over 20%.

Develops a Bayesian framework for symbolic regression of scientific expressions.

problem Lack of principled uncertainty quantification and interpretability in existing symbolic regression methods.
method Hierarchical Bayesian framework with tree-structured symbolic expressions and Markov chain Monte Carlo inference.
result Robust performance on various datasets, including single-atom catalysis.

NDM incorporates geometric structure into neural networks for better optimization and interpretability.

problem Efficient and interpretable deep learning architectures.
method NDM is a neural network architecture that explicitly incorporates geometric structure into its design, using a Coordinate Layer, Geometric Layer, and Evolution Layer.
result NDM provides intrinsic regularization, enhancing generalization and robustness.

AutoSciDACT detects scientific anomalies in noisy data.

problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.

The paper argues for prioritizing identifying structure over complex models for scientific discovery.

problem Underdetermination of mechanisms in high-dimensional data, leading to unreliable explanations.
method Proposes concrete standards for 'mechanistic ML' to avoid collapsing explanations.
result Large language models (LLMs) can collapse large equivalence classes of explanations, making it hard to distinguish between mechanisms.

DiffATD efficiently discovers targets in partially observable environments using diffusion dynamics.

problem Efficiently discovering targets in partially observable environments with limited sampling.
method DiffATD uses diffusion dynamics to maintain a belief distribution over unobserved states, balancing exploration and exploitation.
result DiffATD outperforms baselines and supervised methods in diverse domains.

TRIM improves interpretability of deep neural networks in cosmology.

problem Understanding which features a deep neural network uses in a transformed space.
method TRIM (Transformation IMportance) attributes importances to features in a transformed space.
result Combining TRIM with contextual decomposition helps identify physical features learned by DNNs.

Study explores DNNs' reliance on existing vs. new features in physiological signals.

problem Understanding how deep neural networks discover new features in physiological signals.
method Proposes a method to remove hand-engineered features and force DNNs to learn new representations.
result DNNs often rediscover known features, but can also learn new ones.

PIMA autoencoders discover shared features in multimodal scientific data.

problem Discovering shared information in high-throughput scientific datasets.
method Physics-informed multimodal autoencoders (PIMA) with Gaussian mixture prior and product of experts formulation.
result Accurate cross-modal inference between images and mechanical stress-strain response in lattice metamaterials.

New method uses DNN for genetic variant identification, controlling randomness and improving interpretability.

problem Challenges in interpreting deep neural networks for genetic variant identification.
method Interpretable neural network model with controlled variable selection using ensembling, knockoffs, and de-randomization.
result The proposed method leads to more discoveries compared to conventional methods.

Polynomial chaos surrogates quantify epistemic uncertainty in AI-driven scientific models.

problem Uncertainty in reward estimates hinders interpretability in sequential generative models.
method Fit polynomial chaos expansions to trained models to propagate epistemic uncertainty and quantify sensitivity.
result Interpretable decomposition of reward components driving generative decisions.

In many scientific tasks we are interested in discovering whether there exist any correlations in our data. This raises many questions, such as how to reliably and interpretably measure correlation between a multivariate set of attributes, how to do so without having to make assumptions on distribution of the data or t…

2019-08-30abs ↗pdf ↗

Machine learning improves planetary space physics by incorporating physical knowledge.

problem Improving performance and interpretability of machine learning models for planetary space physics.
method Building on a previous semi-supervised physics-based classification, the team used varying data and physical information to improve machine learning performance and interpretability.
result Incorporating physical knowledge improves machine learning performance and interpretability, essential for deriving scientific meaning.

Proposes DCNAR for dynamic causal inference from neural time series.

problem Uncertainty and evolution of causal structure in real-world domains.
method Two-stage neural causal modeling integrating discovery and inference.
result Dynamic causal inferences are more stable and meaningful than alternatives.

SigTime learns interpretable signatures from time series data.

problem Discovering meaningful patterns in time series data with high complexity and limited interpretability.
method Jointly trains two Transformer models using shapelet-based and feature engineering representations.
result Learned shapelets serve as interpretable signatures for time series classification.

Framework evaluates AI proposals for drug discovery, finds no LLM advantage.

problem No principled framework exists for evaluating AI-guided scientific selection under budget constraints.
method Formally verified metric (BSDS/DQS) penalizes false discoveries and excessive abstention.
result LLMs provide no marginal value over existing classifiers in drug discovery.

CausalEvolve improves efficiency and discovery in open-ended scientific tasks.

problem Lack of targeted guidance and knowledge organization in evolve-based agents.
method Causal scratchpad that identifies and reasons about guiding factors for evolution.
result Effective improvement in evolutionary efficiency and better solutions.

In this paper we analyze both the scientific activities of Cahit Arf, a Turkish mathematician, and the social context in which he worked. We also discuss his work and social environment leading to the discovery of Arf invariant, Arf rings, Arf closure and Hasse-Arf theorem.

2013-01-16abs ↗pdf ↗

Scientific discovery is limited by hypothesis redundancy, and hybrid methods can exploit non-local exploration.

problem Limitation of scientific discovery due to hypothesis redundancy.
method Hybrid discovery systems combining structured local search with LLM-generated non-local proposals.
result Hybrid methods can exploit non-local exploration when three geometric conditions co-occur.

Since time immemorial, people have been looking for ways to organize scientific knowledge into some systems to facilitate search and discovery of new ideas. The problem was partially solved in the pre-Internet era using library classifications, but nowadays it is nearly impossible to classify all scientific and popular…

2018-11-15abs ↗pdf ↗

New benchmarks show LLMs struggle with causal discovery.

problem Leveraging LLMs for causal discovery is unreliable due to dataset leakage.
method Developing science-grounded benchmarks and hybrid methods combining LLM predictions with statistical analysis.
result LLMs perform poorly on novel, real-world scientific studies compared to classical methods.