Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

8162432 · Feb 202619922001200920172026
48 results for scientific

xVal tokenizes numbers continuously for better scientific model training.

problem Lack of continuous numerical tokenization for scientific datasets in LLMs.
method xVal: Continuous numerical tokenization strategy.
result xVal outperforms other numerical tokenization methods on scientific datasets.

Galactica learns from scientific literature to help researchers.

problem Information overload in scientific literature makes it hard to find useful insights.
method Trained on a large corpus of scientific papers, reference material, and knowledge bases.
result Outperforms existing models on various scientific tasks, including LaTeX equations and mathematical reasoning.

Social media enhances or diminishes scientific status, depending on usage.

problem Impact of social media on scientific stratification and mobility.
method Logistic Attribution Analysis combining statistical and machine learning methods.
result Social media promotes stratification and mobility, but beyond a threshold, it negatively impacts status.

Paper proposes a method to estimate scientific parameters in hybrid models without relying on model architecture.

problem Estimating unknown parameters in hybrid models combining machine learning and scientific models.
method Sharpness-aware minimization adapted for hybrid modeling, focusing on model simplicity.
result Demonstrates effectiveness of SAM-based hybrid model learning for scientific parameter estimation.

AutoSciDACT detects scientific anomalies in noisy data.

problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.

MDNs offer a data-efficient alternative to diffusion and flow models for multimodal scientific learning.

problem Capturing multimodal conditional uncertainty in scientific inverse problems.
method Mixture Density Networks (MDNs) as explicit parametric density estimators.
result MDNs achieve superior generalization, interpretability, and sample efficiency in scientific tasks.

New framework compresses and recovers scientific data efficiently.

problem Efficiently managing and recovering from large scientific datasets.
method Grounded in learning exponential families, preserves uncertainty and supports trade-offs.
result Preserves physical features and quantities of interest in compressed representations.

This thesis advances algorithms and software for QMC, GP, and sciML.

problem Efficient high-dimensional integration, interpolation, and PDE modeling.
method Developed new algorithms and software for QMC, GP, and sciML.
result Efficient and accurate methods for high-dimensional problems.

New AI approach improves quantum device calibration by leveraging prior scientific discoveries.

problem Lack of abundant data in scientific disciplines hinders model generalizability.
method Introduces a new machine learning approach that combines prior scientific knowledge with data.
result Accuracy in predicting quantum device energy spectrum surpasses current state-of-the-art by over 20%.

Before retiring, looking back to forty years of writing and publishing scientific papers, I decided to present to the scientific community a selection of my scientific works. I chose mostly articles published in prestigious journals or Proceedings that made a certain impact in the scientific world. I have selected thir…

2012-02-28abs ↗pdf ↗

Why do nations produce scientific research? This is a fundamental problem in the field of social studies of science. The paper confronts this question here by showing vital determinants of science to explain the sources of social power and wealth creation by nations. Firstly, this study suggests a new general definitio…

2018-06-13abs ↗pdf ↗

Paper presents a workflow for reliable unsupervised learning in science.

problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.

Develops a Bayesian framework for symbolic regression of scientific expressions.

problem Lack of principled uncertainty quantification and interpretability in existing symbolic regression methods.
method Hierarchical Bayesian framework with tree-structured symbolic expressions and Markov chain Monte Carlo inference.
result Robust performance on various datasets, including single-atom catalysis.

Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine learning in the natural sciences, where the major goal is to obtain novel scientific insights and di…

2019-05-21abs ↗pdf ↗

EduQG generates better educational questions by pre-training on scientific text.

problem Improving the quality of educational questions for scalable self-assessment.
method Adapting a large language model for educational question generation, pre-trained on scientific text.
result EduQG produces superior educational questions compared to baseline models.

SOS-VAE improves generative models for scientific applications by correcting decoder bias.

problem Bias in generative parameters due to supervised learning in VAEs.
method Develops SOS-VAE framework to influence decoder for predictive latent representation.
result Ensures reliable generative parameters for scientific applications.

Economics does not need a scientific revolution. Economics needs accurate measurements according to high standards of natural sciences and meticulous work on revealing empirical relationships between measured variables.

2009-04-04abs ↗pdf ↗

Differentiable programming aids in solving differential equations and their sensitivities.

problem Computing gradients of numerical solutions of differential equations.
method Review of existing techniques and mathematical foundations.
result Established a coherent framework for combining differential equations with data-driven approaches.

Researchers often summarize their work in the form of posters. Posters provide a coherent and efficient way to convey core ideas from scientific papers. Generating a good scientific poster, however, is a complex and time consuming cognitive task, since such posters need to be readable, informative, and visually aesthet…

2016-04-05abs ↗pdf ↗

PIMA autoencoders discover shared features in multimodal scientific data.

problem Discovering shared information in high-throughput scientific datasets.
method Physics-informed multimodal autoencoders (PIMA) with Gaussian mixture prior and product of experts formulation.
result Accurate cross-modal inference between images and mechanical stress-strain response in lattice metamaterials.

A new method calibrates scientific models by adding randomness to their predictions.

problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.

Fast emulators built with neural search accelerate expensive scientific simulations.

problem Slow execution of accurate simulations limits scientific discovery.
method Neural architecture search to build accurate emulators with limited data.
result Simulations accelerated by up to 2 billion times in various scientific fields.

New sampling strategy preserves relationships in multivariate scientific data.

problem Reducing storage and enabling efficient multivariate analyses on large scientific data.
method Uses principal component analysis for multivariate data and combines with existing univariate sampling algorithms.
result Efficacy demonstrated on real-world data sets, showing data reduction and multivariate analysis ease.

iKF method uncovers complex variable interactions for scientific discovery.

problem Limited interpretability of existing models in decision-making applications.
method Iterative Kings' Forests (iKF) method to uncover multi-order interactions.
result iKF provides strong interpretive power for explainable modeling.

New approach uses interpolation models and error bounds for verifiable scientific machine learning.

problem Challenges in verifying and validating modern scientific machine learning workflows.
method Combines multiple standard interpolation techniques with error bounds for efficient computation and comparative performance analysis.
result Error bounds for interpolation techniques can be computed or estimated efficiently, aiding in validation goals.

Blockchain technology, and more specifically Bitcoin (one of its foremost applications), have been receiving increasing attention in the scientific community. The first publications with Bitcoin as a topic, can be traced back to 2012. In spite of this short time span, the production magnitude (1162 papers) makes it nec…

2019-06-21abs ↗pdf ↗

In order to evaluate the quality of the scientific research, we introduce a new family of scientific performance measures, called Scientific Research Measures (SRM). Our proposal originates from the more recent developments in the theory of risk measures and is an attempt to resolve the many problems of the existing bi…

2012-05-04abs ↗pdf ↗

Framework for interpreting ML models to reveal properties of real-world phenomena.

problem Lack of direct interpretability in modern ML models hinders scientific understanding.
method Developed 'property descriptors' grounded in statistical learning theory.
result Property descriptors can reveal relevant properties of joint probability distributions.

The paper argues for prioritizing identifying structure over complex models for scientific discovery.

problem Underdetermination of mechanisms in high-dimensional data, leading to unreliable explanations.
method Proposes concrete standards for 'mechanistic ML' to avoid collapsing explanations.
result Large language models (LLMs) can collapse large equivalence classes of explanations, making it hard to distinguish between mechanisms.

In this paper we analyze both the scientific activities of Cahit Arf, a Turkish mathematician, and the social context in which he worked. We also discuss his work and social environment leading to the discovery of Arf invariant, Arf rings, Arf closure and Hasse-Arf theorem.

2013-01-16abs ↗pdf ↗

SGNNs use simulations to train neural networks, improving scientific forecasting and interpretability.

problem Combining precise theory and machine learning for robust scientific modeling.
method Pretraining neural networks on diverse mechanistic simulations as training data.
result SGNNs outperform data-driven and physics-constrained models in forecasting and interpretability.

PNNs model aleatoric uncertainty in scientific machine learning with high accuracy.

problem Aleatoric uncertainty in scientific systems with unequal variance.
method Developed a probabilistic distance metric to optimize PNN architecture and used it in material science applications.
result PNNs yield remarkably accurate output mean estimates and high correlation in predicted intervals.

New method extracts biological concepts from cell microscopy images.

problem Extracting meaningful concepts from vision foundation models trained on cell microscopy images.
method Sparse dictionary learning (DL) combined with PCA whitening pre-processing.
result Successfully retrieved biologically meaningful concepts like cell types and genetic perturbations.

New method for PINNs uncertainty quantification without prior distribution.

problem Lack of reliable uncertainty quantification for PINNs.
method Extended fiducial inference with narrow-neck hyper-network.
result Construction of honest confidence sets based on observed data.

SVGP KAN integrates uncertainty quantification into Kolmogorov-Arnold networks.

problem Uncertainty quantification in scientific machine learning models.
method Sparse variational Gaussian process inference with Kolmogorov-Arnold topology.
result Demonstrated ability to distinguish aleatoric and epistemic uncertainty in various scientific applications.