Develops a Bayesian framework for symbolic regression of scientific expressions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Figures are an important channel for scientific communication, used to express complex ideas, models and data in ways that words cannot. However, this visual information is mostly ignored in analyses of the scientific literature. In this paper, we demonstrate the utility of using scientific figures as markers of knowle…
MDNs offer a data-efficient alternative to diffusion and flow models for multimodal scientific learning.
AutoSciDACT detects scientific anomalies in noisy data.
Keyphrase boundary classification (KBC) is the task of detecting keyphrases in scientific articles and labelling them with respect to predefined types. Although important in practice, this task is so far underexplored, partly due to the lack of labelled data. To overcome this, we explore several auxiliary tasks, includ…
The thermal subsystem of the Mars Express (MEX) spacecraft keeps the on-board equipment within its pre-defined operating temperatures range. To plan and optimize the scientific operations of MEX, its operators need to estimate in advance, as accurately as possible, the power consumption of the thermal subsystem. The re…
New framework explains normalizing flows' power and limitations.
We describe a new method for visualizing topics, the distributions over terms that are automatically extracted from large text corpora using latent variable models. Our method finds significant -grams related to a topic, which are then used to help understand and interpret the underlying distribution. Compared with …
New model captures complex relationships from experimental data.
ξ-torch simplifies physics-informed learning by providing differentiable functionals.
Form a pure mathematical point of view, common functional forms representing different physical phenomena can be defined. For example, rates of chemical reactions, diffusion and heat transfer are all governed by exponential-type expressions. If machine learning is used for physical problems, inferred from domain knowle…
Implicit models can match or exceed explicit models with more test-time compute.
This paper shows that scientific discovery can be efficiently learned via compositional function trees, reducing the sample complexity.
Many questions in Data Science are fundamentally causal in that our objective is to learn the effect of some exposure, randomized or not, on an outcome interest. Even studies that are seemingly non-causal, such as those with the goal of prediction or prevalence estimation, have causal elements, including differential c…
The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn effective implicit representations from simple input representations. However, fo…
Tree-based regularization improves latent variable inference from related datasets.
DET unifies geometric and functional alignment for high-dimensional scientific data.
Identifying changes in model parameters is fundamental in machine learning and statistics. However, standard changepoint models are limited in expressiveness, often addressing unidimensional problems and assuming instantaneous changes. We introduce change surfaces as a multidimensional and highly expressive generalizat…
Scientific fields such as insider-threat detection and highway-safety planning often lack sufficient amounts of time-series data to estimate statistical models for the purpose of scientific discovery. Moreover, the available limited data are quite noisy. This presents a major challenge when estimating time-series model…
xVal tokenizes numbers continuously for better scientific model training.
Galactica learns from scientific literature to help researchers.
Ensemble models provide more accurate feature importance estimates than single models.
Data science models, although successful in a number of commercial domains, have had limited applicability in scientific problems involving complex physical phenomena. Theory-guided data science (TGDS) is an emerging paradigm that aims to leverage the wealth of scientific knowledge for improving the effectiveness of da…
Confirmation bias leads to biased estimates in noisy data analysis.
Social media enhances or diminishes scientific status, depending on usage.
VaSST uses soft symbolic trees for probabilistic symbolic regression.
OccamNet finds interpretable symbolic fits to data efficiently.
Evidence shows that in a significant number of cases the current methods of research do not allow for reproducible and falsifiable procedures of scientific investigation. As a consequence, the majority of critical decisions at all levels, from personal investment choices to overreaching global policies, rely on some va…
There is significant interest in using modern neural networks for scientific applications due to their effectiveness in modeling highly complex, non-linear problems in a data-driven fashion. However, a common challenge is to verify the scientific plausibility or validity of outputs predicted by a neural network. This w…
Paper proposes a method to estimate scientific parameters in hybrid models without relying on model architecture.
Functionals involving surface curvature are important across a range of scientific disciplines, and their extrema are representative of physically meaningful objects such as atomic lattices and biomembranes. Inspired in particular by the relationship of the Willmore energy to lipid bilayers, we consider a general funct…
Survey of deep learning models for scientific discovery.
New framework compresses and recovers scientific data efficiently.
Hurd's career overview and publications listed.
Natural language processing often involves computations with semantic or syntactic graphs to facilitate sophisticated reasoning based on structural relationships. While convolution kernels provide a powerful tool for comparing graph structure based on node (word) level relationships, they are difficult to customize and…
This thesis advances algorithms and software for QMC, GP, and sciML.
New AI approach improves quantum device calibration by leveraging prior scientific discoveries.
Before retiring, looking back to forty years of writing and publishing scientific papers, I decided to present to the scientific community a selection of my scientific works. I chose mostly articles published in prestigious journals or Proceedings that made a certain impact in the scientific world. I have selected thir…
Why do nations produce scientific research? This is a fundamental problem in the field of social studies of science. The paper confronts this question here by showing vital determinants of science to explain the sources of social power and wealth creation by nations. Firstly, this study suggests a new general definitio…
Paper presents a workflow for reliable unsupervised learning in science.
Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine learning in the natural sciences, where the major goal is to obtain novel scientific insights and di…
EduQG generates better educational questions by pre-training on scientific text.
SOS-VAE improves generative models for scientific applications by correcting decoder bias.
Paper proposes BSP to find stable bimodules of cross-correlated features.
Economics does not need a scientific revolution. Economics needs accurate measurements according to high standards of natural sciences and meticulous work on revealing empirical relationships between measured variables.
Differentiable programming aids in solving differential equations and their sensitivities.
Researchers often summarize their work in the form of posters. Posters provide a coherent and efficient way to convey core ideas from scientific papers. Generating a good scientific poster, however, is a complex and time consuming cognitive task, since such posters need to be readable, informative, and visually aesthet…
Scientific documents rely on both mathematics and text to communicate ideas. Inspired by the topical correspondence between mathematical equations and word contexts observed in scientific texts, we propose a novel topic model that jointly generates mathematical equations and their surrounding text (TopicEq). Using an e…