Galactica learns from scientific literature to help researchers.
problem Information overload in scientific literature makes it hard to find useful insights.
method Trained on a large corpus of scientific papers, reference material, and knowledge bases.
result Outperforms existing models on various scientific tasks, including LaTeX equations and mathematical reasoning.
Figures are an important channel for scientific communication, used to express complex ideas, models and data in ways that words cannot. However, this visual information is mostly ignored in analyses of the scientific literature. In this paper, we demonstrate the utility of using scientific figures as markers of knowle…
The scientific literature is a rich source of information for data mining with conceptual knowledge graphs; the open science movement has enriched this literature with complementary source code that implements scientific models. To exploit this new resource, we construct a knowledge graph using unsupervised learning me…
The process of collecting and organizing sets of observations represents a common theme throughout the history of science. However, despite the ubiquity of scientists measuring, recording, and analyzing the dynamics of different processes, an extensive organization of scientific time-series data and analysis methods ha…
AutoSciDACT detects scientific anomalies in noisy data.
problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.
Hierarchical NMF organizes COVID-19 literature into a searchable tree.
problem Organizing and searching for relevant COVID-19 research.
method Hierarchical nonnegative matrix factorization.
result Identified 8 major and 52 subtopics related to COVID-19.
Differentiable programming aids in solving differential equations and their sensitivities.
problem Computing gradients of numerical solutions of differential equations.
method Review of existing techniques and mathematical foundations.
result Established a coherent framework for combining differential equations with data-driven approaches.
There has been a lot of recent interest in adopting machine learning methods for scientific and engineering applications. This has in large part been inspired by recent successes and advances in the domains of Natural Language Processing (NLP) and Image Classification (IC). However, scientific and engineering problems …
ANNs overcome curse of dimensionality for heat equation uniform errors.
problem Approximating high-dimensional heat equations with neural networks.
method Developed techniques to estimate uniform L∞-error. result ANNs' parameters grow polynomially with dimension and precision.
Paper proposes MDER model to extract ML methods and datasets from papers.
problem Lack of focus on methods and datasets in literature analysis.
method Proposes MDER model for entity recognition of methods and datasets.
result Demonstrates preliminary performance of MDER model.
New method uses LLMs to generate detailed scientific hypotheses.
problem Generating detailed, actionable scientific hypotheses from coarse initial directions.
method Hierarchical search method that incrementally adds details to hypotheses.
result Hierarchical search method consistently outperforms strong baselines on expert-annotated hypotheses.
Analyzes deep neural networks training errors with SGD and random init.
problem Lack of rigorous understanding of deep learning algorithms.
method Mathematical analysis of deep learning with SGD and random init.
result First full error analysis for deep learning with SGD and random init.
This study analyzes data science vocabulary changes over 13 years.
problem Understanding evolution of data science terms over time.
method Exploratory Data Analysis, Latent Semantic Analysis, Latent Dirichlet Analysis, N-grams Analysis.
result Identified new vocabulary and its incorporation into scientific literature.
Survey analyzes economic research on cryptocurrencies using hybrid methods.
problem Lack of comprehensive literature review in cryptocurrencies economic research.
method Dual analysis combining bibliometric and close literature review.
result Updated state of cryptocurrency economic research literature.
In the scientific literature there are basically two schools of formulating Lagrangian (or Hamiltonian) mechanics in the (Lie) algebroid setting: in terms of prolongations and in terms of Tulczyjew triples. Despite the fact that in both approaches we describe the same phenomena, so far no comparison between prolongatio…
Survey of trainable activation functions in neural networks.
problem Improving neural network performance through trainable activation functions.
method Taxonomy and comparison of recent and past models of trainable activation functions.
result Many trainable activation functions are equivalent to adding neuron layers with fixed activation functions and simple constraints.
New Physics Learning Machine compares generative models for scientific research.
problem Evaluating the fidelity of generative models in high-energy physics.
method Two-sample hypothesis testing using machine learning.
result The New Physics Learning Machine outperforms alternative approaches in classification-based tests.
Leveraging new data sources is a key step in accelerating the pace of materials design and discovery. To complement the strides in synthesis planning driven by historical, experimental, and computed data, we present an automated method for connecting scientific literature to synthesis insights. Starting from natural la…
New method improves spatial prediction validation accuracy.
problem Validation methods fail for spatial prediction tasks due to mismatch between validation and test locations.
method Proposes a new validation method that adapts existing covariate-shift ideas to spatial settings.
result Proves and demonstrates the new method's superiority in spatial prediction validation.
Scientific fields such as insider-threat detection and highway-safety planning often lack sufficient amounts of time-series data to estimate statistical models for the purpose of scientific discovery. Moreover, the available limited data are quite noisy. This presents a major challenge when estimating time-series model…
Drug-drug interaction (DDI) is a major cause of morbidity and mortality and a subject of intense scientific interest. Biomedical literature mining can aid DDI research by extracting evidence for large numbers of potential interactions from published literature and clinical databases. Though DDI is investigated in domai…
This work uses scientific constraints to validate neural network predictions in fusion physics.
problem Verifying the scientific plausibility of neural network predictions in fusion physics.
method Using known scientific constraints as a validation tool.
result Validated neural network predictions in fusion physics using scientific constraints.
Clarifies the various fairness definitions in ML.
problem Addressing fairness in ML with different definitions.
method Analyzes and clarifies the differences between fairness definitions.
result Provides a clearer understanding of fairness definitions in ML.
This paper reviews statistical and machine learning methods for anti-money laundering.
problem Lack of scientific literature on statistical and machine learning methods for anti-money laundering.
method Client risk profiling and suspicious behavior flagging.
result Client risk profiling involves diagnostics, while suspicious behavior flagging involves non-disclosed features and hand-crafted risk indices.
This study analyzes EU ETS literature trends using bibliometric methods.
problem Understanding the evolving research landscape of EU ETS.
method Bibliometric analysis of Scopus database, focusing on publication trends, themes, influential authors, and journals.
result Notable increase in research activity over two decades, particularly during policy changes and economic events.
xVal tokenizes numbers continuously for better scientific model training.
problem Lack of continuous numerical tokenization for scientific datasets in LLMs.
method xVal: Continuous numerical tokenization strategy.
result xVal outperforms other numerical tokenization methods on scientific datasets.
Data science models, although successful in a number of commercial domains, have had limited applicability in scientific problems involving complex physical phenomena. Theory-guided data science (TGDS) is an emerging paradigm that aims to leverage the wealth of scientific knowledge for improving the effectiveness of da…
Revisits orbital minimization for neural operator decomposition.
problem Training neural networks to approximate eigenfunctions of operators.
method Adapts orbital minimization method (OMM) for neural networks.
result Justifies broader applicability of OMM in modern learning pipelines.
Digital Financial Services continue to expand and replace the delivery of traditional banking services to the customers through innovative technologies to meet the growing complex needs and globalization challenges. These diversified digital products help the organizations (service providers) to improve their firm perf…
Social media enhances or diminishes scientific status, depending on usage.
problem Impact of social media on scientific stratification and mobility.
method Logistic Attribution Analysis combining statistical and machine learning methods.
result Social media promotes stratification and mobility, but beyond a threshold, it negatively impacts status.
Evidence shows that in a significant number of cases the current methods of research do not allow for reproducible and falsifiable procedures of scientific investigation. As a consequence, the majority of critical decisions at all levels, from personal investment choices to overreaching global policies, rely on some va…
Paper proposes a method to estimate scientific parameters in hybrid models without relying on model architecture.
problem Estimating unknown parameters in hybrid models combining machine learning and scientific models.
method Sharpness-aware minimization adapted for hybrid modeling, focusing on model simplicity.
result Demonstrates effectiveness of SAM-based hybrid model learning for scientific parameter estimation.
Parametric statistical models that are implicitly defined in terms of a stochastic data generating process are used in a wide range of scientific disciplines because they enable accurate modeling. However, learning the parameters from observed data is generally very difficult because their likelihood function is typica…
MDNs offer a data-efficient alternative to diffusion and flow models for multimodal scientific learning.
problem Capturing multimodal conditional uncertainty in scientific inverse problems.
method Mixture Density Networks (MDNs) as explicit parametric density estimators.
result MDNs achieve superior generalization, interpretability, and sample efficiency in scientific tasks.
Survey of deep learning models for scientific discovery.
problem Identifying which scientific problems are most suitable for deep learning.
method Overview of deep learning models, tasks, training methods, and techniques.
result Helps accelerate deep learning use in scientific domains.
New framework compresses and recovers scientific data efficiently.
problem Efficiently managing and recovering from large scientific datasets.
method Grounded in learning exponential families, preserves uncertainty and supports trade-offs.
result Preserves physical features and quantities of interest in compressed representations.
Hurd's career overview and publications listed.
problem None explicitly stated in the abstract.
method Not applicable as it's an introduction.
result No specific key result mentioned.
This thesis advances algorithms and software for QMC, GP, and sciML.
problem Efficient high-dimensional integration, interpolation, and PDE modeling.
method Developed new algorithms and software for QMC, GP, and sciML.
result Efficient and accurate methods for high-dimensional problems.
New AI approach improves quantum device calibration by leveraging prior scientific discoveries.
problem Lack of abundant data in scientific disciplines hinders model generalizability.
method Introduces a new machine learning approach that combines prior scientific knowledge with data.
result Accuracy in predicting quantum device energy spectrum surpasses current state-of-the-art by over 20%.
Why do nations produce scientific research? This is a fundamental problem in the field of social studies of science. The paper confronts this question here by showing vital determinants of science to explain the sources of social power and wealth creation by nations. Firstly, this study suggests a new general definitio…
Before retiring, looking back to forty years of writing and publishing scientific papers, I decided to present to the scientific community a selection of my scientific works. I chose mostly articles published in prestigious journals or Proceedings that made a certain impact in the scientific world. I have selected thir…
arfpy simplifies data generation with adversarial random forests.
problem Synthesizing new data that matches given data.
method Adversarial Random Forests (ARF) integrated into a Python package.
result Effective and user-friendly data generation for various fields.
Paper presents a workflow for reliable unsupervised learning in science.
problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.
Develops a Bayesian framework for symbolic regression of scientific expressions.
problem Lack of principled uncertainty quantification and interpretability in existing symbolic regression methods.
method Hierarchical Bayesian framework with tree-structured symbolic expressions and Markov chain Monte Carlo inference.
result Robust performance on various datasets, including single-atom catalysis.
Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine learning in the natural sciences, where the major goal is to obtain novel scientific insights and di…
EduQG generates better educational questions by pre-training on scientific text.
problem Improving the quality of educational questions for scalable self-assessment.
method Adapting a large language model for educational question generation, pre-trained on scientific text.
result EduQG produces superior educational questions compared to baseline models.
ARHNN method improves electricity price forecasting accuracy.
problem Improving accuracy in electricity price forecasting.
method Combines Autoregressive Hybrid Nearest Neighbors (ARHNN) method with calibration sample selection and forecast combination.
result ARHNN method outperforms benchmarks by up to 10% in German, Spanish, and New England markets.
SOS-VAE improves generative models for scientific applications by correcting decoder bias.
problem Bias in generative parameters due to supervised learning in VAEs.
method Develops SOS-VAE framework to influence decoder for predictive latent representation.
result Ensures reliable generative parameters for scientific applications.