FRACTI framework supports large-scale collaboration and transparent investigation in finance.
problem Complex, multidisciplinary research in finance requires robust support systems.
method Defines scientific support systems, shares contributions, classifies facets, and outlines a meta-model.
result FRACTI enables provenance tracking and large-scale investigation in computational finance.
DLHub enables sharing and serving of scientific ML models.
problem Lack of specialized ML systems for scientific applications.
method Self-service model repository and scalable serving capabilities.
result DLHub offers better performance and more capabilities than existing systems.
The paper argues for prioritizing identifying structure over complex models for scientific discovery.
problem Underdetermination of mechanisms in high-dimensional data, leading to unreliable explanations.
method Proposes concrete standards for 'mechanistic ML' to avoid collapsing explanations.
result Large language models (LLMs) can collapse large equivalence classes of explanations, making it hard to distinguish between mechanisms.
Physics-guided models improve lake temperature and quality predictions.
problem Predicting and monitoring water temperature and quality in lakes.
method Combining physics-based models and recurrent neural networks with physical constraints.
result Improved prediction accuracy and scientific consistency.
Method predicts rarity of image features to support research integrity investigations.
problem Difficulty in determining if image reuse is by chance or intentional.
method Statistical estimation of ORB features' chance occurrence across PubMed Open Access Subset dataset.
result The method produces decreasingly smaller p-values for more complex imagery, supporting null hypothesis.
New framework compresses and recovers scientific data efficiently.
problem Efficiently managing and recovering from large scientific datasets.
method Grounded in learning exponential families, preserves uncertainty and supports trade-offs.
result Preserves physical features and quantities of interest in compressed representations.
New method learns particle system potentials from unlabeled data.
problem Learning potentials of interacting particle systems from unlabeled data with trajectory information missing.
method Introduces a self-test loss function based on stochastic evolution equation.
result Method outperforms baseline methods in robust estimation of large, high-dimensional systems.
Toolkit improves neural network safety for self-driving cars.
problem Ensuring safety of neural networks in autonomous driving systems.
method Structured approach using Goal Structuring Notation and recent scientific results.
result Improves quality of a level-3 autonomous driving component.
New ML methods improve physical system understanding by quantifying uncertainty across diverse regimes.
problem Capturing multi-regime physical systems with standard ML techniques.
method Coverage-oriented uncertainty quantification (UQ) methods.
result Coverage-oriented UQ models deliver physically consistent uncertainty estimates.
A new method calibrates scientific models by adding randomness to their predictions.
problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.
System automatically searches for scientific features in Mars rover images.
problem Manual task planning for Mars rover images is time-consuming and error-prone.
method Deep image captioning network and automated task prioritization.
result System can prioritize images for transmission based on search tasks.
Framework for interpreting ML models to reveal properties of real-world phenomena.
problem Lack of direct interpretability in modern ML models hinders scientific understanding.
method Developed 'property descriptors' grounded in statistical learning theory.
result Property descriptors can reveal relevant properties of joint probability distributions.
Why do nations produce scientific research? This is a fundamental problem in the field of social studies of science. The paper confronts this question here by showing vital determinants of science to explain the sources of social power and wealth creation by nations. Firstly, this study suggests a new general definitio…
In the same way as the Hilbert Program was a response to the foundational crisis of mathematics, this article tries to formulate a research program for the socio-economic sciences. The aim of this contribution is to stimulate research in order to close serious knowledge gaps in mainstream economics that the recent fina…
EduQG generates better educational questions by pre-training on scientific text.
problem Improving the quality of educational questions for scalable self-assessment.
method Adapting a large language model for educational question generation, pre-trained on scientific text.
result EduQG produces superior educational questions compared to baseline models.
In this essay, I attempt to provide supporting evidence as well as some balance for the thesis on `Transforming socio-economics with a new epistemology' presented by Hollingworth and Mueller (2008). First, I review a personal highlight of my own scientific path that illustrates the power of interdisciplinarity as well …
Study uses machine learning to predict predator-prey dynamics without prior knowledge.
problem Predicting predator-prey interactions without prior knowledge of the system.
method Applied Neural Ordinary Differential Equations (Neural ODEs) and Universal Differential Equations (UDEs) to the Lotka-Volterra model.
result UDEs outperform Neural ODEs in predicting predator-prey dynamics, especially in noisy data.
Instrumented data enables causal scientific machine learning
problem Insufficient data for causal scientific machine learning
method Instrumented data with explicit model, uncertainty, and counterfactuals
result Supports causal interventions through Pearl's do-operator
CATA++ improves scientific article recommendations by learning latent spaces with attention.
problem Natural data sparsity limits MF performance in recommender systems.
method CATA++ uses a dual autoencoder with attention to learn latent spaces from content and contextual information.
result CATA++ significantly improves MF performance on real-world datasets.
Visuals in scientific papers are used to express complex ideas; this study uses them to identify knowledge domains.
problem Scientific figures are underutilized in literature analysis.
method Encoded scientific figures into visual signatures and used distances between signatures to compare communities of practice.
result Figures can differentiate knowledge domains as effectively as text or citation patterns.
AGATHA predicts promising research directions from scientific data.
problem Efficiently winnowing thousands of potential targets in drug discovery.
method Deep-learning hypothesis generation system that ranks plausible term-pairs.
result Best-in-class performance on an established benchmark, high recommendation scores across subdomains.
HollowFlow speeds up likelihood evaluation for large-scale models.
problem Prohibitive scaling of sample likelihood computations in flow-based models.
method Introduces HollowFlow, a flow-based generative model using a NoBGNN with a block-diagonal Jacobian structure.
result Achieves up to O(n^2) speed-up in likelihood evaluation for large systems.
SGNNs use simulations to train neural networks, improving scientific forecasting and interpretability.
problem Combining precise theory and machine learning for robust scientific modeling.
method Pretraining neural networks on diverse mechanistic simulations as training data.
result SGNNs outperform data-driven and physics-constrained models in forecasting and interpretability.
Bayesian parametric matrix models provide uncertainty quantification for spectral learning.
problem Uncertainty quantification in spectral learning for safety-critical applications.
method Bayesian parametric matrix models (B-PMMs) that extend PMMs to provide uncertainty estimates.
result B-PMMs achieve exceptional uncertainty calibration (ECE < 0.05) while maintaining favorable scaling.
Generative model connects physical properties to latent vectors for solar magnetic patches.
problem Disconnection between generative latent vectors and scientifically relevant quantities.
method Integrating GAN, SVM, and SSL to generate and retrieve physically interpretable solar magnetic patches.
result GAN-SVM combination enables smooth changes in physical parameters with generated patches.
LLMs fail to match statistical ground truth despite stable run-to-run performance.
problem LLMs lack validation against statistical ground truth in automated scientific workflows.
method Introduced a behavioral evaluation framework for LLMs, separating four decision-making dimensions.
result LLMs can exhibit near-perfect stability but diverge from statistical ground truth.
The paper clarifies conditions for using benchmark scores in machine learning.
problem Using benchmark scores to draw scientific inferences about learning problems.
method Developing conditions of construct validity inspired by psychological measurement theory.
result Clarifies conditions under which benchmark scores support diverse scientific claims.
ParaMonte simplifies Monte Carlo simulations for various scientific fields.
problem Efficiently performing Monte Carlo simulations for complex models.
method Unified, high-performance, parallelized library for C, C++, Fortran.
result Automates and streamlines Monte Carlo sampling for arbitrary-dimensional functions.
Automates GPU kernel optimization for diverse applications.
problem Lack of systematic evaluation for multi-scenario GPU kernel optimization.
method Introduces MSKernelBench and CUDAMaster for automated optimization.
result Significant speedups across various operators, outperforming existing tools.
This paper advocates for applying scientific method principles to machine learning.
problem Aligning machine learning with scientific rigor, safety, and interpretability.
method Identifying and applying scientific method stages (hypothesis formulation, testing, uncertainty estimation) to machine learning.
result Machine learning researchers should adopt practices from other scientific domains to enhance understanding and reliability.
Statistical physics of complex systems exploits network theory not only to model, but also to effectively extract information from many dynamical real-world systems. A pivotal case of study is given by financial systems: market prediction represents an unsolved scientific challenge yet with crucial implications for soc…
The paper proposes a new framework for accurate uncertainty representation and propagation.
problem Inaccurate representation and propagation of uncertainty in measurement systems.
method The paper introduces a comprehensive framework using Gaussian Mixture Models (GMMs) for representing and propagating quantitative attributes in measurement systems.
result GMMs offer improved accuracy in representing and propagating measurement uncertainty compared to traditional Gaussian methods, while maintaining computational tractability.
We demonstrate the possibility of classifying causal systems into kinds that share a common structure without first constructing an explicit dynamical model or using prior knowledge of the system dynamics. The algorithmic ability to determine whether arbitrary systems are governed by causal relations of the same form o…
When society maintains a competitive system to promote an abstract goal, competition by necessity relies on imperfect proxy measures. For instance profit is used to measure value to consumers, patient volumes to measure hospital performance, or the Journal Impact Factor to measure scientific value. Here we note that \t…
Over 50 million scholarly articles have been published: they constitute a unique repository of knowledge. In particular, one may infer from them relations between scientific concepts, such as synonyms and hyponyms. Artificial neural networks have been recently explored for relation extraction. In this work, we continue…
Survey connects XAI and surrogate modeling for better understanding of complex systems.
problem Opaque surrogate models hide input-output relationships, hindering decision-making.
method Synthesizes XAI techniques with surrogate modeling workflows.
result Surrogate models can be made more interpretable using XAI methods.
Deployment-complete benchmarking assesses if evidence leads to consistent deployment actions.
problem Lack of clear evidence leading to consistent deployment actions.
method Introduces deployment-complete benchmarking to test if benchmark evidence determines deployment actions.
result Benchmark evidence must be complete for a claim to lead to a consistent deployment action.
Automatic classification of scientific articles based on common characteristics is an interesting problem with many applications in digital library and information retrieval systems. Properly organized articles can be useful for automatic generation of taxonomies in scientific writings, textual summarization, efficient…
New insights into ML models' accuracy and generalization for scientific problems.
problem Quantifying accuracy and generalization of ML models in scientific applications.
method Rigorous numerical analysis and theoretical bounds for linear differential equations.
result Different ML models can have opposing generalization behaviors, contrary to intuition.
This article is a prologue to the article "Why Markets are Inefficient: A Gambling 'Theory' of Financial Markets for Practitioners and Theorists." It presents important background for that article --- why gambling is important, even necessary, for real-world traders --- the reason for the superiority of the strategic/g…
Paper introduces MTGP for engineering tasks with sparse data.
problem Challenges of data sparsity and varying task correlations in engineering.
method Multi-Task Gaussian Processes (MTGP) framework.
result Improves predictive performance and reduces computational costs.
Neural network learns equations from data, improving interpretability and extrapolation.
problem Combining neural networks and symbolic regression for better model interpretability and extrapolation.
method Integrating a neural network-based Equation Learner (EQL) network with other deep learning architectures.
result The EQL-based architecture can extrapolate well outside of the training data set.
PNNs model aleatoric uncertainty in scientific machine learning with high accuracy.
problem Aleatoric uncertainty in scientific systems with unequal variance.
method Developed a probabilistic distance metric to optimize PNN architecture and used it in material science applications.
result PNNs yield remarkably accurate output mean estimates and high correlation in predicted intervals.
Random Machines improves SVM performance with free kernel choice.
problem Efficiency and accuracy in solving classification and regression problems.
method Bagged-weighted support vector model with free kernel choice.
result Improved accuracy and reduced computational time.
RPCholesky approximates kernel matrices with few evaluations.
problem Approximating kernel matrices efficiently.
method Randomly pivoted partial Cholesky factorization.
result RPCholesky provides nearly optimal low-rank approximations.
Data mining revealed a cluster of economic, psychological, social and cultural indicators that in combination predicted corruption and wealth of European nations. This prosperity syndrome of self-reliant citizens, efficient division of labor, a sophisticated scientific community, and respect for the law, was clearly di…
Automates organizing diverse web data into a hierarchical topic model.
problem Manual classification of all scientific and popular scientific knowledge is impractical.
method Proposes an algorithm to aggregate multiple collections into a single hierarchical topic model.
result Demonstrates a web service for topical exploratory search.
EnKBS smoothes complex systems with future observations for causal inference.
problem Improving state estimation in complex systems with rapid dynamics.
method Continuous-time ensemble Kalman-Bucy smoother for nonlinear dynamical systems.
result EnKBS provides derivative-free framework with high skill in various scientific problems.