Crowdsourced science questions improve exam accuracy.
problem Generating high-quality, domain-specific multiple choice questions is challenging.
method Leveraging a corpus and existing questions, the method suggests document selection and answer distractors.
result Crowdsourced questions are indistinguishable from original questions and improve exam accuracy.
Paper tackles natural science exam questions, improving over previous systems.
problem Hard natural science exam questions requiring advanced logic reasoning.
method Constructs contextual knowledge graphs for questions and supporting sentences, learns to reason with neural embeddings.
result Model outperforms previous state-of-the-art QA systems on the ARC Challenge Set.
Proposes a methodology to improve data science ROI by addressing key business questions.
problem Companies often fail to maximize data science value, focusing on basic analysis.
method Categorizes and answers 'The Big Three' questions using data science methods.
result Shows how to apply the methodology to real business use cases.
Machine learning interpretability needs a scientific approach, not just tools.
problem Lack of a universal definition and scientific approach in machine learning interpretability.
method Propose interpretability as a scientific discipline with specific questions.
result Interpretability should be a set of questions rather than a specific tool.
Causal inference is crucial for understanding data in Data Science.
problem Understanding causal effects in data science, even when data is non-causal.
method Review of causal roadmap, including scientific question, causal model, estimands, statistical estimators, and interpretation.
result Using the causal roadmap framework improves statistical analysis and interpretation in Data Science.
Foundation models alter medical data science workflow, challenging veridical data science principles.
problem Foundation models disrupt traditional data science practices in medicine.
method Critically examined the medical foundation model lifecycle and its deviation from veridical data science principles.
result Foundation models challenge veridical data science principles of predictability, computability, and stability.
Data science reveals co-evolution of income inequality and savings across countries.
problem Understanding the co-evolution of income inequality and savings across countries.
method Time series data for Gini indices and Gross Domestic Savings (% of GDP) were used to construct correlation and similarity matrices, and a multi-dimensional scaling technique was applied. Linear regression was used to test the empirical linkage between income inequality and savings.
result The empirical model proposed by Chakraborti-Chakrabarti (2000) holds reasonably true for many economies of the world, showing a moderate relationship between income inequality and savings.
Baccalaureate institutions seek to integrate statistics into data science.
problem Graduate statisticians losing ground in data science.
method Reviewing historical contributions of statisticians and calling for integration.
result Baccalaureate institutions need to integrate statistics into data science education.
We present three case studies of organizations using a data science competition to answer a pressing question. The first is in education where a nonprofit that creates smart school budgets wanted to automatically tag budget line items. The second is in public health, where a low-cost, nonprofit women's health care prov…
Review of automation's role in chemical discoveries.
problem Improving autonomous discovery in chemistry.
method Classification of discovery types, assessment of autonomy, case studies.
result Rapid advancements in automation and machine learning are transforming experimentation and modeling.
As machine learning systems become ubiquitous, there has been a surge of interest in interpretable machine learning: systems that provide explanation for their outputs. These explanations are often used to qualitatively assess other criteria such as safety or non-discrimination. However, despite the interest in interpr…
This work explores using deep NNs to learn quantum systems from probability distributions.
problem Learning quantum systems from limited probability distribution data.
method Using deep neural networks to reconstruct quantum Hamiltonian from probability distributions.
result Deep neural networks can learn quantum Hamiltonians from probability distributions.
This paper advocates for applying scientific method principles to machine learning.
problem Aligning machine learning with scientific rigor, safety, and interpretability.
method Identifying and applying scientific method stages (hypothesis formulation, testing, uncertainty estimation) to machine learning.
result Machine learning researchers should adopt practices from other scientific domains to enhance understanding and reliability.
Machine learning's data-centric philosophy conflicts with natural sciences' standards.
problem Conflict between machine learning's ontology and epistemology and natural sciences' practices.
method Identifying and analyzing contexts where ML can be beneficial or harmful in natural sciences.
result ML can enhance trustworthiness in causal inference but introduces biases in emulation and labeling.
The study reveals nations drive scientific research for social and economic interests.
problem Why do nations produce scientific research?
method Synthesizes previous concepts of science and scientific research, defines them, and identifies key drivers.
result Scientific research is driven by nations' social and economic interests, not just for philosophical inquiries.
Fisher et al. extend multi-VAR for better modeling of heterogeneous time series.
problem Modeling structurally heterogeneous processes in social, health, and behavioral sciences.
method Adaptive weighting schemes for penalized estimation of multiple-subject multivariate time series.
result Improved estimation performance compared to alternative estimators.
Survival analysis models research reproducibility, offering new insights.
problem Reproducibility crisis in machine learning research.
method Survival analysis to model reproducibility as a continuous process.
result Survival analysis provides deeper insights into research reproducibility.
The paper surveys network methods for understanding economic and financial systems.
problem Understanding interconnectedness among economic and financial entities.
method Survey of network theory, measures, and structures for economic and financial networks.
result Network methods provide tools to quantify structural properties of economic systems.
Paper presents a workflow for reliable unsupervised learning in science.
problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.
Network science reveals fragmentation and integration in US financial industry.
problem Understanding the evolution of US financial industry over time.
method TVP-VAR approach on stock market returns to infer unobserved links, network science tools.
result Fragmentation and integration coexist in US financial industry, challenging sectoral macroprudential frameworks.
In the light of contemporary discussions of inter and transdisciplinarity, this paper approaches econophysics and sociophysics to seek a response to the question -- whether these interdisciplinary fields could contribute to physics and economics. Drawing upon the literature on history and philosophy of science, the pap…
Analyzes 6M Python notebooks and 2M enterprise DS pipelines to guide investments in data science.
problem Challenges in following the rapidly evolving landscape of data science technologies and applications.
method Downloaded and analyzed over 6M Python notebooks and 2M enterprise DS pipelines, performing statistical and comparative analyses.
result Identifies actionable conclusions for system builders and technology bets for practitioners based on current trends.
A fundamental question in Riemannian geometry is to find canonical metrics on a given smooth manifold. In the 1980s, R. Hamilton proposed an approach to this question based on parabolic partial differential equations. The goal is to start from a given initial metric and deform it to a canonical metric by means of an ev…
Machine learning improves optimization algorithms in data science.
problem Improving optimization algorithms in data science.
method Training machine learning methods to automatically improve optimization algorithms.
result Machine learning leads to more effective outcomes for optimization problems.
Study examines explainable machine learning for monotonic models, finding Integrated gradients better for strong monotonicity.
problem Applying explainable machine learning to science-informed models.
method Proposed axioms for monotonicity, tested Shapley value and Integrated gradients methods.
result Integrated gradients provides better explanations for strong monotonicity.
Faster, more accurate IRT model for large datasets.
problem Speed and accuracy challenges in fitting IRT models to large datasets.
method Variational Bayesian inference for IRT models.
result Higher log likelihoods and improved missing data imputation.
Flat tori found non-isometric pairs with identical Laplace eigenvalues.
problem Finding the lowest dimension for isospectral non-isometric flat tori.
method Analytic, geometric, and number theoretic approaches.
result Schiemann resolved the isospectral problem for flat tori in the 1990s.
Survey on community detection methods and their theoretical properties.
problem Consistent estimation of community labels in networks.
method Various community detection methods and their theoretical properties.
result Review of community detection methods and their theoretical properties.
Develops a machine learning pipeline for learning causal structure in time-series data.
problem Current ML algorithms fail to learn causal structure in time-series data due to lack of temporal order consideration.
method Integrates machine learning with chaos theory using ChaosFEX feature extractor to learn generalized causal structure.
result Successfully learns generalized causal structure in time-series data.
Deep learning detects cloud changes due to human aerosols.
problem Uncertainty in the effect of anthropogenic aerosols on cloud properties and Earth's energy balance.
method Deep convolutional neural networks to analyze cloud images.
result Identified and characterized specific cloud perturbations due to human aerosols.
Bayesian approach groups observations with similar effects for better inference.
problem Estimating heterogeneity across observations in political science.
method Structured sparsity framework integrated into Bayesian regression analysis.
result Method outperforms state-of-the-art methods for heterogeneous effects estimation.
In the same way as the Hilbert Program was a response to the foundational crisis of mathematics, this article tries to formulate a research program for the socio-economic sciences. The aim of this contribution is to stimulate research in order to close serious knowledge gaps in mainstream economics that the recent fina…
FCM clustering adapts to persistence diagrams for topological data analysis.
problem Integrating topological data into machine learning workflows.
method Adapting Fuzzy c-Means to persistence diagrams.
result FCM clustering captures topological structure without additional processing.
SCROLLS benchmarks long text NLP tasks, improving existing models.
problem Short NLP benchmarks ignore long texts; SCROLLS addresses this.
method Handpicked long-text datasets for summarization, QA, and inference tasks.
result Improvement potential on SCROLLS tasks, as indicated by initial baselines.
This paper identifies duplicate questions on Quora using machine and deep learning models.
problem Detecting semantically identical questions on Quora to improve user experience.
method Applied machine learning and deep learning techniques on Quora's dataset.
result Xgboost model with character level term frequency and inverse term frequency achieved 85.82% accuracy.
Machine learning impacts computational math, offering new functions approximations.
problem Machine learning's black box nature hinders further progress in computational math.
method Analyzes machine learning's impact on computational math and vice versa.
result Integrating computational math with machine learning can enhance both fields.
This paper reflects on teaching Data Science to diverse students.
problem Adapting learning practices to diverse backgrounds in Data Science.
method Summarizes experiences from teaching a postgraduate Data Science module.
result Draws lessons relevant to teaching Data Science.
Data science teams collaborate extensively, using various tools and stakeholders.
problem Lack of understanding in how data science workers collaborate in practice.
method Conducted an online survey with 183 data science workers.
result Data science teams are highly collaborative and use multiple tools and stakeholders.
Mnay models situated in the current research landscape of modelling and simulating social processes have roots in physics. This is visible in the name of specialties as Econophysics or Sociophysics. This chapter describes the history of knowledge transfer from physics, in particular physics of self-organization and evo…
Data science redefines causal inference from observational data, classifying tasks into description, prediction, and counterfactual prediction.
problem Widespread misunderstandings about data science's role in causal inference from observational data.
method Organizing data science tasks into three classes: Description, prediction, and counterfactual prediction (including causal inference).
result The necessity of subject-matter expert knowledge for causal analyses in data science.
Formulates approach for guiding explanation types based on user specifications.
problem Creating explainable AI components from user-defined specifications.
method Develops a method for generating explanations based on user-defined specifications.
result Demonstrates feasibility of user-defined explanations for complex models like Bayesian networks and graph neural networks.
We study high-dimensional distribution learning in an agnostic setting where an adversary is allowed to arbitrarily corrupt an ε-fraction of the samples. Such questions have a rich history spanning statistics, machine learning and theoretical computer science. Even in the most basic settings, the only known…
This report aims to improve trust in AI by explaining machine learning models.
problem Understanding and trusting automated decision-making systems.
method Survey and distillation of literature on explainable machine learning.
result Survey findings help practitioners understand and apply explainable methods.
Machine learning improves wildfire science and management, but requires expert knowledge.
problem Improving wildfire science and management through AI.
method Review of popular ML approaches and their application in six wildfire science domains.
result Opportunities exist for applying more advanced ML methods in wildfire science.
ML methods improve planetary science data analysis.
problem Insufficient use of ML in planetary science.
method Ten recommendations for integrating ML in planetary science.
result Expanding planetary science insights from large datasets.
Quantum walk algorithm optimizes quantum state preparation for financial simulations.
problem Efficiently loading classical data into quantum states for quantum computers.
method Split-step quantum walks (SSQW) to design parameterized quantum circuits (PQC).
result SSQW facilitates generating desired probability amplitude distributions for quantum simulations.
Spectral methods simplify data analysis, improving accuracy and stability.
problem Extracting meaningful information from noisy, incomplete data.
method Eigenvalues and eigenvectors of matrices constructed from data.
result Spectral methods are effective and can be analyzed using modern statistical theory.
Quantum mechanics models human perception and decision-making, offering a new approach to understanding social dynamics.
problem Understanding the complex interactions between individuals and groups in social networks.
method Developed a simple computational code based on quantum mechanics principles to model human perception and decision-making.
result Quantum-inspired models can help explain differences in individual and group behavior.