We are in the middle of a complex debate as to whether Economics is really a proper natural science. The 'Discussion & Debate' issue of this Euro. Phys. J. Special Topic volume is: 'Can economics be a Physical Science?' I discuss some aspects here.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “natural science”
Defines data science as a natural ecosystem with challenges and missions.
problem Challenges and missions in data science due to 5D complexities and data life cycle phases.
method Systemic and data-centric view of data science as a fusion of data universe and its challenges, formalizing a general-purpose architecture.
result Essential data science as a natural ecosystem integrating specific disciplines and high-impact applications.
Paper tackles natural science exam questions, improving over previous systems.
problem Hard natural science exam questions requiring advanced logic reasoning.
method Constructs contextual knowledge graphs for questions and supporting sentences, learns to reason with neural embeddings.
result Model outperforms previous state-of-the-art QA systems on the ARC Challenge Set.
Machine learning's data-centric philosophy conflicts with natural sciences' standards.
problem Conflict between machine learning's ontology and epistemology and natural sciences' practices.
method Identifying and analyzing contexts where ML can be beneficial or harmful in natural sciences.
result ML can enhance trustworthiness in causal inference but introduces biases in emulation and labeling.
Constructing Effective Machine Learning Models for the Sciences: A Multidisciplinary Perspectivecs.LG
The study explores how machine learning can enhance scientific research.
problem Improving scientific models with machine learning.
method Analysis of data-driven models versus manually added variables in regression.
result Complex models may not always improve over simpler ones in scientific contexts.
Causal inference from observational data is the goal of many data analyses in the health and social sciences. However, academic statistics has often frowned upon data analyses with a causal objective. The introduction of the term "data science" provides a historic opportunity to redefine data analysis in such a way tha…
Classic economic science is reaching the limits of its explanatory powers. Complexity science uses an increasingly larger set of different methods to analyze physical, biological, cultural, social, and economic factors, providing a broader understanding of the socio-economic dynamics involved in the development of nati…
Deep learning excels in AI but struggles with causal physics.
problem Deep learning struggles with causal relationships in physical sciences.
method Combining Bayesian methods, physical constraints, and causal models.
result Deep learning can mislead in systems with unclear causal relationships.
This is a short commentary piece that discusses how the methods used in the natural sciences can apply to economics in general and financial markets specifically.
GenSBI offers JAX-native SBI methods for natural sciences.
problem Lack of native SBI libraries in JAX for natural sciences.
method Flow and diffusion generative models in JAX.
result Near-ideal mean C2ST scores on SBIBM tasks.
Economics does not need a scientific revolution. Economics needs accurate measurements according to high standards of natural sciences and meticulous work on revealing empirical relationships between measured variables.
Review of automation's role in chemical discoveries.
problem Improving autonomous discovery in chemistry.
method Classification of discovery types, assessment of autonomy, case studies.
result Rapid advancements in automation and machine learning are transforming experimentation and modeling.
New method shows data-driven causal studies can be misleading.
problem Misattribution of causality in data-driven earth science studies.
method Subsample-based ensemble approach for robust causality analysis.
result Transfer entropy-based causal graphs can be spurious.
Natural speech can be easily manipulated to alter perception.
problem The susceptibility of natural speech to manipulation.
method Investigation of the McGurk effect and Yanny or Laurel illusion.
result A significant fraction of natural speech is illusionable.
This review compares extractive and abstractive summarization methods.
problem Improving abstractive summarization in natural language processing.
method Compared various approaches including supervised and unsupervised methods, deep learning, and NLP.
result Current research uses combinations of approaches, but abstractive summarization remains unsolved.
Diffusion models explained via cognitive science.
problem Weak sensitivity to noise family and noise level scheduling.
method Correspondence with serial reproduction in cognitive science.
result Properties of diffusion models explained by cognitive science.
Upper bound on CRN reaction rates derived using information geometry.
problem Challenging task of deriving an upper bound on reaction rates of nonlinear, discrete CRNs.
method Information geometric approach using natural gradient.
result Validated through numerical simulations, demonstrating faster convergence in specific CRNs.
Paper develops an attention mechanism for long-term scientific impact prediction.
problem Predicting the long-term impact of scientific papers based on citation records.
method Develops an attention mechanism to predict long-term scientific impact.
result Emphasizing the limited attention can better stand on the shoulders of giants.
Proposes priors for interpretable word embeddings.
problem Lack of interpretability and unsupervised nature of word embeddings.
method Use of informative priors to create interpretable probabilistic word embeddings.
result Sensible priors capture latent semantic concepts better than current methods.
Surprise predicts breakthroughs in science and technology.
problem Predicting breakthroughs in science and technology.
method Using embeddings from high-dimensional stochastic block models, predicting combinations with AUC of 95%.
result Breakthroughs often occur when problems from one field are solved by researchers from another field.
This is a lecture note for the course DS-GA 3001 <Natural Language Understanding with Distributed Representation> at the Center for Data Science , New York University in Fall, 2015. As the name of the course suggests, this lecture note introduces readers to a neural network based approach to natural language understand…
FCM clustering adapts to persistence diagrams for topological data analysis.
problem Integrating topological data into machine learning workflows.
method Adapting Fuzzy c-Means to persistence diagrams.
result FCM clustering captures topological structure without additional processing.
Machine learning aids scientific discoveries by explaining complex data.
problem Extracting scientific insights from complex data.
method Combining machine learning with domain knowledge for transparency, interpretability, and explainability.
result Enhanced scientific consistency through machine learning and domain knowledge integration.
New method models dewetting of anisotropic particles using numerical techniques.
problem Modeling dewetting dynamics of particles with varying surface energies.
method Level set numerical approach with convolution kernels to handle anisotropic interfacial energies.
result Validated numerical scheme supports merging and splitting of interfaces.
Machine learning interpretability needs a scientific approach, not just tools.
problem Lack of a universal definition and scientific approach in machine learning interpretability.
method Propose interpretability as a scientific discipline with specific questions.
result Interpretability should be a set of questions rather than a specific tool.
Develops efficient algorithms for data science, tackling the curse of dimensionality.
problem Tackles the curse of dimensionality in large datasets.
method Focuses on feature extraction techniques and meta-heuristic algorithms, including evolutionary algorithms.
result Evolutionary algorithms are effective in solving optimization problems with a curse of dimensionality.
MIM adds indicator variables to improve model performance on incomplete data.
problem Missing data in incomplete data sets.
method Missing Indicator Method (MIM) and Selective MIM (SMIM).
result MIM improves model performance for informative missing values and high-dimensional data.
Topology connects to black holes and wormholes.
problem Understanding topological changes in 3D space.
method Direct connection via surgery.
result New insights into black hole and wormhole formation.
Clarifies when certain stochastic PDEs have affine solutions.
problem Existence of affine realizations for semilinear SPDEs driven by Lévy processes.
method Analyzes conditions for affine solutions to SPDEs driven by Lévy processes.
result Conditions for the existence of affine realizations are established.
Novel method for Bayesian model comparison using deep learning.
problem Comparing complex models in science with intractable likelihood functions.
method Simulation-based, purely deep learning approach that amortizes model fitting costs.
result Achieves excellent results in accuracy, calibration, and efficiency.
Unsupervised method constructs knowledge graph from text and code.
problem Lack of structured knowledge in scientific literature and code.
method Word embedding, clustering, and dimensionality reduction techniques.
result Enhanced understanding of scientific literature and code.
This paper reflects on teaching Data Science to diverse students.
problem Adapting learning practices to diverse backgrounds in Data Science.
method Summarizes experiences from teaching a postgraduate Data Science module.
result Draws lessons relevant to teaching Data Science.
A framework for network embedding using VDS principles.
problem Challenges in systematically studying network embedding algorithms.
method Veridical Data Science (VDS) framework applied to network embedding.
result Potential for new research directions in network embedding.
Research connects topological changes to black hole formation and wormholes.
problem Understanding topological changes in mathematical three-space.
method Direct connection via surgery to black hole and wormhole formation.
result New platform for exploring geometrical physics.
Survey on understanding neural networks for medical applications.
problem Black-box nature of deep neural networks hinders their use in critical applications.
method Comprehensive review of interpretability studies in neural networks.
result Interpretability research is crucial for the acceptance of neural networks in medical diagnosis.
Nature-inspired algorithms improve data analytics efficiency.
problem Efficient data analytics with reduced dimensionality.
method Nature-inspired algorithms for feature selection optimization.
result Nature-inspired algorithms enhance data analytics efficiency.
Data science teams collaborate extensively, using various tools and stakeholders.
problem Lack of understanding in how data science workers collaborate in practice.
method Conducted an online survey with 183 data science workers.
result Data science teams are highly collaborative and use multiple tools and stakeholders.
SCROLLS benchmarks long text NLP tasks, improving existing models.
problem Short NLP benchmarks ignore long texts; SCROLLS addresses this.
method Handpicked long-text datasets for summarization, QA, and inference tasks.
result Improvement potential on SCROLLS tasks, as indicated by initial baselines.
NVA combines variational posteriors, annealing, and natural-gradient learning for multimodal optimization.
problem Finding multiple global and local modes in nonconvex objectives.
method NVA integrates variational posteriors, annealing, and natural-gradient learning.
result NVA outperforms gradient descent and evolution strategies on simulations and real-world problems.
Interdisciplinarity in Socio-economics, mathematical analysis and predictability of complex systemsphysics.soc-ph
In this essay, I attempt to provide supporting evidence as well as some balance for the thesis on `Transforming socio-economics with a new epistemology' presented by Hollingworth and Mueller (2008). First, I review a personal highlight of my own scientific path that illustrates the power of interdisciplinarity as well …
ML methods improve planetary science data analysis.
problem Insufficient use of ML in planetary science.
method Ten recommendations for integrating ML in planetary science.
result Expanding planetary science insights from large datasets.
Machine learning improves wildfire science and management, but requires expert knowledge.
problem Improving wildfire science and management through AI.
method Review of popular ML approaches and their application in six wildfire science domains.
result Opportunities exist for applying more advanced ML methods in wildfire science.
This book presents a methodology and philosophy of empirical science based on large scale lossless data compression. In this view a theory is scientific if it can be used to build a data compression program, and it is valuable if it can compress a standard benchmark database to a small size, taking into account the len…
Introduces a network-based framework to analyze swarm intelligence.
problem Lack of a common framework to compare swarm-based algorithms.
method Introduces an interaction network to examine swarm-based systems.
result Shows how swarm-based algorithms can be studied as systems.
A physics-based method improves data interpolators and regression tasks.
problem Improving accuracy and efficiency in function learning.
method Inspired by statistical mechanics, introduces corrections to minimize energy.
result Improves performance in interpolation and regression tasks, especially in high-dimensional spaces.
Foundation models alter medical data science workflow, challenging veridical data science principles.
problem Foundation models disrupt traditional data science practices in medicine.
method Critically examined the medical foundation model lifecycle and its deviation from veridical data science principles.
result Foundation models challenge veridical data science principles of predictability, computability, and stability.
Understanding the nature of dark energy, the mysterious force driving the accelerated expansion of the Universe, is a major challenge of modern cosmology. The next generation of cosmological surveys, specifically designed to address this issue, rely on accurate measurements of the apparent shapes of distant galaxies. H…
Study improves material similarity measures considering distinctiveness.
problem Improving similarity measures for materials science applications.
method Used machine learning techniques with specific descriptors and kernels.
result Minimizing loss of distinctiveness improves prediction accuracy.