The paper explains emergent phenomena in deep learning using entropic forces.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper defines strong emergence in field theories and proves it exists between certain theories.
An agent-based computational economical toy model for the emergence of money from the initial barter trading, inspired by Menger's postulate that money can spontaneously emerge in a commodity exchange economy, is extensively studied. The model considered, while manageable, is significantly complex, however. It is alrea…
Use simplified layerwise linear models to understand neural dynamics.
Analyzes magnetic Laplacian on hyperbolic surfaces, highlighting key quantum phenomena.
Most of the econometric and econophysics models have been borrowed from the statistical physics, and as a cosequence, a new interdisciplinary science called econophysics has emerged. In this paper we planned to extend the analogy between different economic processes or phenomena and processes and phenomena from differe…
Quantum systems are viewed as emergent systems from the fundamental degrees of freedom. The laws and rules of quantum mechanics are understood as an effective description, valid for the emergent systems and specially useful to handle probabilistic predictions of observables. After introducing the geometric theory of Ha…
New approach simulates reputation dynamics using information compression.
Noise causes learning plateaus in neural networks.
The paper axiomatizes strong emergence in parameterized field theories and proves existence theorems.
Predicts language model performance from public models without training.
Unified theory of deep learning from approximation to emergence.
This thesis explores emergent intelligence in disordered systems like spin glasses and neural networks.
A vast amount of textual web streams is influenced by events or phenomena emerging in the real world. The social web forms an excellent modern paradigm, where unstructured user generated content is published on a regular basis and in most occasions is freely distributed. The present Ph.D. Thesis deals with the problem …
Collective phenomena with universal properties have been observed in many complex systems with a large number of components. Here we present a microscopic model of the emergence of scaling behavior in such systems, where the interaction dynamics between individual components is mediated by a global variable making the …
New cooperative dynamics enhances retrieval performance in neural networks.
Social interactions and personal tastes shape our consumption behavior of cultural products. In this study, we present a computational model of a cultural market and we aim to analyze the behavior of the consumer population as an emergent phenomena. Our results suggest that the final market shares of cultural products …
Training task diversity improves ICL with linear attention.
Financial markets provide an ideal frame for studying decision making in crowded environments. Both the amount and accuracy of the data allows to apply tools and concepts coming from physics that studies collective and emergent phenomena or self-organised and highly heterogeneous systems. We analyse the activity of 29,…
A theory of deep learning is emerging, focusing on training dynamics and statistics.
The dual crises of the sub-prime mortgage crisis and the global financial crisis has prompted a call for explanations of non-equilibrium market dynamics. Recently a promising approach has been the use of agent based models (ABMs) to simulate aggregate market dynamics. A key aspect of these models is the endogenous emer…
In this dissertation two simple models of stock exchange are developed and simulated numerically. The first is characterized by centralized trading with a market maker. Unfortunately, this model is unable to generate realistic market dynamics. The second model discards the requirement of centralized trading. Under vari…
One 'problem' with the 21st century world, particularly the economic and business worlds, is the phenomenal and increasing number of interconnections between economic agents (consumers, firms, banks, markets, national economies). This implies that such agents are all interacting and consequently giving raise to enormou…
A new sampler tackles critical phenomena by leveraging scale invariance.
We investigate possible origins of trends using a deterministic threshold model, where we refer to long-term variabilities of price changes (price movements) in financial markets as trends. From the investigation we find two phenomena. One is that the trend of monotonic increase and decrease can be generated by dealers…
Symmetry in loss functions constrains model parameters, leading to specific learning outcomes.
Mechanisms of human color vision are characterized by two phenomenological aspects: the system is nonlinear and adaptive to changing environments. Conventional attempts to derive these features from statistics use separate arguments for each aspect. The few statistical approaches that do consider both phenomena simulta…
Masanao Aoki developed a new methodology for a basic problem of economics: deducing rigorously the macroeconomic dynamics as emerging from the interactions of many individual agents. This includes deduction of the fractal / intermittent fluctuations of macroeconomic quantities from the granularity of the mezo-economic …
New model quantifies interactions' role in real-world phenomena.
Proof confirms perfect representation in deep learning models.
Develops a machine learning framework for computing most probable paths in stochastic systems.
By building on a recently introduced genetic-inspired attribute-based conceptual framework for safety risk analysis, we propose a novel methodology to compute construction univariate and bivariate construction safety risk at a situational level. Our fully data-driven approach provides construction practitioners and aca…
The recent emergence of cryptocurrencies such as Bitcoin and Ethereum has posed possible alternatives to global payments as well as financial assets around the globe, making investors and financial regulators aware of the importance of modeling them correctly. The Levy's stable distribution is one of the attractive dis…
Many complex systems exhibit extreme events far more often than expected for a normal distribution. This work examines how self-similar bursts of activity across several orders of magnitude can emerge from first principles in systems that adapt to information. Surprising connections are found between two apparently unr…
Method detects critical events in complex systems by learning latent causal structure.
Research explores how interconnected systems synchronize and how to control their behavior.
Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We propose a general learning framework for modeling agent behavior in any multiagent …
The Ricci iteration is a discrete analogue of the Ricci flow. We give the first study of the Ricci iteration on a class of Riemannian manifolds that are not Kähler. The Ricci iteration in the non-Kähler setting exhibits new phenomena. Among them is the existence of so-called ancient Ricci iterations. As we show, these …
Study examines effects of pruning techniques on deep learning models.
This paper introduces intrinsic time, a new measure of time for complex systems.
We analyze oversquashing in topological message-passing using relational structures.
The paper argues against the inefficiency of explaining deep learning phenomena.
In this paper, we consider a concentration of measure problem on Riemannian manifolds with boundary. We study concentration phenomena of non-negative -Lipschitz functions with Dirichlet boundary condition around zero, which is called boundary concentration phenomena. We first examine relation between boundary concen…
This research generates synthetic data streams for handling concept drifts and novel classes.
This paper applies quantum theory to cost accounting, focusing on WIP valuation.
The two phase behavior in financial markets actually means the bifurcation phenomenon, which represents the change of the conditional probability from an unimodal to a bimodal distribution. In this paper, the bifurcation phenomenon in Hang-Seng index is carefully investigated. It is observed that the bifurcation phenom…
For a compact manifold with boundary we introduce the -fold scattering stretched product which is a compact manifold with corners for each coinciding with the previously known cases for It is constructed by iterated blow up of boundary faces and boundary faces of multi-diagonals i…
PySR method automates discovering equations from data in chaotic dynamics and epidemics.