Study of two-layer ReLU neural network phase diagram at infinite-width limit.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
This paper presents a phase diagram for two-layer neural networks under different initialization scales.
We recall the similarities between the concepts and techniques of Thermodynamics and Roegenian Economics. The Phase Diagram for a Roegenian economic system highlights a triple point and a critical point, with related explanations. These ideas can be used to improve our knowledge and understanding of the nature of devel…
Quantum phase diagrams for Chern topological insulators show jumps at critical loci.
Theory explains how deep nets learn features from data.
We describe a bottom-up framework, based on the identification of appropriate order parameters and determination of phase diagrams, for understanding progressively refined agent-based models and simulations of financial markets. We illustrate this framework by starting with a deterministic toy model, whereby indepe…
Characterizes kernel interpolation in large dimensions, revealing optimal and sub-optimal regions.
In this letter, we apply the artificial neural network in a supervised manner to map out the quantum phase diagram of disordered topological superconductor in class DIII. Given the disorder that keeps the discrete symmetries of the ensemble as a whole, translational symmetry which is broken in the quasiparticle distrib…
Analyzing large X-ray diffraction (XRD) datasets is a key step in high-throughput mapping of the compositional phase diagrams of combinatorial materials libraries. Optimizing and automating this task can help accelerate the process of discovery of materials with novel and desirable properties. Here, we report a new met…
In this paper we explore the functional correlation approach to operational risk. We consider networks with heterogeneous a-priori conditional and unconditional failure probability. In the limit of sparse connectivity, self-consistent expressions for the dynamical evolution of order parameters are obtained. Under equil…
The aim of this work is to explore the possible types of phenomena that simple macroeconomic Agent-Based models (ABM) can reproduce. We propose a methodology, inspired by statistical physics, that characterizes a model through its 'phase diagram' in the space of parameters. Our first motivation is to understand the lar…
Machine learning predicts phase behavior in active matter suspensions.
The paper analyzes the efficiency of unlearning methods and establishes bounds for minimax computation times.
We study Generalised Restricted Boltzmann Machines with generic priors for units and weights, interpolating between Boolean and Gaussian variables. We present a complete analysis of the replica symmetric phase diagram of these systems, which can be regarded as Generalised Hopfield models. We underline the role of the r…
Stochastic Gradient Descent phases explained for deep networks.
In this article, we give a rough, and so not complete yet, proof of Kashaev's conjecture, that is, the volume conjecture for hyperbolic knots, where the hyperbolicity equations associated to knot diagrams appear as the stationary phase equations for Kashaev's invariants.
Study uses supervised learning to classify quantum phases with limited measurements.
The influence of Commodity Trading Advisors (CTA) on the price process is explored with the help of a simple model. CTA managers are taken to be Kelly optimisers, which invest a fixed proportion of their assets in the risky asset and the remainder in a riskless asset. This requires regular adjustment of the portfolio w…
An algorithmic limit of compressed sensing or related variable-selection problems is analytically evaluated when a design matrix is given by an overcomplete random matrix. The replica method from statistical mechanics is employed to derive the result. The analysis is conducted through evaluation of the entropy, an expo…
We analyze the landscape of empirical risk minimization for high-dimensional models, predicting phase transitions and critical point properties.
Model shows liquidity stress crossover in market dynamics.
We study the feasibility and noise sensitivity of portfolio optimization under some downside risk measures (Value-at-Risk, Expected Shortfall, and semivariance) when they are estimated by fitting a parametric distribution on a finite sample of asset returns. We find that the existence of the optimum is a probabilistic …
Study on synchronization in financial markets with time delays.
PLS-SVD struggles with missing data in multimodal datasets, showing a phase transition in performance.
Persistent entropy detects phase transitions in complex systems.
Using generating functional and replica techniques, respectively, we study the dynamics and statics of a spherical Minority Game (MG), which in contrast with a spherical MG previously presented in J.Phys A: Math. Gen. 36 11159 (2003) displays a phase with broken ergodicity and dependence of the macroscopic stationary s…
We introduce and begin the study of new knot energies defined on knot diagrams. Physically, they model the internal energy of thin metallic solid tori squeezed between two parallel planes. Thus the knots considered can perform the second and third Reidemeister moves, but not the first one. The energy functionals consid…
Transformers learn to generalize out-of-distribution with diverse pretraining tasks.
A simple and elegant arrangement of stock components of a portfolio (market index-DJIA) in a recent paper [1], has led to the construction of crossing of stocks diagram. The crossing stocks method revealed hidden remarkable algebraic and geometrical aspects of stock market. The present paper continues to uncover new ma…
Restricted Boltzmann Machines are described by the Gibbs measure of a bipartite spin glass, which in turn corresponds to the one of a generalised Hopfield network. This equivalence allows us to characterise the state of these systems in terms of retrieval capabilities, both at low and high load. We study the paramagnet…
Early stopping improves generalization in overparameterized diffusion models.
Develops a new framework to analyze gradient flow regimes and derive explicit solutions.
New measure EC assesses node contributions in nonlinear, time-varying systems.
Fundamental weight systems identified as quantum states.
We consider models of financial markets in which all parties involved find incentives to participate. Strategies are evaluated directly by their virtual wealths. By tuning the price sensitivity and market impact, a phase diagram with several attractor behaviors resembling those of real markets emerge, reflecting the ro…
The dynamics of minority games with agents trading on different time scales is studied via dynamical mean-field theory. We analyze the case where the agents' decision-making process is deterministic and its stochastic generalization with finite heterogeneous learning rates. In each case, we characterize the macroscopic…
Predicting labels of nodes in a network, such as community memberships or demographic variables, is an important problem with applications in social and biological networks. A recently-discovered phase transition puts fundamental limits on the accuracy of these predictions if we have access only to the network topology…
Cohen et al. (2021) show GD trajectories align on a bifurcation diagram.
Study neural networks learning from noisy examples via reverberation.
We consider a random sparse graph with bounded average degree, in which a subset of vertices has higher connectivity than the background. In particular, the average degree inside this subset of vertices is larger than outside (but still bounded). Given a realization of such graph, we aim at identifying the hidden subse…
We translate the problem of calculating the entropy of a set of binary configurations/signals into a sequence of supervised classification tasks. Subsequently, one can use virtually any machine learning classification algorithm for computing entropy. This procedure can be used to compute entropy, and consequently the f…
An elementary family of local Hamiltonians , is described for a dimensional quantum mechanical system of spin particles. On the torus, the ground state space is extensively degenerate but should collapse under perturbation" to an anyonic syste…
We investigate the "compass rose" (Crack, T.F. and Ledoit, O. (1996), Journal of Finance, 51(2), pg. 751-762) patterns revealed in phase portraits (delay plots) of stock returns. The structures observed in these diagrams have been attributed mainly to price clustering and discreteness. Using wavelet based denoising, we…
Analyzes bias-variance in overparameterized linear models using random features.
High-dimensional SGD limits show surprising dynamics and phase transitions.
We study the dynamics of a version of the batch minority game, with random external information and with different types of inhomogeneous decision noise (additive and multiplicative), using generating functional techniques à la De Dominicis. The control parameters in this model are the ratio of the number o…
The paper refines transformations of lattice diagrams and introduces dotted diagrams.
Recently, Hopfield and Krotov introduced the concept of {\em dense associative memories} [DAM] (close to spin-glasses with -wise interactions in a disordered statistical mechanical jargon): they proved a number of remarkable features these networks share and suggested their use to (partially) explain the success of …