Field theory explains optimal scaling in ResNets for signal propagation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A neural network model predicts the critical point of the Ising phase transition.
We consider the roughness properties of NYSE (New York Stock Exchange) stock-price fluctuations. The statistical properties of the data are relatively homogeneous within the same day but the large jumps between different days prevent the extension of the analysis to large times. This leads to intrinsic finite size effe…
A bridge between continuous signals and discrete Ising spins for associative memory.
The Normalized Mutual Information (NMI) has been widely used to evaluate the accuracy of community detection algorithms. However in this article we show that the NMI is seriously affected by systematic errors due to finite size of networks, and may give a wrong estimate of performance of algorithms in some cases. We gi…
The Levy-Levy-Solomon model (A microscopic model of the stock market: cycles, booms, and crashes, Economic Letters 45 (1))is one of the most influential agent-based economic market models. In several publications this model has been discussed and analyzed. Especially Lux and Zschischang (Some new results on the Levy, L…
We present a detailed analysis of the self-organization phenomenon in which the stylized facts originate from finite size effects with respect to the number of agents considered and disappear in the limit of an infinite population. By introducing the possibility that agents can enter or leave the market depending on th…
Using a model of wealth distribution where traders are characterized by quenched random saving propensities and trade among themselves by bipartite transactions, we mimic the enhanced rates of trading of the rich by introducing the preferential selection rule using a pair of continuously tunable parameters. The biparti…
A probabilistic framework is introduced that represents stylized banking networks and aims to predict the size of contagion events. In contrast to previous work on random financial networks, which assumes independent connections between banks, the possibility of disassortative edge probabilities (an above average tende…
We study the finite-size effects in some scaling systems, and show that the finite number of agents N leads to a cut-off in the upper value of the Pareto law for the relative individual wealth. The exponent of the Pareto law obtained in stochastic multiplicative market models is crucially affected by the fact that …
VNA solves large portfolio optimization problems efficiently.
Many financial variables are found to exhibit multifractal nature, which is usually attributed to the influence of temporal correlations and fat-tailedness in the probability distribution (PDF). Based on the partition function approach of multifractal analysis, we show that there is a marked finite-size effect in the d…
Topic models have achieved significant successes in analyzing large-scale text corpus. In practical applications, we are always confronted with the challenge of model selection, i.e., how to appropriately set the number of topics. Following recent advances in topic model inference via tensor decomposition, we make a fi…
A hierarchical model shows how scaling laws emerge from sequential feature recovery.
The rich-get-richer mechanism (agents increase their ``wealth'' randomly at a rate proportional to their holdings) is often invoked to explain the Pareto power-law distribution observed in many physical situations, such as the degree distribution of growing scale free nets. We use two different analytical approaches, a…
Residual networks with depthwise hyperparameter scaling transfer optimal hyperparameters across width and depth.
Study of 3d-3d correspondence involving -Weyl algebra and 3d-index.
Deep neural networks near edge of chaos show universal scaling laws.
There has been a recent surge of interest in modeling neural networks (NNs) as Gaussian processes. In the limit of a NN of infinite width the NN becomes equivalent to a Gaussian process. Here we demonstrate that for an ensemble of large, finite, fully connected networks with a single hidden layer the distribution of ou…
We derive finite width and depth corrections for the Neural Tangent Kernel (NTK) of ResNets and DenseNets. Our analysis reveals that finite size residual architectures are initialized much closer to the "kernel regime" than their vanilla counterparts: while in networks that do not use skip connections, convergence to t…
We address the question of market efficiency using the Minority Game (MG) model. First we show that removing unrealistic features of the MG leads to models which reproduce a scaling behavior close to what is observed in real markets. In particular we find that i) fat tails and clustered volatility arise at the phase tr…
Unified thermodynamic approach to Transformer attention dynamics.
We introduce a minimal Agent Based Model with two classes of agents, fundamentalists (stabilizing) and chartists (destabilizing) and we focus on the essential features which can generate the stylized facts. This leads to a detailed understanding of the origin of fat tails and volatility clustering and we propose a mech…
We prove (without using Federer's structure theorem) that a finite-mass flat chain over any coefficient group is rectifiable if and only if almost all of its 0-dimensional slices are rectifiable. This implies that every flat chain of finite mass and finite size is rectifiable. It also leads to a simple necessary and su…
The distribution of the return intervals between volatilities above a threshold for financial records has been approximated by a scaling behavior. To explore how accurate is the scaling and therefore understand the underlined non-linear mechanism, we investigate intraday datasets of 500 stocks which consist of …
New Transformer architecture prevents rank degeneracy in deep attention models.
A new sampler tackles critical phenomena by leveraging scale invariance.
Within the framework of maximum entropy principle we show that the finite-size long-range Ising model is the adequate model for the description of homogeneous credit portfolios and the computation of credit risk when default correlations between the borrowers are included. The exact analysis of the model suggest that w…
Learning three data points can generate all types of periodic orbits in a neural network.
We introduce a probabilistic framework that represents stylized banking networks with the aim of predicting the size of contagion events. Most previous work on random financial networks assumes independent connections between banks, whereas our framework explicitly allows for (dis)assortative edge probabilities (e.g., …
Estimates KRR risk from training data for various kernels and hyperparameters.
Graphs avoid oversmoothing with properly initialized weights.
Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even a few tens of full-order model runs are impracticable. While dimensionality redu…
We introduce a minimal Agent Based Model for financial markets to understand the nature and Self-Organization of the Stylized Facts. The model is minimal in the sense that we try to identify the essential ingredients to reproduce the main most important deviations of price time series from a Random Walk behavior. We fo…
We discuss a simple model based on the Minority Game which reproduces the main stylized facts of anomalous fluctuations in finance. We present the analytic solution of the model in the thermodynamic limit and show that stylized facts arise only close to a line of critical points with non-trivial properties. By a simple…
Mean field theory has been successfully used to analyze deep neural networks (DNN) in the infinite size limit. Given the finite size of realistic DNN, we utilize the large deviation theory and path integral analysis to study the deviation of functions represented by DNN from their typical mean field solutions. The para…
We introduce uniform K-stability and its relationship with the coercivity property of the K-energy functional, for general polarized manifolds. Since the automorphism groups are not necessarily finite, size of the norm measuring uniformity should be reduced with respect to the group action. About this point we explain …
The study reveals a transition in neural network performance from infinite-width to variance-limited behavior as dataset size increases.
A novel correction algorithm is proposed for multi-class classification problems with corrupted training data. The algorithm is non-intrusive, in the sense that it post-processes a trained classification model by adding a correction procedure to the model prediction. The correction procedure can be coupled with any app…
We propose a general framework for solving statistical mechanics of systems with finite size. The approach extends the celebrated variational mean-field approaches using autoregressive neural networks, which support direct sampling and exact calculation of normalized probability of configurations. It computes variation…
New method uses quantum annealing and VAN for better statistical mechanics calculations.
We analyse time series of CDS spreads for a set of major US and European institutions on a pe- riod overlapping the recent financial crisis. We extend the existing methodology of ε-drawdowns to the one of joint ε-drawups, in order to estimate the conditional probabilities of abrupt co-movements among spreads. We correc…
New method reduces over-parametrization in neural networks, ensuring sparsity and finite network size.
Optimizes sample reweighting to match laws under covariate shift using Wasserstein distance.
In this work we study the quantitative relation between the recursive teaching dimension (RTD) and the VC dimension (VCD) of concept classes of finite sizes. The RTD of a concept class , introduced by Zilles et al. (2011), is a combinatorial complexity measure characterized by the worst…
We study high-dimensional Gaussian mixture classification using statistical physics methods.
There has been a lot of recent interest in trying to characterize the error surface of deep models. This stems from a long standing question. Given that deep networks are highly nonlinear systems optimized by local gradient methods, why do they not seem to be affected by bad local minima? It is widely believed that tra…
Estimates roughness of financial volatility paths using horizontal visibility graphs.