Empirical law predicts accuracy of Google Translate's translation chains.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We explore the possibility of using machine learning to identify interesting mathematical structures by using certain quantities that serve as fingerprints. In particular, we extract features from integer sequences using two empirical laws: Benford's law and Taylor's law and experiment with various classifiers to ident…
Power laws detected in financial data, modeled with random multipliers.
We study the relaxation dynamics of a financial market just after the occurrence of a crash by investigating the number of times the absolute value of an index return is exceeding a given threshold value. We show that the empirical observation of a power law evolution of the number of events exceeding the selected thre…
This paper reformulates systemic risk measures and finds new properties and estimators.
We have discovered 12 independent new empirical scaling laws in foreign exchange data-series that hold for close to three orders of magnitude and across 13 currency exchange rates. Our statistical analysis crucially depends on an event-based approach that measures the relationship between different types of events. The…
We show that an economic system populated by multiple agents generates an equilibrium distribution in the form of multiple scaling laws of conditional PDFs, which are sufficient for characterizing the probability distribution. The existence of the double scaling law is demonstrated empirically for the sales and the lab…
We study the growth dynamics of the size of manufacturing firms considering competition and normal distribution of competency. We start with the fact that all components of the system struggle with each other for growth as happened in real competitive bussiness world. The detailed quantitative agreement of the theory w…
We introduce a deterministic dealer model which implements most of the empirical laws, such as fat tails in the price change distributions, long term memory of volatility and non-Poissonian intervals. We also clarify the causality between microscopic dealers' dynamics and macroscopic market's empirical laws.
Employing profits data of Japanese companies in 2002 and 2003, we identify the non-Gibrat's law which holds in the middle profits region. From the law of detailed balance in all regions, Gibrat's law in the high region and the non-Gibrat's law in the middle region, we kinematically derive the profits distribution funct…
By employing exhaustive lists of large firms in European countries, we show that the upper-tail of the distribution of firm size can be fitted with a power-law (Pareto-Zipf law), and that in this region the growth rate of each firm is independent of the firm's size (Gibrat's law of proportionate effect). We also find t…
Law of iterated logarithm derived from betting strategy.
Law derived for neural networks with sparse connections.
Scaling laws in linear regression explain model performance improvements with size and data.
This paper tightens the law of the iterated logarithm for empirical KL_inf, applicable to unbounded data.
Data pruning algorithms struggle in high compression regimes, as shown by theoretical and empirical studies.
A new scaling law predicts optimal batch size for training models.
Study uncovers scaling laws and spectral properties of shallow neural networks.
We explain theoretically a curious empirical phenomenon: "Approximating a matrix by deterministically selecting a subset of its columns with the corresponding largest leverage scores results in a good low-rank matrix surrogate". To obtain provable guarantees, previous work requires randomized sampling of the columns wi…
This work explains scaling laws as redundancy laws in deep learning.
This paper presents a methodology for selecting the mini-batch size that minimizes Stochastic Gradient Descent (SGD) learning time for single and multiple learner problems. By decoupling algorithmic analysis issues from hardware and software implementation details, we reveal a robust empirical inverse law between mini-…
The study explains transformer scaling laws using statistical and approximation theories.
I consider the problem of the optimal limit order price of a financial asset in the framework of the maximization of the utility function of the investor. The analytical solution of the problem gives insight on the origin of the recently empirically observed power law distribution of limit order prices. In the framewor…
Study uses OT to simulate markets, revealing power-law returns are driven by informational effect.
A power-law fit to the empirical inference-compute frontier in LOB prediction suggests a scaling-law-style frontier.
Develops a simple model to understand learning curves for arbitrary power laws.
Based on empirical financial time-series, we show that the "silence-breaking" probability follows a super-universal power law: the probability of observing a large movement is inversely proportional to the length of the on-going low-variability period. Such a scaling law has been previously predicted theoretically [R. …
Empirical study finds IT project costs follow a power-law distribution, exposing risk underestimation.
We respond to the issues discussed by Farmer and Lillo (FL) related to our proposed approach to understanding the origin of power-law distributions in stock price fluctuations. First, we extend our previous analysis to 1000 US stocks and perform a new estimation of market impact that accounts for splitting of large ord…
We provide an empirical investigation aimed at uncovering the statistical properties of intricate stock trading networks based on the order flow data of a highly liquid stock (Shenzhen Development Bank) listed on Shenzhen Stock Exchange during the whole year of 2003. By reconstructing the limit order book, we can extra…
Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemen…
We analyze the European transition economies and show that time series for most of major indices exhibit (i) power-law correlations in their values, power-law correlations in their magnitudes, and (iii) asymmetric probability distribution. We propose a stochastic model that can generate time series with all the previou…
Study on RL on volatility surfaces, proving no free lunch for law-seeking methods.
We use data on wealth of the richest persons taken from the "rich lists" provided by business magazines like Forbes to verify if upper tails of wealth distributions follow, as often claimed, a power-law behaviour. The data sets used cover the world's richest persons over 1996-2012, the richest Americans over 1988-2012,…
The paper examines the short-time implied volatility of additive processes and finds key parameters.
This paper addresses the statistical properties of time series driven by rational bubbles a la Blanchard and Watson (1982), corresponding to multiplicative maps, whose study has recently be revived recently in physics as a mechanism of intermittent dynamics generating power law distributions. Using insights on the beha…
In this paper we present an analysis of power law statistics on land markets. There have been no other studies that have analyzed power law statistics on land markets up to now. We analyzed a database of the assessed value of land, which is officially monitored and made available to the public by the Ministry of Land, …
We develop a simple test for deviations from power law tails, which is based on the asymptotic properties of the empirical distribution function. We use this test to answer the question whether great natural disasters, financial crashes or electricity price spikes should be classified as dragon kings or 'only' as black…
We analyze waiting times for price changes in a foreign currency exchange rate. Recent empirical studies of high frequency financial data support that trades in financial markets do not follow a Poisson process and the waiting times between trades are not exponentially distributed. Here we show that our data is well ap…
Large models follow power laws in performance with dataset size or parameters.
New scaling laws explain deep learning performance growth.
The paper studies neural networks with wide layers and finds a deformed semicircle law.
LLMs learn peaked distributions slowly due to power-law losses.
We report empirical studies on the personal income distribution, and clarify that the distribution pattern of the lognormal with power law tail is the universal structure. We analyze the temporal change of Pareto index and Gibrat index to investigate the change of the inequality of the income distribution. In addition …
Analyzes how BPE tokenisation affects corpus statistics and model entropy in transformer models.
New method integrates real and synthetic data to improve machine learning models.
This work analyzes neural scaling laws using power-law data spectra and derives analytical expressions for generalization error.
It is now well established empirically that financial price changes are distributed according to a power law, with cubic exponent. This is a fascinating regularity, as it holds for various classes of securities, on various markets, and on various time scales. The universality of this law suggests that there must be som…