A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Study explains Zipf's law using geometric mechanisms from a finite alphabet.
An Atlas model is a rank-based system of continuous semimartingales for which the steady-state values of the processes follow a power law, or Pareto distribution. For a power law, the log-log plot of these steady-state values versus rank is a straight line. Zipf's law is a power law for which the slope of this line is …
We summarize a book under publication with his title written by the three present authors, on the theory of Zipf's law, and more generally of power laws, driven by the mechanism of proportional growth. The preprint is available upon request from the authors. For clarity, consistence of language and conciseness, we disc…
Zipf's law states that the number of firms with size greater than S is inversely proportional to S. Most explanations start with Gibrat's rule of proportional growth but require additional constraints. We show that Gibrat's rule, at all firm levels, yields Zipf's law under a balance condition between the effective grow…
We suggest an analytical approach for Pareto-Zipf law, where we assume random multiplicative noise and fragmentation processes for the growth of the number of citizens of each city and the number of the cities, respectively.
Using an exhaustive list of Japanese bankruptcy in 1997, we discover a Zipf law for the distribution of total liabilities of bankrupted firms in high debt range. The life-time of these bankrupted firms has exponential distribution in correlation with entry rate of new firms. We also show that the debt and size are high…
We statistically investigate the distribution of share price and the distributions of three common financial indicators using data from approximately 8,000 companies publicly listed worldwide for the period 2004-2013. We find that the distribution of share price follows Zipf's law; that is, it can be approximated by a …
We have applied the Zipf method to extract the exponent for seven financial indices (DAX, FTSE; DJIA, NASDAQ, S&P500; Hang-Seng and Nikkei 225), after having translated the signals into a text based on two letters. We follow considerations based on the signal Hurst exponent and the notion of a time dependent Zipf …
We study a resource utilization scenario characterized by intrinsic fitness. To describe the growth and organization of different cities, we consider a model for resource utilization where many restaurants compete, as in a game, to attract customers using an iterative learning process. Results for the case of restauran…
New mechanism found for power laws including Zipf's law.
By employing exhaustive lists of large firms in European countries, we show that the upper-tail of the distribution of firm size can be fitted with a power-law (Pareto-Zipf law), and that in this region the growth rate of each firm is independent of the firm's size (Gibrat's law of proportionate effect). We also find t…
We consider a simple model of firm/city/etc. growth based on a multi-item criterion: whenever entity B fares better that entity A on a subset of items out of , the agent originally in A moves to B. We solve the model analytically in the cases and . The resulting stationary distribution of siz…
The paper revisits the investment simulation based on strategies exhibited by Generalized (m,2)-Zipf law to present an interesting characterization of the wildness in financial time series. The investigations of dominant strategies on each specific time series shows that longer words dominant in larger time scale exhib…
Generalized Lotka-Volterra (GLV) models extending the (70 year old) logistic equation to stochastic systems consisting of a multitude of competing auto-catalytic components lead to power distribution laws of the (100 year old) Pareto-Zipf type. In particular, when applied to economic systems, GLV leads to power laws in…
A simple text model shows word lengths follow Zipf's law.
This paper investigates the rank distribution, cumulative probability, and probability density of price returns for the stocks traded in the KSE and the KOSDAQ market. This research demonstrates that the rank distribution is consistent approximately with the Zipf's law with exponent (KSE) and -1.31 (KOSDAQ),…
We apply the Zipf power law to financial time series of WIG20 index daily changes (open-close). Thanks to the mapping of time series signal into the sequence of 2k+1 'spin-like' states, where k=0, 1/2, 1, 3/2, ..., we are able to describe any time series increments, with almost arbitrary accuracy, as the one of such 's…
Analyzes how BPE tokenisation affects corpus statistics and model entropy in transformer models.
PCA whitening weighted by Zipfian word frequencies improves task performance.
A theory of exceptional extreme events, characterized by their abnormal sizes compared with the rest of the distribution, is presented. Such outliers, called "dragon-kings", have been reported in the distribution of financial drawdowns, city-size distributions (e.g., Paris in France and London in the UK), in material f…
We study the rank distribution, the cumulative probability, and the probability density of returns of stock prices of listed firms traded in four stock markets. We find that the rank distribution and the cumulative probability of stock prices traded in are consistent approximately with the Zipf's law or a power law. It…
Pareto distributions, and power laws in general, have demonstrated to be very useful models to describe very different phenomena, from physics to finance. In recent years, the econophysical literature has proposed a large amount of papers and models justifying the presence of power laws in economic data. Most of the ti…
For the first time ever, we analyze a unique public procurement database, which includes information about a number of bidders for a contract, a final price, an identification of a winner and an identification of a contracting authority for each of more than 40,000 public procurements in the Czech Republic between 2006…
The paper applies communication theory to improve language model reranking.
We show power-scaling behaviors for fluctuations in share volume, which no other studies have so far done. After analyzing a database of the daily transactions for all securities listed on the Tokyo Stock Exchange, we selected 1050 large companies that each had an unbroken series of daily trading activity from January …
We introduce a mean-field type approximation for description of company's income statistics. Utilizing huge company data we show that a discrete version of Langevin equation with additive and multiplicative noises can appropriately describe the time evolution of a company's income fluctuation in statistical sense. The …
In this paper, we quantitatively investigate the statistical properties of a statistical ensemble of stock prices. We selected 1200 stocks traded on the Tokyo Stock Exchange, and formed a statistical ensemble of daily stock prices for each trading day in the 3-year period from January 4, 1999 to December 28, 2001, corr…
Many studies in Economics and other disciplines have been reporting distributions following power-law behavior (i.e distributions of incomes (Pareto's law), city sizes (Zipf's law), frequencies of words in long sequences of text etc.)[1, 6, 7]. This widespread observed regularity has been explained in many ways: genera…
The relevance of data quantifies learning efficiency.
Following the work of Okuyama, Takayasu and Takayasu [Okuyama, Takayasu and Takayasu 1999] we analyze huge databases of Japanese companies' financial figures and confirm that the Zipf's law, a power law distribution with the exponent -1, has been maintained over 30 years in the income distribution of Japanese companies…
We present a preferential attachment growth model to obtain the distribution of number of units in the classes which may represent business firms or other socio-economic entities. We found that is described in its central part by a power law with an exponent which depends on the probabil…
We analyze the size dependence and temporal stability of firm bankruptcy risk in the US economy by applying Zipf scaling techniques. We focus on a single risk factor-the debt-to-asset ratio R-in order to study the stability of the Zipf distribution of R over time. We find that the Zipf exponent increases during market …
The paper analyzes how repeating epochs affects data scaling in linear regression.
By analyzing a large data set of daily returns with data clustering technique, we identify economic sectors as clusters of assets with a similar economic dynamics. The sector size distribution follows Zipf's law. Secondly, we find that patterns of daily market-wide economic activity cluster into classes that can be ide…
A so called Zipf analysis portofolio management technique is introduced in order to comprehend the risk and returns. Two portofoios are built each from a well known financial index. The portofolio management is based on two approaches: one called the "equally weighted portofolio", the other the "confidence parametrized…
We present an extension of the Johansen-Ledoit-Sornette (JLS) model to include an additional pricing factor called the "Zipf factor", which describes the diversification risk of the stock market portfolio. Keeping all the dynamical characteristics of a bubble described in the JLS model, the new model provides additiona…
We consider a natural model of random knotting- choose a knot diagram at random from the finite set of diagrams with n crossings. We tabulate diagrams with 10 and fewer crossings and classify the diagrams by knot type, allowing us to compute exact probabilities for knots in this model. As expected, most diagrams with 1…
Statistical mechanics explains income and wealth distribution in developed economies.
Exact asymptotic solutions found for nonlinear Hawkes processes.
Herein, we applied statistical physics to study incomes of three (low-, medium- and high-income) society classes instead of the two (low- and medium-income)classes studied so far. In the frame of the threshold nonlinear Langevin dynamics and its threshold Fokker-Planck counterpart, we derived a unified formula for desc…
Financial markets provide an ideal frame for studying decision making in crowded environments. Both the amount and accuracy of the data allows to apply tools and concepts coming from physics that studies collective and emergent phenomena or self-organised and highly heterogeneous systems. We analyse the activity of 29,…
The distribution of firms' growth and firms' sizes is a topic under intense scrutiny. In this paper we show that a thermodynamic model based on the Maximum Entropy Principle, with dynamical prior information, can be constructed that adequately describes the dynamics and distribution of firms' growth. Our theoretical fr…
In this paper we derive the maximum entropy characteristics of a particular rank order distribution, namely the discrete generalized beta distribution, which has recently been observed to be extremely useful in modelling many several rank-size distributions from different context in Arts and Sciences, as a two-paramete…
A time series that represents daily values of the WIG index (the main index of Warsaw Stock Exchange) over last 5 years is examined. Non-Gaussian features of distributions of fluctuations, namely returns, over a time scale are considered. Some general properties like exponents of the long range correlation estimated by…
By using methods of statistical physics, we focus on the quantitative analysis of the economic income data descending from different databases. To explain our approach, we introduce the necessary theoretical background, the extended Yakovenko et al. (EY) model. This model gives an analytical description of the annual h…
Paper accelerates K-means clustering for large sparse document data.
This paper presents a statistical analysis of Tehran Price Index (TePIx) for the period of 1992 to 2004. The results present asymmetric property of the return distribution which tends to the right hand of the mean. Also the return distribution can be fitted by a stable Levy distribution and the tails are very fatter th…
This work explains scaling laws as redundancy laws in deep learning.