Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

57114171228 · May 202619922001200920172026
48 results for power law decay

SignSGD outperforms SGD in linear regression with optimal scaling laws under PLRF model.

problem Improving linear regression performance with signSGD under power-law random features.
method Analysis of signSGD risk under PLRF model, comparison with SGD, identification of unique effects.
result SignSGD can have a steeper compute-optimal slope than SGD in noisy regimes, especially with WSD schedule.

The paper presents a multi-power law for predicting loss curves across different learning rate schedules.

problem Understanding and optimizing the relationship between model performance and hyperparameters, especially learning rates.
method Proposes a multi-power law that combines power laws based on the sum of learning rates and additional laws for loss reduction due to decay.
result The multi-power law accurately predicts loss curves for unseen learning rate schedules and finds a schedule that outperforms cosine learning rate.

We discover scaling laws for kernel regression loss under various learning rate schedules.

problem Understanding loss dynamics and learning rate schedules in kernel regression.
method Theoretical analysis of stochastic gradient descent on a power-law kernel regression model.
result Established a Functional Scaling Law (FSL) capturing the full loss trajectory under arbitrary learning rate schedules.

The persistence phenomenon is studied in the Japanese financial market by using a novel mapping of the time evolution of the values of shares quoted on the Nikkei Index onto Ising spins. The method is applied to historical end of day data from the Japanese stock market during 2002. By studying the time dependence of th…

2008-03-04abs ↗pdf ↗

Power-law spectrum of random feature model is preserved in neural networks.

problem Preserving power-law spectrum in neural networks through random feature model.
method Characterized eigenvalues of population random-feature covariance using dyadic head-tail decomposition and Wick chaos expansions.
result Power-law exponent αα is inherited from input covariance, modified by a logarithmic correction.

We explain theoretically a curious empirical phenomenon: "Approximating a matrix by deterministically selecting a subset of its columns with the corresponding largest leverage scores results in a good low-rank matrix surrogate". To obtain provable guarantees, previous work requires randomized sampling of the columns wi…

2014-04-06abs ↗pdf ↗

Stochastic block models (SBMs) have been playing an important role in modeling clusters or community structures of network data. But, it is incapable of handling several complex features ubiquitously exhibited in real-world networks, one of which is the power-law degree characteristic. To this end, we propose a new var…

2019-04-05abs ↗pdf ↗

Estimates self- and cross-impact concavity and decay patterns in financial markets.

problem Understanding the impact of financial transactions on market dynamics.
method Nonparametric estimation of concave multi-asset propagator models using metaorders and order flow data.
result Concave self-impact with shifted power-law decay, significant gain from cross-impact, and improved predictive accuracy.

In this paper, we describe a newly discovered statistical property of time series data for daily price changes. We conducted quantitative investigation of the {\it calm-time intervals} of price changes for 800 companies listed in the Tokyo Stock Exchange, and for the Nikkei 225 index over a 27-year period from January …

2003-12-21abs ↗pdf ↗

Optimal learning rates decay to zero in easy tasks and maintain a warmup phase in hard tasks.

problem Optimizing learning rates under functional scaling laws for model training.
method Deriving optimal learning-rate schedules based on exponents ss and ββ.
result Sharp phase transition between easy and hard tasks, with different decay behaviors.

The study uses the Merton model to estimate PD and finds a phase transition affecting convergence speed.

problem Estimating the probability of default (PD) using limited historical data.
method Adopted the Merton model and analyzed phase transitions in default correlation.
result PD estimation converges slowly when temporal correlation decays by power law less than one.

Study classifies stock price jumps as exogenous or endogenous using news data.

problem Differentiating between exogenous and endogenous price jumps.
method Synchronized news data with order book data to analyze stock price movements.
result Exogenous jumps are abrupt and follow a decaying power-law, while endogenous jumps are progressively accelerating.

We analyze a database comprising quarterly sales of 55624 pharmaceutical products commercialized by 3939 pharmaceutical firms in the period 1992--2001. We study the probability density function (PDF) of growth in firms and product sales and find that the width of the PDF of growth decays with the sales as a power law w…

2005-02-15abs ↗pdf ↗

We respond to the issues discussed by Farmer and Lillo (FL) related to our proposed approach to understanding the origin of power-law distributions in stock price fluctuations. First, we extend our previous analysis to 1000 US stocks and perform a new estimation of market impact that accounts for splitting of large ord…

2004-03-02abs ↗pdf ↗

Study shows how anisotropic data affects learning dynamics in phase retrieval.

problem Understanding learning dynamics in phase retrieval with anisotropic Gaussian inputs.
method Developed a tractable reduction to reveal a three-phase trajectory and derived scaling laws.
result Found that anisotropy leads to a three-phase trajectory: fast escape, slow convergence, and spectral-tail learning.

A hierarchical model shows how scaling laws emerge from sequential feature recovery.

problem Emergence of scaling laws from feature learning in multi-layer networks.
method Layer-wise spectral algorithm adapted to compositional structure, sequential feature detection.
result Sequential detection of latent features, leading to explicit power-law decay of prediction error.

We compare systematically several classes of stochastic volatility models of stock market fluctuations. We show that the long-time return distribution is either Gaussian or develops a power-law tail, while the short-time return distribution has generically a stretched-exponential form, but can assume also an algebraic …

2010-09-14abs ↗pdf ↗

We show power-scaling behaviors for fluctuations in share volume, which no other studies have so far done. After analyzing a database of the daily transactions for all securities listed on the Tokyo Stock Exchange, we selected 1050 large companies that each had an unbroken series of daily trading activity from January …

2003-02-24abs ↗pdf ↗

We model the arrival of mid-price changes in the E-Mini S&P futures contract as a self-exciting Hawkes process. Using several estimation methods, we find that the Hawkes kernel is power-law with a decay exponent close to -1.15 at short times, less than approximately 10^3 seconds, and crosses over to a second power-law …

2013-02-06abs ↗pdf ↗

The bitcoin price has surged in recent years and it has also exhibited phases of rapid decay. In this paper we address the question to what extent this novel cryptocurrency market can be viewed as a classic or semi-efficient market. Novel and robust tools for estimation of multi-fractal properties are used to show that…

2018-09-22abs ↗pdf ↗

Second part of series studying charged scalar fields on Reissner--Nordström spacetimes.

problem Analyzing late-time behavior and stability of charged scalar fields on black hole backgrounds.
method Purely physical-space based methods, energy estimates, inverse-power laws.
result First pointwise decay estimates for charged scalar fields on black hole backgrounds.

This article provides a novel framework to evaluate limit order tactics that highlights expected fill price, adverse price selection cost, and opportunity cost. We formulate the problem of optimal execution of market orders with nonlinear market impact, power law decay kernel, and stochastic and deterministic liquidity…

2014-09-04abs ↗pdf ↗

We study the statistical properties of volatility---a measure of how much the market is likely to fluctuate. We estimate the volatility by the local average of the absolute price changes. We analyze (a) the S&P 500 stock index for the 13-year period Jan 1984 to Dec 1996 and (b) the market capitalizations of the largest…

1999-03-24abs ↗pdf ↗

Financial time series typically exhibit strong fluctuations that cannot be described by a Gaussian distribution. In recent empirical studies of stock market indices it was examined whether the distribution P(r) of returns r(tau) after some time tau can be described by a (truncated) Levy-stable distribution L_{alpha}(r)…

2002-08-26abs ↗pdf ↗

Detection of power-law behavior and studies of scaling exponents uncover the characteristics of complexity in many real world phenomena. The complexity of financial markets has always presented challenging issues and provided interesting findings, such as the inverse cubic law in the tails of stock price fluctuation di…

2018-03-22abs ↗pdf ↗

The three-state agent-based 2D model of financial markets as proposed by Giulia Iori has been extended by introducing increasing trust in the correctly predicting agents, a more realistic consultation procedure as well as a formal validation mechanism. This paper shows that such a model correctly reproduces the three f…

2013-10-02abs ↗pdf ↗

Gradient descent outperforms ridge regression under certain covariance matrix decay conditions.

problem Comparing the performance of gradient descent and ridge regression in linear models.
method Investigated gradient descent and ridge regression for linear regression with random isotropic ground truth.
result Gradient descent outperforms ridge regression under specific covariance matrix decay conditions.

Analyzed Bitcoin market index volatility changes over two distinct periods using anomalous diffusion and multifractal analysis.

problem Characterizing volatility changes in Bitcoin market index over two distinct periods.
method Analyzed high-frequency Bitcoin data from 2019 to 2022, using anomalous diffusion and multifractal analysis.
result Volatility changes from subdiffusion to weak superdiffusion over time, with multifractal and self-similar properties.

Bayesian inference and superstatistics model financial volatility dynamics across different timescales.

problem Modeling correlated volatility in financial time series with heavy tails and long memory.
method Superstatistical dynamics, Bayesian Inference, Metropolis-Hasting sampling.
result The log-Normal model is reliable for short timescales, while inverse-Gamma is preferred for long timescales.

In this study we examine the evolution of price, volume, and the bid-ask spread after extreme 15 minute intraday price changes on the NYSE and the NASDAQ. We find that due to strong behavioral trading there is an overreaction. Furthermore we find that volatility which increases sharply at the event decays according to …

2004-01-06abs ↗pdf ↗

Recent empirical studies have demonstrated long-memory in the signs of orders to buy or sell in financial markets [2, 19]. We show how this can be caused by delays in market clearing. Under the common practice of order splitting, large orders are broken up into pieces and executed incrementally. If the size of such lar…

2004-12-27abs ↗pdf ↗

We discuss the distribution of commuting distances and its relation to income. Using data from Denmark, the UK, and the US, we show that the commuting distance is (i) broadly distributed with a slow decaying tail that can be fitted by a power law with exponent γ3γ\approx 3 and (ii) an average growing slowly as a power …

2016-02-04abs ↗pdf ↗

Study on SGD dynamics and scaling laws for training quadratic neural networks in high dimensions.

problem Optimizing and understanding the training dynamics of quadratic neural networks in high-dimensional settings.
method Sharp analysis of SGD dynamics, combining matrix Riccati differential equations and matrix monotonicity arguments.
result Derivation of scaling laws for prediction risk, highlighting power-law dependencies on optimization time, sample size, and model width.