Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

306090120 · Jun 202019922001200920172026
48 results for long-range memory

Research on long-range memory in financial and social systems using various models.

problem Understanding the nature of long-range memory in socioeconomic systems.
method Various Markov processes including point processes, stochastic differential equations, and agent-based models.
result New estimators of self-similarity and long-range memory for non-Gaussian systems are needed.

A new method uses burst and inter-burst duration to test long-range memory in financial markets.

problem Varying results from long-range memory estimators in financial markets.
method Burst and inter-burst duration statistical analysis of limit order book data.
result The new method provides a more reliable evaluation of the Hurst exponent.

Transformers can perform well with less long-range memory.

problem The need for deep long-range memory in Transformers for language modeling.
method Performed interventions to show performance can be achieved with fewer long-range memories and by limiting attention range.
result Comparable performance can be achieved with 6X fewer long-range memories and better performance with limited attention range.

Earlier we proposed the stochastic point process model, which reproduces a variety of self-affine time series exhibiting power spectral density S(f) scaling as power of the frequency f and derived a stochastic differential equation with the same long range memory properties. Here we present a stochastic differential eq…

2006-06-14abs ↗pdf ↗

Representation and learning of long-range dependencies is a central challenge confronted in modern applications of machine learning to sequence data. Yet despite the prominence of this issue, the basic problem of measuring long-range dependence, either in a given data source or as represented in a trained deep model, r…

2019-04-08abs ↗pdf ↗

Analyzed a generalized voter model with power-law herding intensity, revealing anomalous diffusion and long-range memory.

problem Anomalous diffusion and long-range memory in a generalized voter model.
method Derived analytical expressions for moments and first passage time distribution, confirmed numerically.
result The model exhibits long-range memory indicators despite being a Markov model.

We present the Compressive Transformer, an attentive sequence model which compresses past memories for long-range sequence learning. We find the Compressive Transformer obtains state-of-the-art language modelling results in the WikiText-103 and Enwik8 benchmarks, achieving 17.1 ppl and 0.97 bpc respectively. We also fi…

2019-11-13abs ↗pdf ↗

Study on price fluctuations in NFT market, showing heavy-tailed distributions and long-range memory.

problem Characterizing price fluctuations in NFT market.
method Analysis of capitalization, floor price, transactions, inter-transaction times, and volume value of NFTs.
result NFT market exhibits heavy-tailed probability distribution functions, well described by stretched exponentials, with long-range memory.

Long-range correlation and fluctuation in the gold market time series of world's two leading gold consuming countries, namely China and India, are studied. For both the market series during the period 1985-2013 we observe a long-range persistence of memory in the sequences of maxima (minima) of returns in successive ti…

2015-05-17abs ↗pdf ↗

NeuroMemFPP uses LSTM to estimate FPP parameters with high accuracy.

problem Estimating parameters of fractional Poisson process with memory and long-range dependence.
method Recurrent Neural Network (RNN), specifically Long Short-Term Memory (LSTM), for parameter estimation.
result The LSTM-based approach reduces MSE by about 55.3% compared to traditional MOM method.

Using a relationship between the moments of the probability distribution of times between the two consecutive trades (intertrade time distribution) and the moments of the distribution of a daily number of trades we show, that the underlying point process generating times of the trades is an essentially non-markovian lo…

2004-03-18abs ↗pdf ↗

We present a nonlinear stochastic differential equation (SDE) which mimics the probability density function (PDF) of the return and the power spectrum of the absolute return in financial markets. Absolute return as a measure of market volatility is considered in the proposed model as a long-range memory stochastic vari…

2009-01-07abs ↗pdf ↗

Deep neural networks estimate long memory parameters efficiently.

problem Estimating long memory parameters in stochastic processes.
method Scale-invariant 1D Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) models trained with synthetic data.
result Neural models outperform conventional methods in precision, speed, consistency, and robustness.

In this work, we propose an order book model with herd behavior. The proposed model is built upon two distinct approaches: a recent empirical study of the detailed order book records by Kanazawa et al. [Phys. Rev. Lett. 120, 138301] and financial herd behavior model. Combining these approaches allows us to propose a mo…

2018-09-08abs ↗pdf ↗

Study finds long memory in some emerging Asian stocks but not in developed markets.

problem Evaluating stock market efficiency in emerging vs developed markets.
method Improved wavelet estimator of long range dependence.
result Emerging Asian markets show more long memory in stock returns than developed markets.

New method combines long-memory reservoirs for accurate dengue forecasting from short data.

problem Accurate dengue forecasting from short, noisy, non-stationary, and nonlinear data.
method Fractional ESN and Wavelet ESN frameworks integrating long-term memory.
result fESN and wESN outperform baselines in multiple dengue datasets and forecasting horizons.

Study finds long-range dependence in financial markets, but deep generative models struggle to replicate it.

problem Long-range dependence in financial markets and challenges of deep generative models.
method Empirical analysis of financial data from three sectors, including LRD through various statistical methods and deep learning models.
result Deep generative models can reproduce stylized features but fail to capture long-range dependence structures.

We introduce a new test for detection of power-law cross-correlations among a pair of time series - the rescaled covariance test. The test is based on a power-law divergence of the covariance of the partial sums of the long-range cross-correlated processes. Utilizing a heteroskedasticity and auto-correlation robust est…

2013-07-17abs ↗pdf ↗

For the London Stock Exchange we demonstrate that the signs of orders obey a long-memory process. The autocorrelation function decays roughly as τατ^{-α} with α0.6α\approx 0.6, corresponding to a Hurst exponent H0.7H \approx 0.7. This implies that the signs of future orders are quite predictable from the signs of past orde…

2003-11-04abs ↗pdf ↗

New model captures long-range patterns in sequences efficiently.

problem Efficiently capturing long-range patterns in sequential data.
method Inspired by wavelet multiresolution analysis, introduces MultiresLayer with multiresolution convolution.
result State-of-the-art performance on sequence classification and autoregressive density estimation tasks.

Develops a bi-variate stochastic framework to model mortality and interest rates with long-range dependence.

problem Captures long-range dependence and instantaneous correlation in mortality and interest rates.
method Mixed fractional Brownian motions, analytical solutions, risk-neutral measure, sequential parameter estimation.
result Explicit pricing of zero-coupon bonds and extreme mortality bonds, practical implications for pricing and risk management.

The distribution of recurrence times or return intervals between extreme events is important to characterize and understand the behavior of physical systems and phenomena in many disciplines. It is well known that many physical processes in nature and society display long range correlations. Hence, in the last few year…

2008-03-12abs ↗pdf ↗

Study pricing derivatives in markets with long-range dependence and jumps.

problem Deriving pricing formulas for derivatives in markets with long-range dependence and jumps.
method Developed a fractional integro-partial differential equation (PIDE) and used semigroup theory and finite-difference schemes for numerical solutions.
result Closed-form pricing formula for European options and numerical solution for general options.

Rough Transformers improve efficiency for medical time-series data.

problem Efficiently modeling irregularly sampled, long-range time-series data.
method Introducing Rough Transformers, a Transformer variant with continuous-time representations and multi-view signature attention.
result Rough Transformers outperform vanilla Transformers while using less computational resources.

The aim of this paper is to present a simple stochastic model that accounts for the effects of a long-memory in volatility on option pricing. The starting point is the stochastic Black-Scholes equation involving volatility with long-range dependence. We consider the option price as a sum of classical Black-Scholes pric…

2004-03-31abs ↗pdf ↗

FPG uses fractional calculus for efficient reinforcement learning with long-term memory.

problem High variance and inefficient sampling in standard policy gradient methods for long-term temporal modeling.
method Fractional Policy Gradients (FPG) incorporating Caputo fractional derivatives for power-law temporal correlations.
result Achieves asymptotic variance reduction of order O(t^(-alpha)) and sample efficiency gains.

We study compositional generalization, viz., the problem of zero-shot generalization to novel compositions of concepts in a domain. Standard neural networks fail to a large extent on compositional learning. We propose Tree Stack Memory Units (Tree-SMU) to enable strong compositional generalization. Tree-SMU is a recurs…

2019-11-05abs ↗pdf ↗

NeuroMem-FHP framework estimates FHP parameters efficiently.

problem Estimating parameters of fractional Hawkes process (FHP) with long-range dependence.
method Developed LSTM and Transformer neural architectures to estimate FHP parameters directly from inter-arrival times.
result Transformer achieves highest estimation accuracy (MSE = 0.1634) compared to classical MLE (MSE = 2.8032).

New model captures long-term memory effects in epidemic dynamics.

problem Identifying memory effects in disease progression and recovery.
method Physics-informed neural networks (PINN) with fractional SEIRD model.
result Fractional memory order αα improves predictive performance over classical models.

Neural ARFIMA model improves exchange rate forecasting for BRIC economies.

problem Forecasting exchange rates for emerging markets with long-term memory and nonlinear dynamics.
method Integrates ARFIMA for long-memory with neural networks for nonlinear approximation.
result NARFIMA model outperforms benchmarks in BRIC exchange rate forecasting.

A novel online GP model captures long-term memory in sequential data.

problem Capturing long-term memory in sequential data online.
method Integrates HiPPO framework into interdomain GP, leveraging time-varying orthogonal projections as inducing variables.
result OHSVGP outperforms existing online GP methods in predictive performance, long-term memory preservation, and computational efficiency.

FDBM models use fractional Brownian motion to model complex stochastic processes.

problem Capturing memory effects and long-range dependencies in stochastic processes.
method Developed a generative diffusion bridge framework using a Markovian approximation of fractional Brownian motion.
result FDBM outperforms standard models in predicting future states and unpaired data translation.

Hydra boosts efficiency for long-context reasoning in resource-constrained settings.

problem Quadratic complexity of transformers limits long-context reasoning in resource-constrained systems.
method Hydra uses a modular architecture with adaptive routing between sparse global attention, mixture-of-experts, and dual memories.
result Hydra achieves significant throughput and accuracy improvements for long-context reasoning.