A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Model combines long-term and short-term memory using conceptors.
We study the long-term memory in diverse stock market indices and foreign exchange rates using the Detrended Fluctuation Analysis(DFA). For all daily and high-frequency market data studied, no significant long-term memory property is detected in the return series, while a strong long-term memory property is found in th…
Paper questions RNN and LSTM's long-term memory and introduces a new definition.
Current generation of memory-augmented neural networks has limited scalability as they cannot efficiently process data that are too large to fit in the external memory storage. One example of this is lifelong learning scenario where the model receives unlimited length of data stream as an input which contains vast majo…
We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and written to, with the goal of using it for prediction. We investigate these models in t…
Stable Hadamard Memory improves reinforcement learning by efficiently managing memory.
FPG uses fractional calculus for efficient reinforcement learning with long-term memory.
New algorithms for multitask learning with long-term memory.
A novel online GP model captures long-term memory in sequential data.
Generative diffusion models mimic biological memory networks, encoding associative dynamics in deep neural weights.
LEM efficiently models long-term sequences with gradients.
The paper introduces a new stochastic volatility model with long-term memory and jumps.
Efficient algorithm predicts unknown linear systems with long-term memory.
We focus on emergence of the power-law cross-correlations from processes with both short and long term memory properties. In the case of correlated error-terms, the power-law decay of the cross-correlation function comes automatically with the characteristics of separate processes. Bivariate Hurst exponent is then equa…
fSDE-Net generates time series with long-term memory using neural networks.
New RNN model handles long-term dependencies in irregularly-sampled time series.
In this paper we outline initial concepts for an immune inspired algorithm to evaluate price time series data. The proposed solution evolves a short term pool of trackers dynamically through a process of proliferation and mutation, with each member attempting to map to trends in price movements. Successful trackers fee…
Recent empirical results on long-term dependency tasks have shown that neural networks augmented with an external memory can learn the long-term dependency tasks more easily and achieve better generalization than vanilla recurrent neural networks (RNN). We suggest that memory augmented neural networks can reduce the ef…
Improved recurrent neural networks learn long-term dependencies through multi-scale memory.
Deep neural networks are vulnerable to adversarial attacks.
Study adds memory effect to Solow-Swan model for more accurate economic growth modeling.
We utilize long-term memory, fractal dimension and approximate entropy as input variables for the Efficiency Index [Kristoufek & Vosvrda (2013), Physica A 392]. This way, we are able to comment on stock market efficiency after controlling for different types of inefficiencies. Applying the methodology on 38 stock marke…
A new memory-based fusion layer improves multi-modal deep learning performance.
Deep RNNs excel at capturing long-term dependencies in sequential data.
We propose the first reduction-based approach to obtaining long-term memory guarantees for online learning in the sense of Bousquet and Warmuth, 2002, by reducing the problem to achieving typical switching regret. Specifically, for the classical expert problem with actions and rounds, using our framework we dev…
Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), and Memory Networks which contain memory are popularly used to learn patterns in sequential data. Sequential data has long sequences that hold relationships. RNN can handle long sequences but suffers from the vanishing and exploding gradient probl…
Modelling long-term dependencies is a challenge for recurrent neural networks. This is primarily due to the fact that gradients vanish during training, as the sequence length increases. Gradients can be attenuated by transition operators and are attenuated or dropped by activation functions. Canonical architectures lik…
ARISE models efficient markets without periodogram or Gaussianity assumptions.
One of the core tasks in multi-view learning is to capture relations among views. For sequential data, the relations not only span across views, but also extend throughout the view length to form long-term intra-view and inter-view interactions. In this paper, we present a new memory augmented neural network model that…
New framework captures long-term decision dependence in online learning.
Analysis of pretrained models' effectiveness in downstream tasks.
Building accurate language models that capture meaningful long-term dependencies is a core challenge in natural language processing. Towards this end, we present a calibration-based approach to measure long-term discrepancies between a generative sequence model and the true distribution, and use these discrepancies to …
Learning and adapting to new distributions or learning new tasks sequentially without forgetting the previously learned knowledge is a challenging phenomenon in continual learning models. Most of the conventional deep learning models are not capable of learning new tasks sequentially in one model without forgetting the…
We analyze long-term memory properties of hourly prices of electricity in the Czech Republic between 2009 and 2012. As the dynamics of the electricity prices is dominated by cycles -- mainly intraday and daily -- we opt for the detrended fluctuation analysis, which is well suited for such specific series. We find that …
Learning long-term dependencies is a key long-standing challenge of recurrent neural networks (RNNs). Hierarchical recurrent neural networks (HRNNs) have been considered a promising approach as long-term dependencies are resolved through shortcuts up and down the hierarchy. Yet, the memory requirements of Truncated Bac…
The choice of how to retain information about past gradients dramatically affects the convergence properties of state-of-the-art stochastic optimization methods, such as Heavy-ball, Nesterov's momentum, RMSprop and Adam. Building on this observation, we use stochastic differential equations (SDEs) to explicitly study t…
The concepts of unitary evolution matrices and associative memory have boosted the field of Recurrent Neural Networks (RNN) to state-of-the-art performance in a variety of sequential tasks. However, RNN still have a limited capacity to manipulate long-term memory. To bypass this weakness the most successful application…
Study examines cryptocurrency behavior during and after the pandemic.
Many robotic applications require the agent to perform long-horizon tasks in partially observable environments. In such applications, decision making at any step can depend on observations received far in the past. Hence, being able to properly memorize and utilize the long-term history is crucial. In this work, we pro…
Researchers have used many different methods to detect the possibility of long-term dependence (long memory) in stock market returns, but evidence is in general mixed. In this paper, three different tests, (namely Rescaled Range (R/S), its modified form, and the semi-parametric method (GPH)), in addition to a new appro…
Algorithm learns linear systems from partial observations with near-optimal rate.
We investigate the temporal correlations and multifractal nature of trading volume of 22 liquid stocks traded on the Shenzhen Stock Exchange in 2003. We find that the trading volume exhibit size-dependent non-universal long memory and multifractal nature. No crossover in the power-law dependence of the detrended fluctu…
We investigate the two components of the total daily return (close-to-close), the overnight return (close-to-open) and the daytime return (open-to-close), as well as the corresponding volatilities of the 2215 NYSE stocks from 1988 to 2007. The tail distribution of the volatility, the long-term memory in the sequence, a…
LSTMs and GRUs are the most common recurrent neural network architectures used to solve temporal sequence problems. The two architectures have differing data flows dealing with a common component called the cell state (also referred to as the memory). We attempt to enhance the memory by presenting a modification that w…
Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered information is found to be useful. Inspired by this idea, and the increasing pop…
The well-known Mori-Zwanzig theory tells us that model reduction leads to memory effect. For a long time, modeling the memory effect accurately and efficiently has been an important but nearly impossible task in developing a good reduced model. In this work, we explore a natural analogy between recurrent neural network…
We introduce a deterministic dealer model which implements most of the empirical laws, such as fat tails in the price change distributions, long term memory of volatility and non-Poissonian intervals. We also clarify the causality between microscopic dealers' dynamics and macroscopic market's empirical laws.
We study the dynamics of the `batch' minority game with market-impact correction using generating functional techniques to carry out the quenched disorder average. We find that the assumption of weak long-term memory, which one usually makes in order to calculate ergodic stationary states, breaks down when the persiste…