Model combines long-term and short-term memory using conceptors.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
QLSTM outperforms LSTM in predicting KSE 100 index movements.
The mathematical model of a linear system with the short memory about own stochastic behavior is proposed. It is assumed that the system is under a continual influence of independent stochastic impulses. In a short memory approximation the expression of the stochastic process is found. An application of the model propo…
Long and short memory in economic processes is usually described by the so-called discrete fractional differencing and fractional integration. We prove that the discrete fractional differencing and integration are the Grunwald-Letnikov fractional differences of non-integer order d. Equations of ARIMA(p,d,q) and ARFIMA(…
Long short-term memory network outperforms seasonal model in JSE Top 40 forecasting.
We focus on emergence of the power-law cross-correlations from processes with both short and long term memory properties. In the case of correlated error-terms, the power-law decay of the cross-correlation function comes automatically with the characteristics of separate processes. Bivariate Hurst exponent is then equa…
New method combines long-memory reservoirs for accurate dengue forecasting from short data.
The paper introduces a new short rate model with memory components.
Recurrent neural networks (RNN) are at the core of modern automatic speech recognition (ASR) systems. In particular, long-short term memory (LSTM) recurrent neural networks have achieved state-of-the-art results in many speech recognition tasks, due to their efficient representation of long and short term dependencies …
ENRNN uses eigenvalue normalization for short-term memory in RNNs.
We consider the fractional Heston model originally proposed by Comte, Coutin and Renault. Inspired by recent ground-breaking work on rough volatility, which showed that models with volatility driven by fractional Brownian motion with short memory allows for better calibration of the volatility surface and more robust e…
EnLSTM network improves log generation from small datasets.
Method extracts knowledge from LSTM for sequence validation.
Extended LSTMs improve volatility prediction by 20%.
NANSDE-Net models time series with memory using neural ARMA-type noise.
Deep learning predicts baseball home runs with better accuracy.
The extension of deep learning towards temporal data processing is gaining an increasing research interest. In this paper we investigate the properties of state dynamics developed in successive levels of deep recurrent neural networks (RNNs) in terms of short-term memory abilities. Our results reveal interesting insigh…
New perspective on SGD reveals short-range memory effects in deep learning.
Paper tackles stutter detection using deep learning.
Much sequential data exhibits highly non-uniform information distribution. This cannot be correctly modeled by traditional Long Short-Term Memory (LSTM). To address that, recent works have extended LSTM by adding more activations between adjacent inputs. However, the approaches often use a fixed depth, which is at the …
Reservoir computers and RNNs fall short of optimal prediction for stochastic PDFA.
Extended LSTM improves language modeling performance.
LSTMs improve demand forecasting for e-grocery products.
Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory recurrent neural network (LSTM RNN) sub-modules for time series classification. Our …
Cryptocurrency prices predicted using LSTM, SVM, and polynomial regression.
Stacked LSTM networks improve traffic volume forecasting.
NeuroMemFPP uses LSTM to estimate FPP parameters with high accuracy.
We introduce a Vasicek-type short rate model which has two additional parameters representing memory effect. This model presents better results in yield curve fitting than the classical Vasicek model. We derive closed-form expressions for the prices of bonds and bond options. Though the model is non-Markov, there exist…
LSTMs improve bond yield forecasting with unique signals.
In this work, we first analyze the memory behavior in three recurrent neural networks (RNN) cells; namely, the simple RNN (SRN), the long short-term memory (LSTM) and the gated recurrent unit (GRU), where the memory is defined as a function that maps previous elements in a sequence to the current output. Our study show…
Paper uses AI methods to forecast Bitcoin prices.
We examine the scaling regime for the detrended fluctuation analysis (DFA) - the most popular method used to detect the presence of long memory in data and the fractal structure of time series. First, the scaling range for DFA is studied for uncorrelated data as a function of length of time series and regression li…
Paper proposes new method for time series confidence intervals using LSTM.
The paper uses HMM and LSTM for stock market trend analysis.
The ability to look multiple times through a series of pose-adjusted glimpses is fundamental to human vision. This critical faculty allows us to understand highly complex visual scenes. Short term memory plays an integral role in aggregating the information obtained from these glimpses and informing our interpretation …
Neural Turing Machines (NTMs) are an instance of Memory Augmented Neural Networks, a new class of recurrent neural networks which decouple computation from memory by introducing an external memory unit. NTMs have demonstrated superior performance over Long Short-Term Memory Cells in several sequence learning tasks. A n…
We have applied a Long Short-Term Memory neural network to model S&P 500 volatility, incorporating Google domestic trends as indicators of the public mood and macroeconomic factors. In a held-out test set, our Long Short-Term Memory model gives a mean absolute percentage error of 24.2%, outperforming linear Ridge/Lasso…
New kernel-based models improve on traditional neural methods in sequence modeling.
With deep learning approaches becoming state-of-the-art in many speech (as well as non-speech) related machine learning tasks, efforts are being taken to delve into the neural networks which are often considered as a black box. In this paper it is analyzed how recurrent neural network (RNNs) cope with temporal dependen…
In this paper, we present the results of Monte Carlo simulations for two popular techniques of long-range correlations detection - classical and modified rescaled range analyses. A focus is put on an effect of different distributional properties on an ability of the methods to efficiently distinguish between short and …
Deep learning predicts currency volatility accurately.
Learning and adapting to new distributions or learning new tasks sequentially without forgetting the previously learned knowledge is a challenging phenomenon in continual learning models. Most of the conventional deep learning models are not capable of learning new tasks sequentially in one model without forgetting the…
Event-driven features improve forex price prediction accuracy.
Enhanced LSTM model learns complex temporal dependencies.
Paper presents methods to create stock price confidence intervals using LSTM models.
Learning and memory are intertwined in our brain and their relationship is at the core of several recent neural network models. In particular, the Attention-Gated MEmory Tagging model (AuGMEnT) is a reinforcement learning network with an emphasis on biological plausibility of memory dynamics and learning. We find that …
Action recognition has attracted increasing attention from RGB input in computer vision partially due to potential applications on somatic simulation and statistics of sport such as virtual tennis game and tennis techniques and tactics analysis by video. Recently, deep learning based methods have achieved promising per…
Study combines CNNs and LSTMs for ECG classification, improving performance with attention mechanisms.