Time series forecasting is difficult. It is difficult even for recurrent neural networks with their inherent ability to learn sequentiality. This article presents a recurrent neural network based time series forecasting framework covering feature engineering, feature importances, point and interval predictions, and for…
Two new methods improve forecasting of functional time series data.
problem Forecasting of functional time-dependent data.
method Functional Singular Spectrum Analysis (FSFA) based forecasting methods.
result Our methods outperform existing algorithms for periodic stochastic processes.
Generalizes memory and forecasting capacities for nonlinear recurrent networks with dependent inputs.
problem Understanding memory and forecasting capabilities in networks with dependent inputs.
method Formulated bounds for memory and forecasting capacities in terms of network size and input properties.
result Proved that memory capacity for linear recurrent networks with independent inputs is given by the rank of the controllability matrix.
This work combines recurrent models with diffusion for probabilistic time series forecasting.
problem Scalability and capturing high-dimensional distributions and cross-feature dependencies in time series forecasting.
method Combines recurrent neural networks' efficiency with diffusion models' probabilistic modeling, using stochastic interpolants and conditional generation.
result Offers scalable probabilistic time series forecasting methods.
New RNN model forecasts unseen time series with little training data.
problem Lack of data for RNNs to generalize well in time series forecasting.
method Proposes a novel RNN-based model that learns shared feature embeddings over quantised time series.
result Accurately forecasts unseen time series with minimal training data.
The study compares econometric and deep learning models for forecasting COMEX copper futures volatility.
problem Forecasting volatility of COMEX copper futures across different time intervals.
method Econometric models (GARCH, HAR) and deep learning models (RNN, LSTM, GRU) applied to daily and hourly data.
result Deep learning models outperform econometric models in hourly data, but HAR remains the best overall for daily data.
We study epidemic forecasting on real-world health data by a graph-structured recurrent neural network (GSRNN). We achieve state-of-the-art forecasting accuracy on the benchmark CDC dataset. To improve model efficiency, we sparsify the network weights via transformed-ℓ1 penalty and maintain prediction accuracy at…
Improved electricity price forecasting model combining linear and non-linear structures.
problem Day-ahead electricity price forecasting in energy systems.
method Recurrent neural networks with embedded linear structures.
result Approximately 11% higher accuracy than state-of-the-art models.
This article applies a long short-term memory recurrent neural network to mortality rate forecasting. The model can be trained jointly on the mortality rate history of different countries, ages, and sexes. The RNN-based method seems to outperform the popular Lee-Carter model.
AGCRN forecasts traffic using adaptive graph and recurrent learning.
problem Forecasting traffic dynamics with complex spatial and temporal correlations.
method Adaptive Graph Convolutional Recurrent Network (AGCRN) with Node Adaptive Parameter Learning (NAPL) and Data Adaptive Graph Generation (DAGG).
result AGCRN outperforms state-of-the-art models without pre-defined graphs.
The objective of this work is to improve the accuracy of building demand forecasting. This is a more challenging task than grid level forecasting. For the said purpose, we develop a new technique called recurrent transform learning (RTL). Two versions are proposed. The first one (RTL) is unsupervised; this is used as a…
Neural networks predict traffic flow in smart cities.
problem Forecasting stochastic and nonlinear traffic flow.
method Various recurrent neural networks trained on intersection data.
result Vector output model with gated recurrent units performed best.
Exponentially smoothed RNNs improve industrial forecasting.
problem Complexity and non-stationarity in industrial time series data.
method Exponential smoothed recurrent neural networks (RNNs) for modeling non-linear dynamics.
result Exponentially smoothed RNNs outperform traditional models in multi-step forecasting.
Unified GARCH-NN models improve financial volatility forecasting.
problem Improving financial volatility forecasting accuracy and efficiency.
method Embedding GARCH dynamics within recurrent neural networks (GRU and LSTM).
result Unified GARCH-NN models outperform classical GARCH and hybrid methods.
Probabilistic forecasting, i.e. estimating the probability distribution of a time series' future given its past, is a key enabler for optimizing business processes. In retail businesses, for example, forecasting demand is crucial for having the right inventory available at the right time at the right place. In this pap…
Improved electrical load forecasting model using Fourier-enhanced RNN.
problem Electrical load time series downscaling with high accuracy and low error.
method Combines recurrent neural network with Fourier seasonal embeddings and self-attention.
result Significantly reduces RMSE across different time horizons compared to existing methods.
A simple baseline outperforms deep learning methods in transportation forecasting.
problem The importance of stationarity and recurrent patterns in transportation data.
method A naive baseline based on average weekly patterns and linear regression.
result The baseline method achieves comparable or better results than state-of-the-art deep learning approaches.
Being able to predict the occurrence of extreme returns is important in financial risk management. Using the distribution of recurrence intervals---the waiting time between consecutive extremes---we show that these extreme returns are predictable on the short term. Examining a range of different types of returns and th…
BiHRNN predicts inflation by leveraging hierarchical structure and bidirectional RNNs.
problem Accurate inflation forecasting is challenging due to dynamic factors and the layered structure of the Consumer Price Index.
method Bi-directional Hierarchical Recurrent Neural Network (BiHRNN) model that uses bidirectional information flow between levels and informative constraints on RNN parameters.
result BiHRNN significantly outperforms traditional RNN models in forecasting accuracy.
Deep state space model forecasts time series with uncertainty.
problem Probabilistic forecasting for risk management.
method Parameterized deep networks for non-linear models, recurrent neural nets for dependency, ARD network for exogenous variables.
result Accurate and sharp probabilistic forecasts with realistic uncertainty growth.
Study improves stock price prediction using advanced ML models.
problem Improving financial forecasting accuracy in stock markets.
method Evaluation of RNN architectures including LSTM, GRU, and attention-based models.
result Attention-based models outperform others in capturing complex dependencies.
Few-shot learning improves time-series forecasting with limited data.
problem Limited data in target tasks degrade forecasting performance.
method A few-shot learning method using recurrent neural networks with attention.
result The model forecasts future values effectively with minimal data.
Deep learning models predict call center volumes with seasonal patterns.
problem Forecasting call center volumes with complex seasonal behavior.
method Investigated recurrent neural networks (RNNs) including Elman, LSTM, and GRU models.
result Optimal RNN configurations outperform other forecasting techniques.
New financial volatility models capture dynamic volatility better.
problem Traditional volatility models miss important volatility dynamics.
method Integrate recurrent neural networks into GARCH models.
result Improved in-sample and out-of-sample volatility forecasting.
We propose a framework for general probabilistic multi-step time series regression. Specifically, we exploit the expressiveness and temporal nature of Sequence-to-Sequence Neural Networks (e.g. recurrent and convolutional structures), the nonparametric nature of Quantile Regression and the efficiency of Direct Multi-Ho…
This paper reports empirical evidence that a neural networks model is applicable to the statistically reliable prediction of foreign exchange rates. Time series data and technical indicators such as moving average, are fed to neural nets to capture the underlying "rules" of the movement in currency exchange rates. The …
Spatiotemporal forecasting has various applications in neuroscience, climate and transportation domain. Traffic forecasting is one canonical example of such learning task. The task is challenging due to (1) complex spatial dependency on road networks, (2) non-linear temporal dynamics with changing road conditions and (…
A novel deep probabilistic model for dynamic systems forecasting.
problem Probabilistic forecasting in dynamic systems.
method Combining deep generative models and state space models with recurrent neural networks and variational sequence models.
result Outperforms existing models in system identification benchmarks and real-world centrifugal compressor forecasting.
RNN(p) improves power consumption forecasts with interpretable models.
problem Improving power consumption forecasts for energy sector decisions.
method RNN(p) models with p time lags, using structured feedbacks.
result RNN(p) models achieve excellent forecasting accuracy and interpretability.
DAUM networks improve weather forecasting with attention and multistream features.
problem Improving weather forecasting accuracy using deep learning.
method Proposes DAUM networks combining tensorial unistream and multistream representations with attention mechanisms.
result Adding self-attention blocks enhances forecasting performance.
CTRNNs improve blood glucose forecasting in ICU, outperforming traditional models.
problem Forecasting blood glucose in ICU with irregular measurements.
method Continuous time autoregressive recurrent neural networks (CTRNNs) using neural ODE or neural flow layers.
result CTRNNs generally outperform traditional autoregressive models in probabilistic forecasting of blood glucose.
The non-stationarity characteristic of the solar power renders traditional point forecasting methods to be less useful due to large prediction errors. This results in increased uncertainties in the grid operation, thereby negatively affecting the reliability and increased cost of operation. This research paper proposes…
Transfer learning improves highway traffic forecasting using graph neural networks.
problem Lack of historical data for traffic forecasting on large highway networks.
method Developed a transfer learning approach for DCRNN, a graph neural network for highway forecasting.
result TL-DCRNN can forecast traffic on unseen regions of the highway network with high accuracy.
Study forecasts aortic pressure with deep learning models.
problem Forecasting noisy, non-stationary aortic pressure.
method Used deep learning models, specifically recurrent neural networks with Legendre Memory Unit, on 25 Hz time series data.
result Recurrent neural networks with Legendre Memory Unit achieved the best performance with an overall forecasting error of 1.8 mmHg.
Improved county-level COVID-19 forecasting model using LSTM and data augmentation.
problem Accurately forecasting county-level COVID-19 cases to optimize medical resources.
method Adapted TDEFSI-LONLY model, utilized LSTM, data augmentation, and inter-county mixing.
result CLEIR-Net model provides better forecasts than TDEFSI-LONLY.
MES-LSTM hybrid method improves multivariate time series forecasting and mortality modeling.
problem Challenges in applying hybrid forecast methods to multivariate data.
method Generalized multivariate extension of ES-RNN, utilizing vectorized implementation.
result MES-LSTM shows significant improvement over pure statistical and deep learning methods in forecast accuracy and prediction interval construction.
LSTM models predict low likelihood of another COVID-19 wave in India.
problem Inaccurate and unreliable COVID-19 infection forecasting models due to data limitations and model complexity.
method Application of LSTM, bidirectional LSTM, and encoder-decoder LSTM models for multi-step infection forecasting.
result Predictions indicate low likelihood of another wave in October and November 2021.
PhICNet combines physics and deep learning for forecasting and source identification in dynamical systems.
problem Forecasting and identifying unobservable external sources in spatio-temporal dynamical systems.
method Physics-Incorporated Convolutional Recurrent Neural Network (PhICNet).
result PhICNet can forecast dynamics and identify sources for relatively long periods.
Recurrent neural networks (RNNs) are nonlinear dynamical models commonly used in the machine learning and dynamical systems literature to represent complex dynamical or sequential relationships between variables. More recently, as deep learning models have become more common, RNNs have been used to forecast increasingl…
Enhanced multivariate GARCH model using LSTM for better volatility forecasting.
problem Limitations of traditional multivariate GARCH in capturing persistent volatility and co-movement.
method Integrates deep learning (LSTM) into multivariate GARCH models to capture nonlinear and dynamic dependence structures.
result Superior out-of-sample portfolio risk forecast compared to traditional methods.
Deep models predict intraday electricity prices accurately.
problem Accurately forecasting intraday electricity prices.
method Two deep time series probabilistic models using ESNs with stochastic disturbances and copulas.
result Deep distributional models provide accurate short-term probabilistic price forecasts.
With the advent of Big Data, nowadays in many applications databases containing large quantities of similar time series are available. Forecasting time series in these domains with traditional univariate forecasting procedures leaves great potentials for producing accurate forecasts untapped. Recurrent neural networks …
This paper introduces CloudLSTM, a new branch of recurrent neural models tailored to forecasting over data streams generated by geospatial point-cloud sources. We design a Dynamic Point-cloud Convolution (DConv) operator as the core component of CloudLSTMs, which performs convolution directly over point-clouds and extr…
Improved LSTM cell for high-frequency trading forecasts.
problem Precise stock price forecasting with minimal lags.
method Revised long short-term memory (LSTM) cell with optimal gate/state selection.
result Lower forecasting error compared to other recurrent neural networks.
Model predicts COVID-19 spread with better accuracy than existing methods.
problem Limited daily samples in time for data-driven methods.
method Integrated spatiotemporal model combining epidemic differential equations and RNN.
result Model outperforms existing methods in forecasting cases.
For2For combines forecasts to improve time series forecasting.
problem Improving time series forecasting accuracy.
method Combines standard forecasting methods and machine learning models using forecasts as features.
result Outperforms all submissions in the M4 competition for quarterly series and most monthly series.
This study extends and evaluates the forecasting performance of the Singular Spectrum Analysis (SSA) technique using a general non-linear form for the re- current formula. In this study, we consider 24 series measuring the monthly seasonally adjusted industrial production of important sectors of the German, French and …
Hybrid models forecast EPEC energy spot prices.
problem Forecasting energy spot prices in EPEC markets.
method Combining Naive, Fourier, ARMA/GARCH, mean-reversion, jump-diffusion, and RNN models.
result Improved accuracy in forecasting compared to individual models.