Extended LSTMs improve volatility prediction by 20%.
problem Predicting asset price volatility with long memory.
method Extended LSTMs with multiple flexible timescales.
result Extended LSTMs outperform rough volatility predictions by 20%.
QLSTM improves speech recognition by considering internal quaternion dependencies.
problem Weak internal dependencies in traditional RNNs for speech recognition.
method Proposes QLSTM, a quaternion-based LSTM that considers both external and internal dependencies.
result QLSTM achieves better performance with up to 2.8 times fewer parameters.
Simplified LSTM models improve sentiment analysis on Twitter debate data.
problem Performing sentiment analysis on long sequence data from Twitter debates.
method Developed six parameter-reduced LSTM models (slim LSTM) for faster training and reduced computational cost.
result Slim LSTM models outperform standard LSTM model in sentiment analysis of GOP Debate Twitter dataset.
Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory recurrent neural network (LSTM RNN) sub-modules for time series classification. Our …
LSTMs improve demand forecasting for e-grocery products.
problem Improving demand forecasting accuracy in e-grocery retail.
method Developed and tested univariate and multivariate LSTM models for 100 fast-moving consumer goods.
result LSTMs outperform traditional models for food products, especially in beverage category.
LSTM neural networks improve fiber nonlinearities in coherent systems.
problem Compensating fiber nonlinearities in digital coherent systems.
method Utilization of Long short-term memory (LSTM) neural networks.
result LSTM neural networks provide superior performance compared to digital back propagation, especially in multi-channel scenarios.
Method extracts knowledge from LSTM for sequence validation.
problem Validating sequences generated by unknown automata.
method Clustering hidden states to build a corresponding automaton.
result Automaton accurately predicts sequence validity.
NeuroMemFPP uses LSTM to estimate FPP parameters with high accuracy.
problem Estimating parameters of fractional Poisson process with memory and long-range dependence.
method Recurrent Neural Network (RNN), specifically Long Short-Term Memory (LSTM), for parameter estimation.
result The LSTM-based approach reduces MSE by about 55.3% compared to traditional MOM method.
Develops LSTM for predicting neuronal dynamics over long time-horizons.
problem Understanding and controlling complex brain behaviors.
method Long Short-Term Memory (LSTM) neural network architecture for multi-time step predictions.
result LSTM improves short time-horizon prediction accuracy and multi-time step predictions of neuronal dynamics.
We propose a max-pooling based loss function for training Long Short-Term Memory (LSTM) networks for small-footprint keyword spotting (KWS), with low CPU, memory, and latency requirements. The max-pooling loss training can be further guided by initializing with a cross-entropy loss trained network. A posterior smoothin…
Deep neural networks predict electricity consumption accurately.
problem Predicting future electricity consumption for better management.
method Used Recurrent Neural Networks (RNN) and Long Short Term Memory (LSTM) networks to predict electricity consumption based on past data.
result Both RNN and LSTM achieved an average Root Mean Square error of 0.1.
Stacked LSTM networks improve traffic volume forecasting.
problem Accurate traffic volume prediction for better planning.
method Applying stacked Long Short-Term Memory (LSTM) networks for time series forecasting.
result Stacked LSTM networks enhance the accuracy of traffic volume predictions.
Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic connections making them powerful for modeling sequences. They have been successfully u…
LSTM-MDNs improve risk forecasting during turbulent periods.
problem Forecasting Value-at-Risk (VaR) during volatile market conditions.
method Implemented Long Short-Term Memory mixture density networks (LSTM-MDNs) for VaR forecasting and compared them with established models.
result LSTM-MDNs outperformed benchmark models in turbulent periods but not in calm periods.
New LSTM scheme incorporates prior knowledge and measurement uncertainties.
problem Overfitting and insufficient data for accurate time-dependent solutions.
method Sparse Bayesian training algorithm for automatic connection determination.
result Less prone to overfitting, smaller data set required for satisfying accuracy.
Neural networks predict airport passenger behavior using WiFi traces.
problem Predicting airport passenger activity choices inside the terminal.
method Three neural network architectures: FNN, LSTM, and their combination. Inputs include static and dynamic passenger data. Real-world case study at Bologna Airport.
result LSTM approach, especially with short prediction horizons, outperforms FNN.
QLSTM outperforms LSTM in predicting KSE 100 index movements.
problem Predicting stock market movement in uncertain economic conditions.
method Used LSTM and QLSTM models on monthly data of economic indicators.
result QLSTM provided more accurate predictions of KSE 100 index values.
Multivariate techniques based on engineered features have found wide adoption in the identification of jets resulting from hadronic top decays at the Large Hadron Collider (LHC). Recent Deep Learning developments in this area include the treatment of the calorimeter activation as an image or supplying a list of jet con…
New kernel-based models improve on traditional neural methods in sequence modeling.
problem Sequence modeling challenges in natural language processing and neuroscience.
method Kernel-based recurrent neural networks and convolutional neural networks.
result Kernel-based models perform on par or better than traditional neural methods.
With deep learning approaches becoming state-of-the-art in many speech (as well as non-speech) related machine learning tasks, efforts are being taken to delve into the neural networks which are often considered as a black box. In this paper it is analyzed how recurrent neural network (RNNs) cope with temporal dependen…
The standard LSTM recurrent neural networks while very powerful in long-range dependency sequence applications have highly complex structure and relatively large (adaptive) parameters. In this work, we present empirical comparison between the standard LSTM recurrent neural network architecture and three new parameter-r…
Paper uses LSTM neural networks to forecast commodity prices.
problem Forecasting accuracy of traditional methods like ARIMA.
method Long Short-Term Memory (LSTM) neural networks complement traditional methods.
result Forecast averaging of LSTM and ARIMA models improves forecast accuracy.
EnLSTM network improves log generation from small datasets.
problem Generating well logs from small datasets with high accuracy.
method Combining ENN and C-LSTM networks with perturbation methods.
result 34% reduction in mean-square-error compared to existing models.
Deep learning predicts currency volatility accurately.
problem Predicting future volatility in Forex trading.
method Constructed a deep-learning network using multiscale LSTM with multi-currency pairs.
result Multiscale LSTM model outperforms conventional models.
SRNNs achieve LSTMs' online regression performance in less time.
problem Training LSTMs is time-consuming.
method First-order training algorithm with linear time complexity.
result SRNNs provide similar regression performance as LSTMs in shorter training time.
Paper compares GRU and LSTM for predicting wildfire spread direction.
problem Predicting wildfire spread direction with limited data.
method Comparison of Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) networks.
result GRU performs better for longer time series than LSTM.
In this work, we first analyze the memory behavior in three recurrent neural networks (RNN) cells; namely, the simple RNN (SRN), the long short-term memory (LSTM) and the gated recurrent unit (GRU), where the memory is defined as a function that maps previous elements in a sequence to the current output. Our study show…
Study combines CNNs and LSTMs for ECG classification, improving performance with attention mechanisms.
problem Improving ECG classification accuracy for weakly supervised tasks.
method Investigates ConvLSTM networks and various attention mechanisms to capture both morphological and temporal features.
result Attention mechanisms improve classification performance and provide interpretable saliency maps.
DCRNN improves LSTM for chaotic dynamical system forecasting.
problem Modeling chaotic dynamical systems with recurrent neural networks.
method DCRNN incorporates learnable skip-connections and a Lyapunov stability regularization term.
result DCRNN outperforms LSTM in 100 out of 100 experiments, reducing mean squared error by 80.0%.
A model integrates CNN and LSTM with LLM for better stock forecasting.
problem Complex stock market prediction with volatile patterns and multifaceted data.
method Two-Level Conv-LSTM Neural Network with LLM for holistic stock advising.
result Improved prediction accuracy and contextual insights.
Paper addresses LSTM stability for thermal systems using infinity-norm.
problem Stability of LSTM networks in thermal systems.
method Derived ISS∞ condition for LSTM, developed training strategy. result ISS∞-promoted LSTM outperforms other models in thermal system case study. SVOCD detects changepoints in complex systems efficiently.
problem Detecting changepoints in complex systems efficiently.
method Stein variational online changepoint detection integrating SVN method and BOCPD.
result Successfully applied to Hawkes processes and LSTM neural networks.
This study improves stock investment strategies using advanced neural networks.
problem Improving stock investment strategies for better performance.
method Used LSTM-GRU neural networks combined with SVM for stock prediction.
result LSTM-GRU outperformed benchmarks in stock predictions.
DA-LSTM adapts LSTM depth to non-uniform data, improving efficiency.
problem Non-uniform information distribution in sequential data cannot be accurately modeled by traditional LSTM.
method Developed DA-LSTM architecture that dynamically adjusts LSTM depth based on information distribution.
result DA-LSTM reduces computation resource usage and convergence time by 41.78% and 46.01% respectively.
Improved LSTM cell for high-frequency trading forecasts.
problem Precise stock price forecasting with minimal lags.
method Revised long short-term memory (LSTM) cell with optimal gate/state selection.
result Lower forecasting error compared to other recurrent neural networks.
LSTM neural networks improve stock price prediction for Stockholm OMX30.
problem Forecasting stock price movement in financial markets.
method Ensemble of parallel long short-term memory (LSTM) neural networks trained on binary classification of stock returns.
result The LSTM ensemble outperforms traditional portfolios in terms of average daily returns, cumulative returns, and risk-adjusted performance.
LTM tackles long sequence language modeling by avoiding vanishing and exploding gradients.
problem Language models struggle with long sequences due to gradient issues.
method Introduces Long Term Memory network (LTM) that scales memory and weights input, avoiding overfitting.
result LTM achieves state-of-the-art perplexity results with fewer cells than previous models.
Vanishing long-term gradients are a major issue in training standard recurrent neural networks (RNNs), which can be alleviated by long short-term memory (LSTM) models with memory cells. However, the extra parameters associated with the memory cells mean an LSTM layer has four times as many parameters as an RNN with the…
In this paper, a taxonomy for memory networks is proposed based on their memory organization. The taxonomy includes all the popular memory networks: vanilla recurrent neural network (RNN), long short term memory (LSTM ), neural stack and neural Turing machine and their variants. The taxonomy puts all these networks und…
LSTMs outperform DFM in nowcasting COVID-19 economic variables.
problem Timely estimation of macroeconomic variables during the pandemic.
method Comparison of LSTM and DFM performance on three variables (export values, volumes, and services exports).
result LSTMs outperformed DFM in two-thirds of variable/quarter combinations.
Event-driven features improve forex price prediction accuracy.
problem Inaccurate predictions in forex due to market volatility.
method Developed event-driven features and used LSTM, BiLSTM, GRU models.
result Improved prediction system with minimal risk.
LSTMs improve bond yield forecasting with unique signals.
problem Improving bond yield forecasting accuracy.
method Long short-term memory (LSTM) networks with sequence-to-sequence architectures and LSTM-LagLasso methodology.
result Univariate LSTM models with additional memory can achieve similar results as multivariate MLP models using exogenous information.
A deep learning network was used to predict future blood glucose levels, as this can permit diabetes patients to take action before imminent hyperglycaemia and hypoglycaemia. A sequential model with one long-short-term memory (LSTM) layer, one bidirectional LSTM layer and several fully connected layers was used to pred…
This paper reviews methods to create compact neural networks for IoT applications.
problem Complex deep neural networks are costly and slow, hindering real-world deployment.
method Automatic synthesis of compact, accurate DNN/LSTM models.
result Compact neural networks reduce energy consumption, memory, and inference time.
Study uses neural networks to predict travel times for public transportation.
problem Inaccurate travel time predictions due to road traffic irregularities.
method Developed two neural network models (MLP and LSTM) using OD travel time matrix.
result Both models can make near-accurate predictions, but LSTM is more susceptible to noise.
Develops deep learning model for detecting anomalies in transportation data.
problem Anomaly detection in temporal data of transportation networks.
method Proposes EVT-LSTM model combining LSTM and EVT, trained with an objective function.
result EVT-LSTM model outperforms other models in anomaly detection.
New RNN model handles long-term dependencies in irregularly-sampled time series.
problem Handling long-term dependencies in irregularly-sampled time series data.
method Designing ODE-LSTMs that separate memory from continuous-time state.
result ODE-LSTMs outperform other RNN-based models on non-uniformly sampled data with long-term dependencies.
State-of-the-art forecasting methods using Recurrent Neural Net- works (RNN) based on Long-Short Term Memory (LSTM) cells have shown exceptional performance targeting short-horizon forecasts, e.g given a set of predictor features, forecast a target value for the next few time steps in the future. However, in many appli…