We have recently shown that deep Long Short-Term Memory (LSTM) recurrent neural networks (RNNs) outperform feed forward deep neural networks (DNNs) as acoustic models for speech recognition. More recently, we have shown that the performance of sequence trained context dependent (CD) hidden Markov model (HMM) acoustic m…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
19 results for “LSTM-RNN”
The Long-Short-Term-Memory Recurrent Neural Networks (LSTM RNNs) are a popular class of machine learning models for analyzing sequential data. Their training on modern GPUs, however, is limited by the GPU memory capacity. Our profiling results of the LSTM RNN-based Neural Machine Translation (NMT) model reveal that fea…
The study optimizes investment portfolios using deep learning models for variance-covariance estimation.
problem Estimating an appropriate variance-covariance matrix in Modern Portfolio Theory.
method Employed LSTM-RNN and probabilistic deep learning models (DeepVAR, GPVAR) for multivariate forecasting and portfolio optimization.
result LSTM-RNN models generally yield the best performance in terms of information ratio and annualized returns.
Automatic Construction of a Recurrent Neural Network based Classifier for Vehicle Passage Detectioncs.CV
Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a vehicle passage through a checkpoint. As an input to the classifier we use multidime…
One-class Collective Anomaly Detection based on Long Short-Term Memory Recurrent Neural Networkscs.LG
Intrusion detection for computer network systems has been becoming one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to the valuable resources hosted on computer networks. Traditional misuse detection strategies are unable to det…
Using raw sensor data to model and train networks for Human Activity Recognition can be used in many different applications, from fitness tracking to safety monitoring applications. These models can be easily extended to be trained with different data sources for increased accuracies or an extension of classifications …
Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Veccs.LG
E-commerce system predicts customer interest in sequentially ordered products.
problem Modeling customer interest in sequentially ordered products.
method Embed purchased items with Word2Vec and model the sequence with LSTM RNN.
result The recommender system outperforms its predecessor in click-through rate.
Recurrent neural networks (RNNs) are powerful and effective for processing sequential data. However, RNNs are usually considered "black box" models whose internal structure and learned parameters are not interpretable. In this paper, we propose an interpretable RNN based on the sequential iterative soft-thresholding al…
Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic connections making them powerful for modeling sequences. They have been successfully u…
Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory recurrent neural network (LSTM RNN) sub-modules for time series classification. Our …
Recurrent neural networks can be difficult to train on long sequence data due to the well-known vanishing gradient problem. Some architectures incorporate methods to reduce RNN state updates, therefore allowing the network to preserve memory over long temporal intervals. To address these problems of convergence, this p…
CNN-LSTM models for Multi-Speaker Source Separation using Bayesian Hyper Parameter Optimizationcs.LG
Paper proposes CNN-LSTM model for multi-speaker speech separation.
problem Multi-speaker source separation using deep learning.
method Parallel CNN-LSTM architecture with Bayesian hyperparameter optimization.
result Parallel CNN-LSTM model outperforms LSTM-only and CNN-only models.
Often, more time is spent on finding a model that works well, rather than tuning the model and working directly with the dataset. Our research began as an attempt to improve upon a simple Recurrent Neural Network for answering "simple" first-order questions (QA-RNN), developed by Ferhan Ture and Oliver Jojic, from Comc…
Reservoir computers and RNNs fall short of optimal prediction for stochastic PDFA.
problem Predicting stochastic processes generated by probabilistic deterministic finite-state automata.
method Generalized linear models, Reservoir computers, and Long Short-Term Memory (LSTM) RNNs were tested.
result Each method can fall short of maximal predictive accuracy by up to 50% after training.
Deep neural networks improve forecasting of non-stationary time-series data.
problem Forecasting non-stationary time-series data with structural breaks and high volatility.
method Evaluation of DNN models including MLP, CNN, LSTM-RNN, and GRU-RNN on 10 Indian financial stocks.
result DNN models show better performance for single-step forecasting but degrade for multi-step forecasting, especially for long forecast periods.
Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information from inputs. For modeling long-term dependencies in a dataset, the gating mecha…
Today's Cyber-Physical Systems (CPSs) are large, complex, and affixed with networked sensors and actuators that are targets for cyber-attacks. Conventional detection techniques are unable to deal with the increasingly dynamic and complex nature of the CPSs. On the other hand, the networked sensors and actuators generat…
This study compares deep learning and statistical models for stock price forecasting.
problem Accurate stock price prediction is challenging due to market volatility.
method Used deep learning (LSTM, RNN, CNN, FULL CNN) and statistical models (ARIMA, Moving Averages) on S&P 500 data.
result LSTM model showed the lowest Mean Absolute Error (MAE), indicating highest accuracy.
Study shows challenges in converting RNNs to FSMs due to computational complexity.
problem Understanding the equivalence and distance between RNNs and FSMs.
method Computational proofs for equivalence and distance problems between RNNs and FSMs.
result Undecidability and hardness of approximation problems between RNNs and FSMs.