The paper evaluates three variants of the Gated Recurrent Unit (GRU) in recurrent neural networks (RNN) by reducing parameters in the update and reset gates. We evaluate the three variant GRU models on MNIST and IMDB datasets and show that these GRU-RNN variant models perform as well as the original GRU RNN model while…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,932 papers · 148 categories
Trend · papers per month
48 results for “GRU network”
GRU models with Adam optimizer outperform other combinations in stock market forecasting.
problem Comparing optimization techniques for time series forecasting in LSTM and GRU networks.
method Examined Adam and Nesterov Accelerated Gradient (NAG) on LSTM and GRU models for stock market forecasting.
result GRU models with Adam optimizer produced the lowest RMSE and outperformed other combinations.
Hybrid LSTM-fully convolutional networks (LSTM-FCN) for time series classification have produced state-of-the-art classification results on univariate time series. We show that replacing the LSTM with a gated recurrent unit (GRU) to create a GRU-fully convolutional network hybrid model (GRU-FCN) can offer even better p…
Tiny Eats GRU detects eating episodes on a microcontroller.
problem Automatic dietary monitoring on low-power devices.
method Shallow gated recurrent unit (GRU) architecture on Arm Cortex M0+.
result Tiny Eats GRU achieves 95.15% accuracy with 4% memory usage and 6 ms latency.
GRUs exhibit diverse dynamical behaviors but cannot mimic continuous attractors.
problem Understanding and predicting the dynamics of GRUs for neural data.
method Continuous time dynamical systems analysis of GRU networks.
result GRUs can represent stable limit cycles, multi-stable dynamics, and homoclinic bifurcations but not continuous attractors.
GRUs predict flu at state and city levels with lower error.
problem Influenza prediction at multiple spatial resolutions.
method Gated Recurrent Unit (GRU) neural network, real-time search data.
result GRU outperforms state-of-the-art methods for flu prediction.
This study uses neural networks to predict Bitcoin prices, finding GRUs outperform LSTMs.
problem Predicting Bitcoin's volatile price movements.
method Used LSTMs and GRUs for forecasting, with L2 regularization to reduce overfitting.
result GRUs models outperform LSTMs in predicting Bitcoin's price with lower MSE.
Integrates CNN and GRU for precise stock market risk alerts.
problem Predicting future stock market risks and providing early warnings.
method Uses CNN for feature extraction and GRU for time series analysis.
result Effective early warnings of future stock market risks.
Gating units in GRUs and LSTMs create slow modes and control phase-space complexity.
problem Training challenges in RNNs due to exploding or vanishing gradients.
method Random matrix theory and mean-field theory applied to GRUs and LSTMs.
result Gates in GRUs and LSTMs lead to accumulation of slow modes and control phase-space complexity.
GRU-PFG model extracts inter-stock correlations from stock factors using graph neural networks.
problem Limited effectiveness of models relying solely on stock factors for capturing stock correlations.
method Project stock factors into a graph and use graph neural networks to extract inter-stock correlations.
result Achieves better prediction results than models relying solely on stock factors and comparable to second category models.
Improved GRU model with weighted time-delay feedback for long-term dependencies.
problem Modeling long-term dependencies in sequential data.
method Introducing a gated recurrent unit (GRU) with a weighted time-delay feedback mechanism.
result τ-GRU outperforms state-of-the-art models on various tasks.
We examine the algebraic and geometric properties of a uni-directional GRU and word embeddings trained end-to-end on a text classification task. A hyperparameter search over word embedding dimension, GRU hidden dimension, and a linear combination of the GRU outputs is performed. We conclude that words naturally embed t…
LSTMs and GRUs are the most common recurrent neural network architectures used to solve temporal sequence problems. The two architectures have differing data flows dealing with a common component called the cell state (also referred to as the memory). We attempt to enhance the memory by presenting a modification that w…
There is growing interest in being able to run neural networks on sensors, wearables and internet-of-things (IoT) devices. However, the computational demands of neural networks make them difficult to deploy on resource-constrained edge devices. To meet this need, our work introduces a new recurrent unit architecture th…
Gated Recurrent Unit (GRU) is a recently-developed variation of the long short-term memory (LSTM) unit, both of which are types of recurrent neural network (RNN). Through empirical evidence, both models have been proven to be effective in a wide variety of machine learning tasks such as natural language processing (Wen…
Recurrent Neural Network (RNN) has been successfully applied in many sequence learning problems. Such as handwriting recognition, image description, natural language processing and video motion analysis. After years of development, researchers have improved the internal structure of the RNN and introduced many variants…
Paper compares GRU and LSTM for predicting wildfire spread direction.
problem Predicting wildfire spread direction with limited data.
method Comparison of Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) networks.
result GRU performs better for longer time series than LSTM.
Neural networks predict US recessions with SHAP method.
problem Forecasting US recessions using machine learning.
method Long short-term memory (LSTM) and gated recurrent unit (GRU) models compared to linear models. SHAP method applied for interpretation.
result Neural networks can capture business cycle asymmetries and nonlinearities.
Improved GRU model with multi-head cross-attention enhances stock prediction accuracy.
problem Inaccurate stock prediction due to complex market dynamics and data sparsity.
method Enhanced GRU with multi-head cross-attention for better historical information selection and latent market state learning.
result The proposed MCI-GRU model outperforms state-of-the-art techniques in multiple metrics.
A major contributing factor to the recent advances in deep neural networks is structural units that let sensory information and gradients to propagate easily. Gating is one such structure that acts as a flow control. Gates are employed in many recent state-of-the-art recurrent models such as LSTM and GRU, and feedforwa…
Sophisticated gated recurrent neural network architectures like LSTMs and GRUs have been shown to be highly effective in a myriad of applications. We develop an un-gated unit, the statistical recurrent unit (SRU), that is able to learn long term dependencies in data by only keeping moving averages of statistics. The SR…
False Data Injection Attacks in Internet of Things and Deep Learning enabled Predictive Analyticscs.LG
This paper shows how cyber-attacks can undermine predictive maintenance systems.
problem Cyber-attacks on IoT sensors and DL algorithms in predictive maintenance systems.
method Used LSTM, GRU, and CNN for RUL prediction; modeled false data injection attacks; evaluated impact on accuracy and resilience.
result False data injection attacks can severely impact RUL prediction, but GRU-based models are more resilient.
Long-term investors, different from short-term traders, focus on examining the underlying forces that affect the well-being of a company. They rely on fundamental analysis which attempts to measure the intrinsic value an equity. Quantitative investment researchers have identified some value factors to determine the cos…
This paper describes the participation of Amobee in the shared sentiment analysis task at SemEval 2018. We participated in all the English sub-tasks and the Spanish valence tasks. Our system consists of three parts: training task-specific word embeddings, training a model consisting of gated-recurrent-units (GRU) with …
TGNN4I model forecasts irregularly observed graph data using ODEs.
problem Forecasting graph-structured data with irregular time steps and partial observations.
method Introduces a time-continuous latent state in each node using ODEs and GRUs, integrating graph neural network layers.
result Validated usefulness of graph structure and time-continuous dynamics in irregular observation settings.
Convolutional neural networks (CNNs) attained a good performance in hyperspectral sensing image (HSI) classification, but CNNs consider spectra as orderless vectors. Therefore, considering the spectra as sequences, recurrent neural networks (RNNs) have been applied in HSI classification, for RNNs is skilled at dealing …
Paper proposes a deep learning model to predict stock prices using sentiment analysis.
problem Predicting future stock movement using financial textual and numerical data.
method A blending ensemble deep learning model with two levels of RNNs, LSTM, and GRU followed by a fully connected neural network.
result The model improves prediction accuracy compared to traditional methods.
Distribution feeder long-term load forecast (LTLF) is a critical task many electric utility companies perform on an annual basis. The goal of this task is to forecast the annual load of distribution feeders. The previous top-down and bottom-up LTLF methods are unable to incorporate different levels of information. This…
Hybrid GARCH-GRU model improves volatility forecasting for financial assets.
problem Improving volatility and risk forecasting for financial assets.
method Combining GARCH models with GRU neural networks.
result Hybrid models produce more accurate volatility forecasts.
A new framework combines CNN and GRU for better structural damage detection.
problem Improving damage detection in structural engineering using machine learning.
method Hierarchical CNN and Gated Recurrent Unit (GRU) framework to model spatial and temporal relations.
result The proposed HCG framework significantly outperforms existing methods for structural damage detection.
Neural network predicts falls in elderly people up to 10 minutes in advance.
problem Falls prevention in elderly people, especially in aging societies.
method Gated Recurrent Unit (GRU) based neural networks model using heart rate and mean blood pressure signals.
result Predicted syncope occurrence approximately 10 minutes before manual markers.
GRU-D detects age-specific missing patterns in vital signs.
problem Temporal missingness in clinical time series data.
method Gated recurrent unit with decay mechanisms (GRU-D) trained on MIMIC-IV vital signs.
result GRU-D achieves AUROC 0.780 and AUPRC 0.810 on bootstrapped data.
Proposes GRU-ODE-Bayes for modeling irregularly observed time series.
problem Challenges of modeling sporadically observed multidimensional time series.
method Continuous-time GRU, Bayesian update network, Fokker-Planck dynamics.
result Demonstrates superior performance on synthetic and real-world data.
Process Mining consists of techniques where logs created by operative systems are transformed into process models. In process mining tools it is often desired to be able to classify ongoing process instances, e.g., to predict how long the process will still require to complete, or to classify process instances to diffe…
This study improves stock investment strategies using advanced neural networks.
problem Improving stock investment strategies for better performance.
method Used LSTM-GRU neural networks combined with SVM for stock prediction.
result LSTM-GRU outperformed benchmarks in stock predictions.
Enhances spoken speech quality using EEG signals.
problem Improves speech clarity in noisy environments.
method Generative adversarial network (GAN), gated recurrent unit (GRU), temporal convolutional network (TCN) regression models.
result Significant improvement in speech enhancement quality compared to traditional methods.
Training recurrent neural networks (RNNs) on long sequence tasks is plagued with difficulties arising from the exponential explosion or vanishing of signals as they propagate forward or backward through the network. Many techniques have been proposed to ameliorate these issues, including various algorithmic and archite…
The paper proposes a SeqGAN model to generate balanced log messages for anomaly detection.
problem Imbalanced log data makes anomaly detection difficult.
method SeqGAN for generating balanced log messages, Autoencoder for feature extraction, GRU for anomaly detection.
result Oversampling and balancing data improves anomaly detection accuracy.
Study enhances neural network predictions for wave height using topological features.
problem Challenges in predicting wave heights due to short-term and long-term factors.
method Hybridization of persistent homology with neural networks for feature engineering.
result Significant improvements in score and reductions in errors for various neural network models.
Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a.…
The vulnerability to adversarial attacks has been a critical issue for deep neural networks. Addressing this issue requires a reliable way to evaluate the robustness of a network. Recently, several methods have been developed to compute for neural networks, namely, certified lower b…
Time-Aware Gated Recurrent Unit Networks for Road Surface Friction Prediction Using Historical Datacs.LG
Study proposes GRU-D networks for missing value handling in road surface friction prediction.
problem Missing values in road surface friction data affect prediction accuracy.
method Gated Recurrent Unit (GRU) network with decay mechanism.
result GRU-D networks outperform baseline models in road surface friction prediction.
Unified GARCH-NN models improve financial volatility forecasting.
problem Improving financial volatility forecasting accuracy and efficiency.
method Embedding GARCH dynamics within recurrent neural networks (GRU and LSTM).
result Unified GARCH-NN models outperform classical GARCH and hybrid methods.
The paper uses GRU and self-attention for SPY option pricing.
problem Precise prediction of SPY option prices for better investment decisions.
method Partitioned dataset, built four models, used SHAP for interpretation.
result Self-attention GRU model outperforms traditional models.
Successful recurrent models such as long short-term memories (LSTMs) and gated recurrent units (GRUs) use ad hoc gating mechanisms. Empirically these models have been found to improve the learning of medium to long term temporal dependencies and to help with vanishing gradient issues. We prove that learnable gates in a…
A model combines GRU-D for missing data and Neural ODEs for time series continuity.
problem Challenges of informative missingness in multivariate time series data.
method Combines GRU-D for missing data imputation and Neural ODEs for temporal continuity.
result Demonstrates improved performance on a time series classification task.
Time series forecasting is difficult. It is difficult even for recurrent neural networks with their inherent ability to learn sequentiality. This article presents a recurrent neural network based time series forecasting framework covering feature engineering, feature importances, point and interval predictions, and for…
Recurrent Neural Networks (RNNs) with sophisticated units that implement a gating mechanism have emerged as powerful technique for modeling sequential signals such as speech or electroencephalography (EEG). The latter is the focus on this paper. A significant big data resource, known as the TUH EEG Corpus (TUEEG), has …