Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

72144215287 · Jun 202019922001200920172026
48 results for GRU loss

Recurrent Neural Network (RNN) has been successfully applied in many sequence learning problems. Such as handwriting recognition, image description, natural language processing and video motion analysis. After years of development, researchers have improved the internal structure of the RNN and introduced many variants…

2018-10-30abs ↗pdf ↗

The paper evaluates three variants of the Gated Recurrent Unit (GRU) in recurrent neural networks (RNN) by reducing parameters in the update and reset gates. We evaluate the three variant GRU models on MNIST and IMDB datasets and show that these GRU-RNN variant models perform as well as the original GRU RNN model while…

2017-01-20abs ↗pdf ↗

TGNN4I model forecasts irregularly observed graph data using ODEs.

problem Forecasting graph-structured data with irregular time steps and partial observations.
method Introduces a time-continuous latent state in each node using ODEs and GRUs, integrating graph neural network layers.
result Validated usefulness of graph structure and time-continuous dynamics in irregular observation settings.

GRU models with Adam optimizer outperform other combinations in stock market forecasting.

problem Comparing optimization techniques for time series forecasting in LSTM and GRU networks.
method Examined Adam and Nesterov Accelerated Gradient (NAG) on LSTM and GRU models for stock market forecasting.
result GRU models with Adam optimizer produced the lowest RMSE and outperformed other combinations.

Improved GRU model with multi-head cross-attention enhances stock prediction accuracy.

problem Inaccurate stock prediction due to complex market dynamics and data sparsity.
method Enhanced GRU with multi-head cross-attention for better historical information selection and latent market state learning.
result The proposed MCI-GRU model outperforms state-of-the-art techniques in multiple metrics.

We examine the algebraic and geometric properties of a uni-directional GRU and word embeddings trained end-to-end on a text classification task. A hyperparameter search over word embedding dimension, GRU hidden dimension, and a linear combination of the GRU outputs is performed. We conclude that words naturally embed t…

2018-03-07abs ↗pdf ↗

LSTMs and GRUs are the most common recurrent neural network architectures used to solve temporal sequence problems. The two architectures have differing data flows dealing with a common component called the cell state (also referred to as the memory). We attempt to enhance the memory by presenting a modification that w…

2018-08-04abs ↗pdf ↗

GRU-PFG model extracts inter-stock correlations from stock factors using graph neural networks.

problem Limited effectiveness of models relying solely on stock factors for capturing stock correlations.
method Project stock factors into a graph and use graph neural networks to extract inter-stock correlations.
result Achieves better prediction results than models relying solely on stock factors and comparable to second category models.

Detecting and aggregating sentiments toward people, organizations, and events expressed in unstructured social media have become critical text mining operations. Early systems detected sentiments over whole passages, whereas more recently, target-specific sentiments have been of greater interest. In this paper, we pres…

2019-02-08abs ↗pdf ↗

This paper compares LSTM, GRU, and Transformer models for stock price prediction.

problem Improving stock price prediction accuracy in fast-paced financial markets.
method Training models on Tesla stock data from 2015 to 2024, comparing LSTM, GRU, and Transformer.
result LSTM model achieved 94% accuracy in predicting stock prices.

There is growing interest in being able to run neural networks on sensors, wearables and internet-of-things (IoT) devices. However, the computational demands of neural networks make them difficult to deploy on resource-constrained edge devices. To meet this need, our work introduces a new recurrent unit architecture th…

2019-02-13abs ↗pdf ↗

Sophisticated gated recurrent neural network architectures like LSTMs and GRUs have been shown to be highly effective in a myriad of applications. We develop an un-gated unit, the statistical recurrent unit (SRU), that is able to learn long term dependencies in data by only keeping moving averages of statistics. The SR…

2017-03-01abs ↗pdf ↗

Paper addresses LSTM stability for thermal systems using infinity-norm.

problem Stability of LSTM networks in thermal systems.
method Derived ISS_{\infty} condition for LSTM, developed training strategy.
result ISS_{\infty}-promoted LSTM outperforms other models in thermal system case study.

Gating is a key feature in modern neural networks including LSTMs, GRUs and sparsely-gated deep neural networks. The backbone of such gated networks is a mixture-of-experts layer, where several experts make regression decisions and gating controls how to weigh the decisions in an input-dependent manner. Despite having …

2019-06-06abs ↗pdf ↗

In this paper we examine a possible reason for the LSTM outperforming the GRU on language modeling and more specifically machine translation. We hypothesize that this has to do with counting. This is a consistent theme across the literature of long term dependence, counting, and language modeling for RNNs. Using the si…

2018-10-29abs ↗pdf ↗

A model combines GRU-D for missing data and Neural ODEs for time series continuity.

problem Challenges of informative missingness in multivariate time series data.
method Combines GRU-D for missing data imputation and Neural ODEs for temporal continuity.
result Demonstrates improved performance on a time series classification task.

A new framework combines CNN and GRU for better structural damage detection.

problem Improving damage detection in structural engineering using machine learning.
method Hierarchical CNN and Gated Recurrent Unit (GRU) framework to model spatial and temporal relations.
result The proposed HCG framework significantly outperforms existing methods for structural damage detection.

A major contributing factor to the recent advances in deep neural networks is structural units that let sensory information and gradients to propagate easily. Gating is one such structure that acts as a flow control. Gates are employed in many recent state-of-the-art recurrent models such as LSTM and GRU, and feedforwa…

2016-08-11abs ↗pdf ↗

DeepCausalMMM models marketing impacts using deep learning and causal inference.

problem Traditional MMM approaches struggle with non-linear dynamics and temporal patterns.
method Combines deep learning, causal inference, and marketing science. Uses GRUs for temporal patterns and DAG structure for channel dependencies.
result Captures non-linear dynamics and temporal patterns in marketing impacts.

Training recurrent neural networks (RNNs) on long sequence tasks is plagued with difficulties arising from the exponential explosion or vanishing of signals as they propagate forward or backward through the network. Many techniques have been proposed to ameliorate these issues, including various algorithmic and archite…

2019-01-25abs ↗pdf ↗

Successful recurrent models such as long short-term memories (LSTMs) and gated recurrent units (GRUs) use ad hoc gating mechanisms. Empirically these models have been found to improve the learning of medium to long term temporal dependencies and to help with vanishing gradient issues. We prove that learnable gates in a…

2018-03-23abs ↗pdf ↗

Process Mining consists of techniques where logs created by operative systems are transformed into process models. In process mining tools it is often desired to be able to classify ongoing process instances, e.g., to predict how long the process will still require to complete, or to classify process instances to diffe…

2018-09-16abs ↗pdf ↗