Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

63126189252 · Jun 202019922001200920172026
48 results for Temporal Attention LSTM

In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks mostly focuses on the temporal aspect of data and falls short of characterizing variable importance. To …

2018-06-17abs ↗pdf ↗

As one of the important functions of the intelligent transportation system (ITS), supply-demand prediction for autonomous vehicles provides a decision basis for its control. In this paper, we present two prediction models (i.e. ARLP model and Advanced ARLP model) based on two system environments that only the current d…

2019-05-27abs ↗pdf ↗

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies, its ability to pay different degree of attention on sub-window feature within mu…

2018-11-09abs ↗pdf ↗

Realistic music generation has always remained as a challenging problem as it may lack structure or rationality. In this work, we propose a deep learning based music generation method in order to produce old style music particularly JAZZ with rehashed melodic structures utilizing a Bi-directional Long Short Term Memory…

2020-02-06abs ↗pdf ↗

FAL improves formation resistivity prediction from cased boreholes with noise resistance.

problem Noise and high-frequency disaster in predicting formation resistivity from cased boreholes.
method Frequency-aware framework and temporal anti-noise block for LSTM.
result FAL achieves a 24.3% improvement in R2 over LSTM, reaching R2=0.91.

Proposes a dynamic model for urban traffic volume prediction.

problem Urban traffic volume prediction for better traffic management and driver planning.
method Combines bidirectional LSTM, attention mechanism, and external features.
result Improves prediction precision by 3-7 percent on NYC-Taxi and NYC-Bike datasets.

Inspired by the observation that humans are able to process videos efficiently by only paying attention where and when it is needed, we propose an interpretable and easy plug-in spatial-temporal attention mechanism for video action recognition. For spatial attention, we learn a saliency mask to allow the model to focus…

2018-10-01abs ↗pdf ↗

Paper introduces a conformer-based system for streaming language identification in long-form speech.

problem Language identification in long-form audio.
method Conformer layers with attentive temporal pooling and domain adaptation.
result Conformer-based models significantly outperform LSTM and transformer models.

Traffic flow prediction is crucial for urban traffic management and public safety. Its key challenges lie in how to adaptively integrate the various factors that affect the flow changes. In this paper, we propose a unified neural network module to address this problem, called Attentive Crowd Flow Machine~(ACFM), which …

2018-09-01abs ↗pdf ↗

Paper proposes deep learning model for dynamic stock repurchase forecasting.

problem Complex temporal dependencies in corporate financial conditions.
method Hybrid Temporal Convolutional Network (TCN) and Attention-based LSTM.
result Model significantly outperforms static baselines in stock repurchase forecasting.

Improved traffic forecasting model handles missing data.

problem Short-term traffic forecasting with missing values.
method Proposed SBU-LSTM architecture with bidirectional and unidirectional LSTM.
result Superior performance in accuracy and robustness for network-wide traffic prediction.

Study predicts stock transaction durations using LSTM and attention mechanism.

problem Estimating the probability density function of transaction durations in financial markets.
method Proposes a hybrid model combining LSTM networks and attention mechanism to extend ACD model.
result Demonstrates superior performance of the hybrid model on large-scale financial data.

StockEmotions dataset for financial sentiment and emotion analysis.

problem Limited resources for financial sentiment analysis.
method Collects 10,000 English comments from StockTwits, categorizes emotions into 12 classes.
result DistilBERT outperforms other models in sentiment classification, and Temporal Attention LSTM model achieves best performance in multivariate time series forecasting.

Proposes a model combining difference-attention and error-correction LSTMs for improved time series prediction.

problem Improving accuracy in time series prediction.
method Combines difference-attention LSTM and error-correction LSTM in a cascade approach.
result Improves prediction accuracy in time series.

Intelligent Momentum Transformer outperforms traditional trading strategies.

problem Improving time-series momentum and mean-reversion trading strategies.
method Attention-based deep-learning architecture (Momentum Transformer) combining attention and LSTM.
result Momentum Transformer outperforms benchmarks and adapts to new market regimes.

Sensors are an integral part of modern Internet of Things (IoT) applications. There is a critical need for the analysis of heterogeneous multivariate temporal data obtained from the individual sensors of these systems. In this paper we particularly focus on the problem of the scarce amount of training data available pe…

2019-05-13abs ↗pdf ↗

In this paper, we present Gamma-LSTM, an enhanced long short term memory (LSTM) unit, to enable learning of hierarchical representations through multiple stages of temporal abstractions. Gamma memory, a hierarchical memory unit, forms the central memory of Gamma-LSTM with gates to regulate the information flow into var…

2019-10-25abs ↗pdf ↗

Paper proposes integrating wavelet transform, channel attention, and LSTM for better stock price prediction.

problem Inherently difficult stock price prediction due to low signal-to-noise ratio.
method Wavelet transform convolution, channel attention, and LSTM integration.
result Robust performance in post-pandemic market conditions.

Neural HMM with AGA captures multi-scale dynamics in financial markets.

problem Capturing multi-scale temporal dynamics in financial markets.
method Parallel multi-resolution encoders, adaptive gating, and multi-head attention.
result Outperforms fixed-resolution baselines in predicting price movements and liquidity shocks.

Recurrent neural networks can be difficult to train on long sequence data due to the well-known vanishing gradient problem. Some architectures incorporate methods to reduce RNN state updates, therefore allowing the network to preserve memory over long temporal intervals. To address these problems of convergence, this p…

2019-01-22abs ↗pdf ↗

Study improves stock price prediction using advanced ML models.

problem Improving financial forecasting accuracy in stock markets.
method Evaluation of RNN architectures including LSTM, GRU, and attention-based models.
result Attention-based models outperform others in capturing complex dependencies.

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction accuracy of NPs by incorporating attention mechanism among contexts and targets. In …

2019-10-17abs ↗pdf ↗

As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and computational resources, such as voice command recognition in vehicles and robot interact…

2019-07-10abs ↗pdf ↗

The Linear Attention Recurrent Neural Network (LARNN) is a recurrent attention module derived from the Long Short-Term Memory (LSTM) cell and ideas from the consciousness Recurrent Neural Network (RNN). Yes, it LARNNs. The LARNN uses attention on its past cell state values for a limited window size kk. The formulas ar…

2018-08-16abs ↗pdf ↗

CLVSA predicts financial market trends using LSTM and attention mechanisms.

problem Predicting trends in financial markets due to complex interactions.
method Hybrid model combining LSTM, sequence-to-sequence, attention, and convolutional LSTM.
result CLVSA outperforms basic models in predicting financial market trends.

EMDLOT predicts bond defaults better than traditional methods.

problem Lack of interpretability and irregular temporal dependencies in financial data.
method Integrates time-series and textual data, uses Time-Aware LSTM, soft clustering, and multi-level attention.
result EMDLOT outperforms traditional and deep learning benchmarks in recall, F1-score, and mAP.

Novel spatio-temporal LSTM model forecasts oceanic variables across sensors and scales.

problem Data sparsity and lack of connected spatial and temporal information in environmental datasets.
method SPATIAL LSTM architecture that learns across spatial and temporal scales.
result Framework accurately forecasts oceanic variables with comparable performance to state-of-the-art models.

Paper proposes a new LSTM model for spatio-temporal learning.

problem Challenging video tasks require learning long-term spatio-temporal correlations.
method Introduces a higher-order convolutional LSTM model with tensor train decomposition.
result Model achieves state-of-the-art performance with significantly fewer parameters.

Proposes ECLSTM for more accurate RUL estimation from time series data.

problem Predicting Remaining Useful Life (RUL) from multivariate time series data.
method Embedded Convolutional LSTM (ECLSTM) with automated hyperparameter optimization.
result ECLSTM outperforms state-of-the-art approaches on benchmark data sets.