Proposes a model combining difference-attention and error-correction LSTMs for improved time series prediction.
problem Improving accuracy in time series prediction.
method Combines difference-attention LSTM and error-correction LSTM in a cascade approach.
result Improves prediction accuracy in time series.
Bayesian Attention Networks compress data by focusing on key training samples.
problem Lossless data compression for efficiency.
method Bayesian Attention Networks with attention factors and latent space.
result Efficient prediction using a few correlated training samples.
Models use embeddings and attention for better claim severity prediction.
problem Improving predictive modeling of claim severity with categorical data.
method Developed neural networks and attention-based architectures with embeddings.
result Attention-based models enhance predictive performance with contextual augmentation.
Adapts attention to supervised learning for personalized predictions.
problem Personalized predictions for each data point with model simplicity.
method Local model fitting with attention weighting for tabular data.
result Attention weighting improves predictive performance and preserves interpretability.
Neural nets predict user attention from mouse movements.
problem Predicting user attention from mouse cursor movements.
method Investigated different mouse movement representations and trained neural networks.
result Neural networks outperform handcrafted features for predicting user attention.
Financial time series prediction, especially with machine learning techniques, is an extensive field of study. In recent times, deep learning methods (especially time series analysis) have performed outstandingly for various industrial problems, with better prediction than machine learning methods. Moreover, many resea…
Investor attention predicts global equity market volatility during Ukraine invasion.
problem Predicting global equity market volatility during geopolitical events.
method Event-specific attention indices based on Google Trends, analyzed across 51 global equity markets.
result Investor attention significantly predicts volatility in countries with higher economic openness to Russia and closer to it.
Models predict emotional valence from narratives, matching human raters.
problem Predicting emotional valence from multimodal time-series data.
method Adapted attention-based mechanisms (Transformer, Memory Fusion Network) to emotional narratives.
result Models perform well, matching human raters on emotional valence prediction.
MAT uses attention mechanism for molecule property prediction.
problem Designing a competitive neural network for molecule property prediction.
method Augmented attention mechanism using inter-atomic distances and molecular graph structure.
result MAT achieves state-of-the-art performance on diverse molecular prediction tasks.
Paper proposes integrating wavelet transform, channel attention, and LSTM for better stock price prediction.
problem Inherently difficult stock price prediction due to low signal-to-noise ratio.
method Wavelet transform convolution, channel attention, and LSTM integration.
result Robust performance in post-pandemic market conditions.
Deep learning predicts chess player attention using eye-tracking and game data.
problem Predicting chess player attention during game.
method Convolutional neural networks with skip-layer architecture and autoencoder.
result Deep features from natural images help in predicting saliency maps for chess.
Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised manner. To overcome this limitation, we introduce the notion of input-dependent unce…
This paper predicts stock prices using LLMs and news embeddings.
problem Predicting stock prices with high accuracy and relevance.
method Integrates LLMs with stock name embeddings and attention mechanisms for news filtering.
result Reduces MAE by 7.11% compared to baseline.
Graph Attention Networks predict disease state from single-cell data.
problem Predicting disease state from single-cell data.
method Graph Attention Networks (GAT) for learning from both features and graph structures.
result Achieved 92% accuracy in predicting MS from single-cell data.
HTAD predicts diagnoses from EHRs using target-aware attention.
problem Lack of specificity in aggregating clinical records for diagnosis prediction.
method Hierarchical target-attentive mechanism for EHRs.
result Target-aware attention significantly improves diagnosis prediction performance.
SurvBESA predicts survival times using ensemble methods with self-attention.
problem Challenges in survival analysis due to censored data and unstable predictions.
method SurvBESA combines Beran estimators with a self-attention mechanism to predict survival times.
result SurvBESA outperforms state-of-the-art models in predicting survival times.
Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies, its ability to pay different degree of attention on sub-window feature within mu…
News attention to financial intermediaries and crises predicts excess bond premium and macroeconomic movements.
problem Drivers of the excess bond premium (EBP).
method News attention to 180 topics captures up to 80% of EBP variation and forecasts macroeconomic movements.
result News attention to financial intermediaries and crises drives up the EBP and predicts macroeconomic downturns.
Paper uses AI to predict option volatility surfaces with improved accuracy.
problem Difficult to predict dynamic evolution of option volatility smile surface.
method Combines deep learning (LSTM) with attention mechanism.
result Predicted volatility surfaces lead to higher returns and Sharpe ratios.
KFAtt improves CTR prediction by modeling user behavior with Kalman filtering attention.
problem Improving CTR prediction in personalized e-commerce search engines.
method KFAtt combines Kalman filtering with attention mechanisms to model user behavior.
result KFAtt outperforms existing methods in CTR prediction, achieving better performance in both offline and online settings.
DSTP-RNN improves long-term multivariate time series prediction using attention-based RNN.
problem Long-term prediction of multivariate time series with spatial correlations and spatio-temporal relationships.
method Inspired by human attention mechanism, DSTP-RNN uses a dual-stage two-phase structure and multiple attentions to enhance spatial correlations and long-term dependence.
result DSTP-RNN outperforms nine baseline methods on four datasets in energy, finance, environment, and medicine.
Paper proposes a graph neural network for accurate long-term ILI prediction.
problem Limited long-term prediction performance and spatio-temporal dependency in existing models.
method Cross-location attention based graph neural network (Cola-GNN) for time series embeddings and location aware attentions.
result Proposed method shows strong predictive performance and interpretable results for long-term epidemic predictions.
New techniques improve channel prediction in noisy wireless systems.
problem Predicting channels in wireless communication systems from noisy observations.
method Adapted sequence-to-sequence models and transformers with reverse positional encoding and reversed encoder outputs.
result Improved robustness and relationship capture in channel prediction models.
TSAM predicts directed temporal links using GCN and self-attention.
problem Predicting links in directed temporal networks.
method GCN, self-attention mechanism, autoencoder architecture, graph attentional layers, graph convolutional layers, graph recurrent unit layer.
result TSAM outperforms benchmarks on four realistic networks.
Random forests with attention and self-attention improve regression performance.
problem Improving regression model performance on various datasets.
method Proposes new models using attention and self-attention mechanisms to solve regression problems.
result The models improve model performance on many datasets.
A neural network predicts drug interactions using attention mechanisms.
problem Predicting drug-drug interactions from massive combinations of drugs.
method Siamese self-attention multi-modal neural network integrating drug characteristics.
result The model achieves AUPR scores ranging from 0.77 to 0.92 on various benchmark datasets.
Two prediction models improve supply-demand forecasting for autonomous vehicles.
problem Improving accuracy and stability of supply-demand predictions for autonomous vehicles.
method Two prediction models based on residual network, LSTM, attention mechanism, and multi-attention mechanism.
result Our frameworks provide more accurate and stable prediction results than existing methods.
Proposes a time-aware attention model for CTR prediction.
problem Lack of temporal signals in existing CTR prediction models.
method Time-aware attention model with absolute and relative temporal signals, regularized adversarial sampling.
result Significantly improves CTR prediction performance.
Hybrid model predicts flow and pressure in water systems.
problem Predicting flow and pressure in water distribution systems with complex spatial-temporal correlations.
method Hybrid dual-stage spatial-temporal attention-based recurrent neural networks (hDS-RNN).
result Our model outperformed 9 baseline models in flow and pressure series prediction.
ETNA model predicts demographic attributes from transactions.
problem Predicting demographic attributes from transaction histories with limited data.
method Embedding Transformation Network with Attention (ETNA) model.
result ETNA model outperforms previous models on all tasks.
Modeling student behaviors and multiple predictions for early intervention.
problem Predicting student outcomes and interactions among multiple tasks.
method Proposes a variant of LSTM and soft-attention mechanism for heterogeneous behaviors, and co-attention mechanism for task interactions.
result Demonstrated effectiveness in predicting student outcomes and interactions.
A new LSTM architecture improves time series forecasting efficiency.
problem Efficiency and accuracy in time series forecasting using linear models.
method Attention-free LSTM architecture for time series prediction.
result Improved prediction capacity and efficiency compared to LSTM.
Attention-based embeddings improve relation prediction in incomplete KGs.
problem Incomplete or missing relations in knowledge graphs.
method Attention-based feature embedding that captures entity and relation features in local neighborhoods.
result Marked performance gains on all datasets compared to state-of-the-art methods.
Predicting highrisk vascular diseases is a significant issue in the medical domain. Most predicting methods predict the prognosis of patients from pathological and radiological measurements, which are expensive and require much time to be analyzed. Here we propose deep attention models that predict the onset of the hig…
Graph attention networks improve performance on heterogeneous graphs.
problem Complex performance of GNNs on heterogeneous graphs.
method Integrating positional encodings into graph attention networks.
result Graph attention networks excel in node classification and link prediction.
Axial-LOB predicts stock prices from LOB data using attention layers.
problem Predicting stock price from LOB data with long-range dependencies.
method Axial-LOB uses gated position-sensitive axial attention layers to incorporate global interactions.
result Axial-LOB achieves state-of-the-art performance in stock price prediction.
Attention improves edge prediction in e-commerce graphs.
problem Predicting edges in graphs from node attributes in e-commerce.
method Used attention mechanism in simple feedforward networks, derived analytically tractable model AttEST.
result Attention network outperforms LSTM architectures by over 20% on F-1 score.
Proposes new methods for interpreting document classification models.
problem Interpretation fragility of attention-based neural networks.
method Corpus-level and concept-based explanation methods using attention weights.
result Extracts semantically meaningful keywords and concepts for model predictions.
ST-SAN predicts flow with spatial-temporal dependencies using self-attention.
problem Challenges in predicting flow due to spatial-temporal dependencies.
method Spatial-Temporal Self-Attention Network (ST-SAN) that addresses temporal and spatial dependencies.
result Significant improvement in flow prediction accuracy (9% in inflow, 4% in outflow) compared to state-of-the-art methods.
Study integrates attentional and spacing factors to improve category learning models.
problem Understanding the impact of training sequences on category learning.
method Introduced a novel integration of attentional factors and spacing into logistic knowledge tracing models.
result Enhanced model predicts students' learning outcomes better than existing models.
A new method calibrates scientific models by adding randomness to their predictions.
problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.
Hybrid model predicts stock prices with high accuracy.
problem Complex volatility of stock market makes traditional models unsatisfactory.
method Attention-based CNN-LSTM and XGBoost integrated model.
result Hybrid model improves prediction accuracy.
NAK model predicts student grades by focusing on relevant past courses.
problem Accurately predicting future course grades for students.
method NAK model learns attention weights to focus on relevant past courses.
result NAK model outperforms CKRM and other methods in predicting grades.
The Nonlinear autoregressive exogenous (NARX) model, which predicts the current value of a time series based upon its previous values as well as the current and past values of multiple driving (exogenous) series, has been studied for decades. Despite the fact that various NARX models have been developed, few of them ca…
OLS predictions are shown to be similar to attention mechanisms in models.
problem OLS in traditional statistics and econometrics.
method Rewriting OLS as an attention mechanism in a transformed space.
result OLS can be understood as minimizing squared prediction errors via optimal embedding and decoding.
DanSmp predicts stock movement using a hybrid-relational MKG and dual attention networks.
problem Predicting stock price trends in volatile financial markets.
method Constructs a bi-typed MKG with hybrid-relations and uses DanSmp, a dual attention network, to learn momentum spillover signals.
result DanSmp improves stock prediction accuracy using the MKG.
Enhances stock movement prediction using Higher Order Transformers for multimodal time-series data.
problem Predicting stock movements in financial markets with complex dynamics.
method Introduced Higher Order Transformers, extending self-attention and transformer architecture to capture complex market dynamics. Employed low-rank tensor decomposition and kernel attention to manage computational complexity. Integrated technical and fundamental analysis from historical prices and tweets.
result Demonstrated effectiveness of the method on the Stocknet dataset, improving stock movement prediction.
GAT-AGNN learns stock trends using graph and attention mechanisms.
problem Predicting dynamic stock trends in a complex market.
method Sequential graph structure with attention mechanisms.
result GAT-AGNN outperforms state-of-the-art methods in stock trend prediction.