Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

1.9%3.7%5.6%7.5% · Jun 202019922001200920172026
48 results for Hybrid Attention

Hybrid model predicts flow and pressure in water systems.

problem Predicting flow and pressure in water distribution systems with complex spatial-temporal correlations.
method Hybrid dual-stage spatial-temporal attention-based recurrent neural networks (hDS-RNN).
result Our model outperformed 9 baseline models in flow and pressure series prediction.

Hybrid model integrates GATv2 and geostatistics for better spatial prediction and uncertainty.

problem Accurate spatial prediction and uncertainty quantification in epidemiology and risk analysis.
method Integrates Graph Attention Network (GATv2) with model-based geostatistics (MBG) to capture relational and spatial dependencies.
result Hybrid model improves predictive accuracy and uncertainty quantification compared to standalone models.

DanSmp predicts stock movement using a hybrid-relational MKG and dual attention networks.

problem Predicting stock price trends in volatile financial markets.
method Constructs a bi-typed MKG with hybrid-relations and uses DanSmp, a dual attention network, to learn momentum spillover signals.
result DanSmp improves stock prediction accuracy using the MKG.

LNUCB-TA improves MAB performance by dynamically adjusting exploration rates and recognizing spatiotemporal patterns.

problem Suboptimal performance in environments with rapidly changing reward structures and static exploration rates.
method Hybrid model combining linear and nonlinear estimation, with adaptive k-NN for temporal attention.
result Significantly outperforms state-of-the-art algorithms in cumulative and mean reward, convergence, and robustness.

The study improves Bitcoin price prediction using hybrid machine learning and enhances interpretability.

problem Improving Bitcoin price prediction accuracy and interpretability.
method Hybrid machine learning algorithms (OLS, LASSO, LSTM, decision tree regressors) and preprocessing techniques for time-series data.
result Linear regression achieves the best performance in predicting Bitcoin prices.

Quantum self-attention boosts automated market maker performance in crypto trading.

problem Improving automated market maker rebalancing in crypto trading.
method Quantum Adaptive Self-Attention (QASA) using variational quantum circuits and softmax attention.
result QASA-Sequence variant achieves best single-model risk-adjusted performance in crypto trading.

HAD-Net forecasts glucose levels with insights into insulin and carbs diffusion.

problem Inaccurate predictions in glucose level forecasting without context understanding.
method Hybrid model combining deep learning and physiological models, using recurrent attention network.
result Achieves competitive performance in glucose level forecasting with plausible diffusion insights.

New methods improve integration of external LMs with AED models.

problem Improving performance of AED models by integrating external LMs.
method Comparing and proposing novel methods to estimate implicit LM from AED models.
result Proposed methods outperform previous approaches.

Paper proposes LAHA to improve XMTC by integrating document content and label correlation.

problem Challenges in tagging documents with most relevant labels from a large label set.
method Hybrid attention deep neural network model (LAHA) that combines multi-label self-attention and adaptive fusion strategies.
result LAHA outperforms state-of-the-art methods, especially on tail labels.

A new hybrid GNN framework tackles oversmoothing in graph data.

problem Oversmoothing in graph convolutional networks limits their expressive power and generalization.
method Combines traditional GCN filters with band-pass filters defined via geometric scattering and introduces an attention framework.
result Improves expressive power and generalization of graph convolutional networks.

Hybrid models are reinterpreted as Neuro-Symbolic AI designs to quantify uncertainty and variability.

problem Limited semantic interface for comparing hybrid models across domains.
method Reinterpret hybrid models as Neuro-Symbolic AI, translating them into explicit inference function and logic-belief decomposition.
result Metrics SVR and BD quantify uncertainty and variability in hybrid models.

Hybrid approach combines transformer and Bayesian filtering for robust multiple particle tracking.

problem Challenges in tracking multiple particles in noisy scenes due to combinatorial explosion of hypotheses.
method Attention-Bayesian hybrid framework using transformer for association and Bayesian filtering for pruning hypotheses.
result Improved tracking accuracy and robustness against spurious detections.

Proposes a new metric learning method for image recognition.

problem Improving image recognition performance using learned distance representations.
method Introduces a Generalized Hybrid Metric Loss (GHM-Loss) to learn hybrid proximity features combining geometric and probabilistic spaces.
result Demonstrates superior performance compared to existing methods on public datasets.

Proposes a deep hybrid model for better recommendation systems.

problem Limited studies on hybrid recommender systems and the need for more advanced approaches.
method Integrates deep learning with ID embeddings and auxiliary features for improved recommendation.
result Improves recommendation results over deep learning models using ID embeddings.

SAINT improves neural networks for tabular data with row attention and contrastive pre-training.

problem Tabular data challenges in machine learning applications.
method SAINT combines row and column attention with contrastive self-supervised pre-training.
result SAINT outperforms previous deep learning methods and even gradient boosting methods on benchmark tasks.

AuON is a linear-time optimizer that improves upon Muon's performance without approximate orthogonal matrices.

problem High memory and computational costs of orthogonal momentum updates.
method AuON uses normalized nonlinear scaling and a 'emergency brake' to handle exploding attention logits.
result AuON achieves strong performance without approximate orthogonal matrices, preserving structural alignment and reconditioning.

Intelligent Momentum Transformer outperforms traditional trading strategies.

problem Improving time-series momentum and mean-reversion trading strategies.
method Attention-based deep-learning architecture (Momentum Transformer) combining attention and LSTM.
result Momentum Transformer outperforms benchmarks and adapts to new market regimes.

MAGIC generates image collages from set templates using attention and set representations.

problem Generating image collages from set templates is challenging for classical models.
method Memory Attentive Generation of Image Collages (MAGIC) using Set-Transformer layers and set-pooling.
result MAGIC can generate image collages from set templates in one forward pass.

A new model uses attention and Gaussian processes for efficient time-series generation.

problem Computational inefficiency and uncertainty underestimation in sequence transduction.
method Attention-based Gaussian process network for real-valued sequence generation.
result The model improves training efficiency and learns factorized generative distribution.

Paper forecasts stock correlations using a hybrid model combining graph neural networks and transformers.

problem Improving stock correlation forecasts for better portfolio management.
method Hybrid model combining Transformer and graph attention networks for forecasting residual deviations from historical data.
result The hybrid model reduces correlation forecasting error compared to rolling-window estimates.

CLVSA predicts financial market trends using LSTM and attention mechanisms.

problem Predicting trends in financial markets due to complex interactions.
method Hybrid model combining LSTM, sequence-to-sequence, attention, and convolutional LSTM.
result CLVSA outperforms basic models in predicting financial market trends.

Memory networks are neural networks with an explicit memory component that can be both read and written to by the network. The memory is often addressed in a soft way using a softmax function, making end-to-end training with backpropagation possible. However, this is not computationally scalable for applications which …

2016-05-24abs ↗pdf ↗

HANET combines LSTM and attention mechanisms for better financial forecasting.

problem Lack of distinct macroeconomic regimes in financial datasets.
method Hierarchical Cross-Attention mechanism integrating long-run macro contexts with high-frequency market dynamics.
result HANET outperforms neural forecasters, especially during turbulent periods.

AI model predicts stock prices using social media data and hybrid neural networks.

problem Predicting stock price movements during the COVID-19 pandemic.
method Integrates social media trends and historical stock data using a hybrid CNN-BLSTM framework.
result The proposed framework outperforms traditional models in predicting stock price movements.

Paper proposes deep learning model for dynamic stock repurchase forecasting.

problem Complex temporal dependencies in corporate financial conditions.
method Hybrid Temporal Convolutional Network (TCN) and Attention-based LSTM.
result Model significantly outperforms static baselines in stock repurchase forecasting.

A new system detects and classifies defects in semiconductor manufacturing.

problem Detecting and classifying novel defect patterns in high-resolution imagery.
method Stacked hybrid convolutional neural networks (SH-CNN) with visual attention.
result SH-CNN outperforms current approaches in automated visual inspection.

Study predicts stock transaction durations using LSTM and attention mechanism.

problem Estimating the probability density function of transaction durations in financial markets.
method Proposes a hybrid model combining LSTM networks and attention mechanism to extend ACD model.
result Demonstrates superior performance of the hybrid model on large-scale financial data.

CATA++ improves scientific article recommendations by learning latent spaces with attention.

problem Natural data sparsity limits MF performance in recommender systems.
method CATA++ uses a dual autoencoder with attention to learn latent spaces from content and contextual information.
result CATA++ significantly improves MF performance on real-world datasets.

Enhanced Momentum Transformer outperforms traditional trading strategies.

problem Improving trading performance in equities with evolving market conditions.
method Building a Momentum Transformer using an attention mechanism combined with LSTM, capturing long-term dependencies and transaction costs.
result Average returns of 4.14% and Sharpe ratio of 1.12, similar to original results but with higher volatility.

As an effective data preprocessing step, feature selection has shown its effectiveness to prepare high-dimensional data for many machine learning tasks. The proliferation of high di-mension and huge volume big data, however, has brought major challenges, e.g. computation complexity and stability on noisy data, upon exi…

2019-02-28abs ↗pdf ↗

Hybrid Deep Embedding for aspect-level explanations in recommendations.

problem Challenges in personalization, dynamic explanations, and aspect-level granularity in recommendation systems.
method Proposes Hybrid Deep Embedding (HDE) to learn dynamic embeddings for user and item preferences, and aspect-level quality vectors.
result Demonstrates improved recommending performance and dynamic aspect-level explanations.

Improved robustness in ASR systems with speaker adaptation.

problem Improving robustness in automatic speech recognition systems.
method Weighted-Simple-Add method for adding weighted speaker information vectors to the conformer-based acoustic model.
result Achieved 11% relative improvement in WER on Switchboard 300h Hub5'00 dataset.

Defines non-parabolic curves in spatial hybrid space with applications.

problem Defining and analyzing non-parabolic spatial hybrid framed curves.
method Definition and proof of existence and uniqueness theorem for non-parabolic spatial hybrid framed curves.
result Existence and uniqueness theorem for non-parabolic spatial hybrid framed curves.