A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
DRew dynamically rewires message passing to improve long-range tasks.
Improved Mamba model for long-range sequence tasks.
Improved GNN handles long-range dependencies in multi-relational graphs.
New neural model processes 2D data with long-range dependencies efficiently.
Introduces Spectral Attention for better long-range time series forecasting.
We present the Compressive Transformer, an attentive sequence model which compresses past memories for long-range sequence learning. We find the Compressive Transformer obtains state-of-the-art language modelling results in the WikiText-103 and Enwik8 benchmarks, achieving 17.1 ppl and 0.97 bpc respectively. We also fi…
HGNet improves GNNs' ability to handle long-range interactions in graphs.
D-LinOSS models learn to dissipate energy, improving performance on long-range tasks.
IGNN captures long-range graph dependencies using fixed-point equations.
SSMs have a built-in bias towards low-frequency components, which can be adjusted.
Graph neural networks struggle to propagate long-range information, causing over-squashing.
Persistent homology enhances graph classification by capturing long-range graph properties.
Graph algorithms are key tools in many fields of science and technology. Some of these algorithms depend on propagating information between distant nodes in a graph. Recently, there have been a number of deep learning architectures proposed to learn on undirected graphs. However, most of these architectures aggregate i…
We present the mixture-of-parents maximum entropy Markov model (MoP-MEMM), a class of directed graphical models extending MEMMs. The MoP-MEMM allows tractable incorporation of long-range dependencies between nodes by restricting the conditional distribution of each node to be a mixture of distributions given the parent…
Transformer model improves source code summarization.
This paper looks into the analysis of the long-range auto-correlations and cross-correlations in bond market. Based on Detrended Moving Average (DMA) method, empirical results present a clear evidence of long-range persistence that exists in one year scale. The degree of long-range correlation related to maturities has…
Combines PCA and message passing for better graph node embeddings.
Rough Transformers improve efficiency for medical time-series data.
Research on long-range memory in financial and social systems using various models.
A new method uses burst and inter-burst duration to test long-range memory in financial markets.
Prediction and interpolation for long-range video data involves the complex task of modeling motion trajectories for each visible object, occlusions and dis-occlusions, as well as appearance changes due to viewpoint and lighting. Optical flow based techniques generalize but are suitable only for short temporal ranges. …
Transformers improve time series modeling by capturing long-range dependencies.
Transformers can perform well with less long-range memory.
Cohesion uses deep Koopman operators to generate long-range forecasts of chaotic dynamics.
A main theoretical interest in biology and physics is to identify the nonlinear dynamical system (DS) that generated observed time series. Recurrent Neural Networks (RNNs) are, in principle, powerful enough to approximate any underlying DS, but in their vanilla form suffer from the exploding vs. vanishing gradients pro…
HGConv uses HRR to efficiently detect malware, outperforming existing methods.
Paper proposes an active learning method for surgical workflow recognition using long-range temporal dependency.
Spatial and time-dependent data is of interest in many applications. This task is difficult due to its complex spatial dependency, long-range temporal dependency, data non-stationarity, and data heterogeneity. To address these challenges, we propose Forecaster, a graph Transformer architecture. Specifically, we start b…
HC-GNN tackles long-range graph information and high-order neighbourhoods.
pLSTM tackles long-range language modeling and computer vision tasks with parallelizable linear source transition mark networks.
Autoregressive generative models consistently achieve the best results in density estimation tasks involving high dimensional data, such as images or audio. They pose density estimation as a sequence modeling task, where a recurrent neural network (RNN) models the conditional distribution over the next element conditio…
Learning representations that accurately capture long-range dependencies in sequential inputs -- including text, audio, and genomic data -- is a key problem in deep learning. Feed-forward convolutional models capture only feature interactions within finite receptive fields while recurrent architectures can be slow and …
We investigate how simultaneously recorded long-range power-law correlated multi-variate signals cross-correlate. To this end we introduce a two-component ARFIMA stochastic process and a two-component FIARCH process to generate coupled fractal signals with long-range power-law correlations which are at the same time lo…
Characterizing temporal dependence patterns is a critical step in understanding the statistical properties of sequential data. Long Range Dependence (LRD) --- referring to long-range correlations decaying as a power law rather than exponentially w.r.t. distance --- demands a different set of tools for modeling the unde…
Hierarchical decoupling improves sample efficiency for complex robots.
Novel graph neural network combines random walks with local message passing.
Fractal analysis is carried out on the stock market indices of seven European countries and the US. We find evidence of long range dependence in the log return series of the Mibtel (Italy) and the PX Glob (Czech Republic). Long range dependence implies that predictable patterns in the log returns do not dissipate quick…
Novel neural network layer improves long-range interactions in point clouds.
This paper studies the dynamics of Brazilian interest rates for short-term maturities. The paper employs developed techniques in the econophysics literature and tests for long-range dependence in the term structure of these interest rates for the last decade. Empirical results suggest that the degree of long-range depe…
This paper presents empirical evidence using recently developed techniques in econophysics suggesting that the degree of long-range dependence in interest rates depends on the conduct of monetary policy. We study the term structure of interest rates for the US and find evidence that global Hurst exponents change dramat…
This study uses moving average cluster entropy to analyze financial market dynamics.
We introduce a new method for detection of long-range cross-correlations and multifractality - multifractal height cross-correlation analysis (MF-HXA) - based on scaling of qth order covariances. MF-HXA is a bivariate generalization of the height-height correlation analysis of Barabasi & Vicsek [Barabasi, A.L., Vicsek,…
Realistic music generation is a challenging task. When building generative models of music that are learnt from data, typically high-level representations such as scores or MIDI are used that abstract away the idiosyncrasies of a particular performance. But these nuances are very important for our perception of musical…
S4 model improves long sequence modeling efficiency.
We propose a new method (implemented in an R-program) to simulate long-range daily stock-price data. The program reproduces various stylized facts much better than various parametric models from the extended GARCH-family. In particular, the empirically observed changes in unconditional variance are truthfully mirrored …
New model captures long-range patterns in sequences efficiently.
Long-range correlation in financial time series reflects the complex dynamics of the stock markets driven by algorithms and human decisions. Our analysis exploits ultra-high frequency order book data from NASDAQ Nordic over a period of three years to numerically estimate the power-law scaling exponents using detrended …
New model incorporates long-range dependence in mortality rates for better valuation and risk management.