A new gradient method LAG reduces communication in distributed learning.
problem Reducing communication in distributed machine learning.
method Skip gradient calculations for slowly-varying gradients using simple rules.
result Communication reduction with theoretical and empirical support.
LAGS-SGD optimizes deep learning training by sparsifying gradients layer-wise.
problem Reduces long training times in large deep neural networks with distributed S-SGD.
method Layer-wise adaptive gradient sparsification combined with S-SGD.
result LAGS-SGD achieves convergence guarantees and outperforms vanilla S-SGD.
LASG improves communication efficiency in distributed learning.
problem Efficiently communicating gradients in distributed machine learning.
method Develops a new stochastic gradient descent approach, LASG, that predicts and selects significant communication rounds.
result Achieves communication savings by an order of magnitude in federated learning.
DOLCE improves off-policy evaluation and learning by decomposing effects.
problem Bias in off-policy evaluation and learning due to policy mismatch.
method Uses lagged contexts and a moment-based training procedure to decompose and cancel bias.
result DOLCE achieves substantial improvements in off-policy evaluation and learning.
Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as l0 regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called the LAGS, short for "least absulute gradient selector", to this challenging yet i…
Adaptive TBPTT controls gradient bias in RNNs for faster convergence.
problem Choosing optimal truncation length in TBPTT for RNNs is difficult.
method Adaptive TBPTT converts lag selection to bias control, estimating optimal truncation length during training.
result Adaptive TBPTT improves convergence rate and computational efficiency in RNNs.
Momentum SGD fails to track nonstationary optima due to drift amplification.
problem Tracking nonstationary optima in stochastic optimization.
method Theoretical analysis of SGD and momentum variants under strong convexity and smoothness.
result Momentum incurs a drift-amplification penalty that diverges as the momentum parameter approaches 1, leading to systematic lag.
Transformer-based method for causal discovery with prior knowledge integration.
problem Complex nonlinear dependencies and spurious correlations in time series data.
method Multi-layer Transformer forecaster with gradient-based causal structure extraction and attention masking for prior knowledge integration.
result Significant improvement in causal discovery and causal lag estimation compared to state-of-the-art methods.
Deep learning reveals lagged correlations in stock markets, showing accuracy decreases with shorter prediction horizons.
problem Capturing non-linear interactions in financial prediction problems using large-scale datasets.
method Applying deep learning to econometrically constructed gradients to learn and exploit lagged correlations among S&P 500 stocks.
result Model accuracies decrease with shorter prediction horizons, but remain significant in both stable and volatile markets.
New method calibrates stochastic reduced-order models from data efficiently.
problem Challenges in estimating drift and diffusion coefficients from data for high-dimensional systems.
method Uses a novel relationship between conditional score and transition density to constrain model coefficients directly from finite-lag statistics.
result Validated on various systems, the method reproduces statistical and dynamical properties of the original models.
Algorithm detects lead-lag relationships in multivariate time series.
problem Understanding temporal dependencies between time series.
method Cluster-driven methodology based on dynamic time warping.
result Robust detection of lead-lag relationships in lagged multi-factor models.
No arbitrage found with market frictions for time-lagged asset returns.
problem Existence of time-lagged cross-correlations in financial returns.
method Introduced market frictions like minimal waiting time or transaction costs.
result No arbitrage possible with market frictions.
Detects lead-lag clusters in US equity market time series.
problem Identifying lead-lag relationships in multivariate time series.
method Directed network clustering of lead-lag relationships.
result Validated on US equity market data, detects statistically significant lead-lag clusters.
Deep learning methods improve time series forecasting by optimizing lag selection.
problem Optimizing the number of lags for accurate univariate time series forecasting.
method Empirical analysis of deep learning methods trained on multiple time series datasets.
result Excessively small or large lag sizes negatively impact forecasting performance.
A new wavelet method for analyzing lead-lag effects between financial assets.
problem Analyzing lead-lag relationships between financial assets.
method Wavelet-based framework bridging continuous-time and discrete-time models.
result Developed an asymptotic theory for multi-scale analysis of lead-lag effects.
We develop methods to estimate lag and parameters for multiple stable autoregressive processes.
problem Estimating lag and parameters for multiple stable autoregressive processes with unknown lag.
method Use convex programming to simultaneously select lag and estimate parameters across multiple processes.
result The estimated process is stable, and forecasting errors can outperform known rates.
NAPLES resolves lead-lag analysis challenges in non-synchronous high-frequency data.
problem Challenges in analyzing lead-lag effects due to non-synchronous observations and high-frequency data.
method NAPLES (Negative And Positive lead-lag EStimator) resolves these challenges.
result NAPLES has a strong correlation with actual lead-lag effects, including those triggered by macroeconomic announcements.
Method detects lead-lag relationships in multivariate time series.
problem Discovering lead-lag relationships in multivariate time series.
method Clustering-driven methodology using sliding window and various clustering techniques.
result Robust lead-lag estimates across clusters enhance consistent relationships identification.
Modeling delayed Granger causality in Hawkes processes.
problem Capturing the time lag between causal events in multivariate Hawkes processes.
method Proposed a Hawkes process model with latent time lags, using Variational Auto-Encoder (VAE) for inference.
result Identified and inferred time lags with posterior distributions, improving event prediction and root cause analysis.
The study finds that factor momentum is significant only at short lags compared to stock momentum.
problem Investigating the relationship between factor momentum and stock momentum.
method Replicated earlier findings and conducted a spanning test controlling for stock momentum and factor exposure.
result Factor momentum is significant only at short lags after controlling for stock momentum and factor exposure.
Study lead-lag relationships in foreign exchange markets using three approaches.
problem Lack of research on lead-lag relationships in foreign exchange markets.
method Three approaches: lagged correlations, lagged partial correlations, and Granger causality.
result Statistically significant lead-lag relationships found in some exchange rate pairs.
Novel framework detects lead-lag relationships in Chinese A-share market.
problem Detecting lead-lag relationships in the Chinese A-share market.
method Two-stage framework: long-term coupling via correlation, dynamic time warping, and rank-based metrics; high-frequency data analysis via cross-correlation, Granger causality, and regression models.
result Strongly coupled stock pairs often exhibit lead-lag effects, especially at finer time scales.
New method selects stock pairs for pairs trading considering lead-lag relationship.
problem Identifying best stock pairs for pairs trading considering lead-lag relationship.
method Proposes a new distance measure incorporating lead-lag relationship.
result Selected pairs consistently generate best profit compared to other measures.
Abstract: A new approach to technical indicators without lag.
problem Defining classical technical indicators as bounded operators for lag-free trading.
method Using linear algebra to redefine technical indicators as bounded operators in l∞(N) space. result Demonstrated the no-lag versions of technical indicators are simpler and more effective.
Study reveals lead-lag patterns between onshore and offshore RMB exchange rates.
problem Understanding the lead-lag relationship between onshore and offshore RMB exchange rates.
method Employed the thermal optimal path method to analyze daily and minute-scale data.
result Lead-lag patterns are influenced by market factors and US dollar appreciation.
New method for estimating lead-lag times between non-synchronously observed point processes.
problem Estimating lead-lag relationships between non-synchronously observed point processes.
method Formulate lead-lag estimation as CPCF shape estimation; propose kernel density estimation-based lead-lag time estimator.
result Proposed method delivers superior numerical performance and effective lead-lag time estimation.
Vector autoregression (VAR) is a fundamental tool for modeling multivariate time series. However, as the number of component series is increased, the VAR model becomes overparameterized. Several authors have addressed this issue by incorporating regularized approaches, such as the lasso in VAR estimation. Traditional a…
Estimates lead-lag relationships in high-frequency financial markets without interpolation.
problem Lag relationships in high-frequency financial markets with non-synchronous data.
method Proposes a novel estimation procedure for scale-by-scale lead-lag relationships.
result Identifies two types of lead-lag relationships at different time scales.
New technique identifies lead-lag relationships in FX market during pandemic.
problem Identifying lead-lag relationships in financial markets, especially during crises.
method Dynamic Programming technique for finding optimal lead-lag path, using a loose metric.
result The proposed technique gives the best results in identifying statistically significant paths and closest forecasts.
This study examines lead-lag relationships in Chinese futures markets using high-frequency data.
problem Understanding high-frequency trading dynamics and information flow in futures markets.
method High-frequency tick-by-tick data analysis of lead-lag relationships between different maturity futures contracts.
result The near-month futures lead longer-dated contracts by one tick, with a negative feedback effect on the leading asset.
Clusters asset classes to identify lead-lag relationships in market regimes.
problem Understanding lead-lag relationships between different asset classes.
method Defining macroeconomic regimes by clustering indices and investigating lead-lag relationships.
result Unravels market features and highlights informative market trends or risks.
We present the symmetric thermal optimal path (TOPS) method to determine the time-dependent lead-lag relationship between two stochastic time series. This novel version of the previously introduced TOP method alleviates some inconsistencies by imposing that the lead-lag relationship should be invariant with respect to …
Optimal exercise boundary for put options with delivery lags identified.
problem Analyzing the optimal exercise time for American put options with delivery lags.
method Decomposing the option into a European put and a new American-style derivative, using free boundary techniques.
result The optimal exercise boundary exists and is a strictly increasing and smooth curve.
We study the probability distribution of stock returns at mesoscopic time lags (return horizons) ranging from about an hour to about a month. While at shorter microscopic time lags the distribution has power-law tails, for mesoscopic times the bulk of the distribution (more than 99% of the probability) follows an expon…
One popular approach for nonstructural economic and financial forecasting is to include a large number of economic and financial variables, which has been shown to lead to significant improvements for forecasting, for example, by the dynamic factor models. A challenging issue is to determine which variables and (their)…
Proposes a continuous flow model to understand and control instability in gradient descent for deep learning.
problem Understanding and controlling the instability of gradient descent in deep learning.
method Introduces the Principal Flow (PF), a continuous time flow that approximates gradient descent dynamics.
result The PF captures divergent and oscillatory behaviors of gradient descent, including escaping local minima and saddle points.
The study predicts trader actions and price movements in forex markets using lead-lag networks.
problem Predicting trader behavior and price movements in foreign exchange markets.
method Infer lead-lag networks from trader-resolved data in the foreign exchange market.
result Trader actions and price movements can be predicted from past prices and trader behavior.
Financial markets worldwide do not have the same working hours. As a consequence, the study of correlation or causality between financial market indices becomes dependent on wether we should consider in computations of correlation matrices all indices in the same day or lagged indices. The answer this article proposes …
In our previous study we have presented an approach to studying lead--lag effect in financial markets using information and network theories. Methodology presented there, as well as previous studies using Pearson's correlation for the same purpose, approached the concept of lead--lag effect in a naive way. In this pape…
Methodology to measure lag relevance in time series models.
problem Measuring lag relevance in machine learning models for univariate time series.
method Ghost variables, Shapley values, additive importance measures, auto-relevance and partial auto-relevance functions, one-step forecast.
result Calculated relevance measures successfully demonstrate expected lag structure in almost all cases.
The study finds a time lag effect in FDI-GDP correlations, with significant statistical significance.
problem The relationship between FDI and GDP growth is not immediate.
method Time-dependent Pearson correlation coefficient matrix analysis of 43 countries' data from 1970-2015.
result The correlation between FDI and GDP growth is time-lagged, evolving from positive to negative as inequality-adjusted human development index increases.
Bayesian framework selects features and lags for time series forecasting.
problem Variable selection and lagged error term identification in time series models.
method Hierarchical Bayesian models with spike-and-slab priors, two-stage MCMC algorithm.
result Posterior selection consistency under mild conditions, improved predictive performance.
AdaGrad-Norm achieves optimal convergence rates for non-convex objectives without tuning.
problem Optimal convergence rates for non-convex, smooth objectives with adaptive step sizes.
method Adaptive SGD (AdaGrad-Norm) with self-tuning step sizes, analyzing under unbounded gradients and affine variance scaling.
result AdaGrad-Norm achieves order optimal convergence rate of $\mathcal{O}\left(\frac{\mathrm{poly}\log(T)}{\sqrt{T}}
ight)$ under optimal assumptions.
Study examines lead-lag relationships between VIX and VIX futures markets over time.
problem Understanding dynamic interaction patterns between VIX and VIX futures markets.
method Utilized the symmetric thermal optimal path (TOPS) method to analyze time-dependent lead-lag relationships.
result Observed alternate lead-lag relationship instead of dominance between VIX and VIX futures markets.
Modeling lead-lag relationship between two text corpora for improved topic modeling.
problem Recognizing the relationship between multiple text corpora for better topic modeling.
method Proposed a jointly dynamic topic model and embedding extension for large-scale text corpus.
result The proposed model can well recognize the lead-lag relationship between two text corpora and improve topic learning.
Stochastic gradient descent is the method of choice for large-scale machine learning problems, by virtue of its light complexity per iteration. However, it lags behind its non-stochastic counterparts with respect to the convergence rate, due to high variance introduced by the stochastic updates. The popular Stochastic …
Develops variable-lag Granger causality and Transfer Entropy for time series analysis.
problem Fixed time delay assumption in Granger causality and Transfer Entropy does not hold in many applications.
method Variable-lag Granger causality and Transfer Entropy, using optimal warping path of Dynamic Time Warping (DTW).
result Proposed methods perform better than existing methods in both simulated and real-world datasets.
Develops variable-lag Granger causality for more accurate time series analysis.
problem Fixed time delay assumption in Granger causality does not fit many real-world applications.
method Variable-lag Granger causality, inferring with arbitrary time delays.
result Performs better than existing methods in coordinated collective behavior studies.