Asynchronous SGD can speed up training with a trade-off of gradient staleness.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
AEGiS optimizes expensive function evaluations asynchronously.
Distributed Stochastic Gradient Descent (SGD) when run in a synchronous manner, suffers from delays in waiting for the slowest learners (stragglers). Asynchronous methods can alleviate stragglers, but cause gradient staleness that can adversely affect convergence. In this work we present a novel theoretical characteriz…
The Epps effect, the decrease of correlations between stock returns for short time windows, was traced back to the trading asynchronicity and to the occasional lead-lag relation between the prices. We study pairs of stocks where the latter is negligible and confirm the importance of asynchronicity but point out that al…
RL agent learns to place limit orders for trading signals in financial markets.
In order to use the advanced inference techniques available for Ising models, we transform complex data (real vectors) into binary strings, by local averaging and thresholding. This transformation introduces parameters, which must be varied to characterize the behaviour of the system. The approach is illustrated on fin…
A new estimator for asynchronous tick data shows better correlation estimates.
Secure asynchronous federated learning with differential privacy for edge intelligence.
Unified framework for finite-sample RL algorithms using Lyapunov theory.
In order to simulate the complex phenomena manifested in stock markets, we introduce a continuous asynchronous model in which millions of individual traders interact through a central orders matching mechanism, just as it happens in real stock markets. Each trader has a unique decision function, which allows him/ her t…
Agent-based model simulates market dynamics with real-time order matching.
New simulation shows trading algorithms' performance varies with parallelism.
Reinforcement learning improves trading performance on stock exchanges.
We present a method to compensate statistical errors in the calculation of correlations on asynchronous time series. The method is based on the assumption of an underlying time series. We set up a model and apply it to financial data to examine the decrease of calculated correlations towards smaller return intervals (E…
The analysis of the intraday dynamics of correlations among high-frequency returns is challenging due to the presence of asynchronous trading and market microstructure noise. Both effects may lead to significant data reduction and may severely underestimate correlations if traditional methods for low-frequency data are…
Enhances Fourier estimator performance for asynchronous event-data.
Researchers simulate and estimate a market model with a matching engine to understand its impact on order submission and management.
Stochastic Gradient Descent (SGD) is a fundamental algorithm in machine learning, representing the optimization backbone for training several classic models, from regression to neural networks. Given the recent practical focus on distributed machine learning, significant work has been dedicated to the convergence prope…
Latent Block-Diffusion Temporal Point Processes (LBDTPP) is a semi-autoregressive framework for generating asynchronous event sequences.
Ringmaster ASGD improves Asynchronous SGD's efficiency under varying worker times.
New model explains price dynamics of Bitcoin with psychological factors.
American Depositary Receipts (ADRs) are exchange-traded certificates that rep- resent shares of non-U.S. company securities. They are major financial instruments for investing in foreign companies. Focusing on Asian ADRs in the context of asyn- chronous markets, we present methodologies and results of empirical analysi…
Secure aggregation for buffered asynchronous federated learning without TEEs.
Standard acquisition functions are sufficient for asynchronous Bayesian optimization.
Batch Bayesian optimisation (BO) has been successfully applied to hyperparameter tuning using parallel computing, but it is wasteful of resources: workers that complete jobs ahead of others are left idle. We address this problem by developing an approach, Penalising Locally for Asynchronous Bayesian Optimisation on …
Asynchronous method for hyperparameter and neural architecture search.
This work tackles resource allocation in asynchronous and stochastic systems.
Advances in asynchronous optimization methods for machine learning.
As datasets continue to increase in size and multi-core computer architectures are developed, asynchronous parallel optimization algorithms become more and more essential to the field of Machine Learning. Unfortunately, conducting the theoretical analysis asynchronous methods is difficult, notably due to the introducti…
A framework uses deep reinforcement learning to optimize energy storage in intraday markets.
FedBuff improves federated learning scalability with asynchronous updates.
The asymptotic pseudo-trajectory approach to stochastic approximation of Benaim, Hofbauer and Sorin is extended for asynchronous stochastic approximations with a set-valued mean field. The asynchronicity of the process is incorporated into the mean field to produce convergence results which remain similar to those of a…
We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for asymptotic optimality of standard stochastic gradient procedures. Roughly, the n…
Distributed asynchronous SGD has become widely used for deep learning in large-scale systems, but remains notorious for its instability when increasing the number of workers. In this work, we study the dynamics of distributed asynchronous SGD under the lens of Lagrangian mechanics. Using this description, we introduce …
This paper describes Plumbing for Optimization with Asynchronous Parallelism (POAP) and the Python Surrogate Optimization Toolbox (pySOT). POAP is an event-driven framework for building and combining asynchronous optimization strategies, designed for global optimization of expensive functions where concurrent function …
In machine learning, asynchronous parallel stochastic gradient descent (APSGD) is broadly used to speed up the training process through multi-workers. Meanwhile, the time delay of stale gradients in asynchronous algorithms is generally proportional to the total number of workers, which brings additional deviation from …
Optimal trading strategy between CEXs and DEXs with priority fees and stochastic delays.
Unified analysis of asynchronous-SGD algorithms for distributed learning.
Paper proves CLTs for Q-learning with asynchronous updates.
Accelerates optimization in asynchronous systems with sparse updates.
Improves asynchronous federated learning with queuing dynamics.
A simple learning agent learns to trade in an agent-based market model.
We study optimization algorithms based on variance reduction for stochastic gradient descent (SGD). Remarkable recent progress has been made in this direction through development of algorithms like SAG, SVRG, SAGA. These algorithms have been shown to outperform SGD, both theoretically and empirically. However, asynchro…
Paper proposes a novel trading strategy combining clustering and reinforcement learning for multi-period portfolio management.
Background: Recent developments have made it possible to accelerate neural networks training significantly using large batch sizes and data parallelism. Training in an asynchronous fashion, where delay occurs, can make training even more scalable. However, asynchronous training has its pitfalls, mainly a degradation in…
Ringleader ASGD optimizes SGD for diverse edge devices with varying data and computation speeds.
We study the volatility functional inference by Fourier transforms. This spectral framework is advantageous in that it harnesses the power of harmonic analysis to handle missing data and asynchronous observations without any artificial time alignment nor data imputation. Under conditions, this spectral approach is cons…
Combines multi-fidelity and asynchronous batch methods for faster experimental design.