arXiv research

AEGiS optimizes expensive function evaluations asynchronously.

Standard acquisition functions are sufficient for asynchronous Bayesian optimization.

The paper improves Q-learning by incorporating pessimism for better sample efficiency.

LSAM optimizes deep learning training with improved efficiency.

Unified framework for finite-sample RL algorithms using Lyapunov theory.

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and distributed systems such as compute clusters. Recent work has proposed running i…

We design and analyse variations of the classical Thompson sampling (TS) procedure for Bayesian optimisation (BO) in settings where function evaluations are expensive, but can be performed in parallel. Our theoretical analysis shows that a direct application of the sequential Thompson sampling algorithm in either synch…

Asynchronous framework speeds up model-based RL to real-time.

Asynchronous Q-learning achieves optimal Q-function estimation with reduced sample complexity.

We consider parallel asynchronous Markov Chain Monte Carlo (MCMC) sampling for problems where we can leverage (stochastic) gradients to define continuous dynamics which explore the target distribution. We outline a solution strategy for this setting based on stochastic gradient Hamiltonian Monte Carlo sampling (SGHMC) …

Improves asynchronous federated learning with queuing dynamics.

In AI research and industry, machine learning is the most widely used tool. One of the most important machine learning algorithms is Gradient Boosting Decision Tree, i.e. GBDT whose training process needs considerable computational resources and time. To shorten GBDT training time, many works tried to apply GBDT on Par…

Asynchronous Gibbs sampling has been recently shown to be fast-mixing and an accurate method for estimating probabilities of events on a small number of variables of a graphical model satisfying Dobrushin's condition~\cite{DeSaOR16}. We investigate whether it can be used to accurately estimate expectations of functions…

Asynchronous SGD generalizes well with enough data, improving stability and reducing error.

Freya PAGE optimizes nonconvex optimization with heterogeneous, asynchronous workers.

High-throughput 3D control training system achieves 100,000 FPS.

A fast MCMC sampler for sparse Bayesian inference.

A new estimator for asynchronous tick data shows better correlation estimates.

Gaussian processes (GPs) are powerful non-parametric function estimators. However, their applications are largely limited by the expensive computational cost of the inference procedures. Existing stochastic or distributed synchronous variational inferences, although have alleviated this issue by scaling up GPs to milli…

The paper analyzes Q-learning convergence rates with asynchronous updates.

Enhances SGLD for log-concave posteriors with asynchronous computation.

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in computationally complex environments. In this paper, we propose Asynchronous Episo…

Enhances Fourier estimator performance for asynchronous event-data.

Ringmaster ASGD improves Asynchronous SGD's efficiency under varying worker times.

New method speeds up lead-lag detection between asynchronous time series.

Latent Block-Diffusion Temporal Point Processes (LBDTPP) is a semi-autoregressive framework for generating asynchronous event sequences.

Catalyst.RL accelerates RL research with efficient training.

New algorithms allow multiple robots to search efficiently without central coordination.

Secure aggregation for buffered asynchronous federated learning without TEEs.

New Q-learning method achieves optimal sample complexity for average-reward problems.

Paper analyzes convergence and speedup of asynchronous parallel SGD.

Batch Bayesian optimisation (BO) has been successfully applied to hyperparameter tuning using parallel computing, but it is wasteful of resources: workers that complete jobs ahead of others are left idle. We address this problem by developing an approach, Penalising Locally for Asynchronous Bayesian Optimisation on $k$…

Asynchronous method for hyperparameter and neural architecture search.

Federated Q-learning achieves linear speedup with heterogeneity, improving sample complexity.

This work tackles resource allocation in asynchronous and stochastic systems.

Advances in asynchronous optimization methods for machine learning.

New Fourier transform method handles missing data and asynchronous observations.

New rules found to maintain neural network performance in asynchronous training.

As datasets continue to increase in size and multi-core computer architectures are developed, asynchronous parallel optimization algorithms become more and more essential to the field of Machine Learning. Unfortunately, conducting the theoretical analysis asynchronous methods is difficult, notably due to the introducti…

FedBuff improves federated learning scalability with asynchronous updates.

Sparsification improves convergence in asynchronous distributed SGD, even in the presence of staleness.

The asymptotic pseudo-trajectory approach to stochastic approximation of Benaim, Hofbauer and Sorin is extended for asynchronous stochastic approximations with a set-valued mean field. The asynchronicity of the process is incorporated into the mean field to produce convergence results which remain similar to those of a…

We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for asymptotic optimality of standard stochastic gradient procedures. Roughly, the n…

Distributed asynchronous SGD has become widely used for deep learning in large-scale systems, but remains notorious for its instability when increasing the number of workers. In this work, we study the dynamics of distributed asynchronous SGD under the lens of Lagrangian mechanics. Using this description, we introduce …

A new method for efficient optimization of expensive simulations on HPC.

This paper describes Plumbing for Optimization with Asynchronous Parallelism (POAP) and the Python Surrogate Optimization Toolbox (pySOT). POAP is an event-driven framework for building and combining asynchronous optimization strategies, designed for global optimization of expensive functions where concurrent function …

Unified analysis of asynchronous-SGD algorithms for distributed learning.

Paper proves CLTs for Q-learning with asynchronous updates.