arXiv research

Optimal algorithms for non-linear ridge bandits reduce burn-in cost.

New RL algorithms reduce costs for single-agent and federated learning.

New algorithm reduces cold-start costs in multi-armed bandits for many products.

New algorithm learns optimal policies with minimal memory and time.

A new algorithm reduces memory and computational needs for reinforcement learning.

This paper is concerned with offline reinforcement learning (RL), which learns using pre-collected data without further exploration. Effective offline RL would be able to accommodate distribution shift and limited data coverage. However, prior algorithms or analyses either suffer from suboptimal sample complexities or …

Study fast learning rates for square loss in dependent data with hypercontractivity condition.

Restricted Boltzmann machines (RBMs) are powerful machine learning models, but learning and some kinds of inference in the model require sampling-based approximations, which, in classical digital computers, are implemented using expensive MCMC. Physical computation offers the opportunity to reduce the cost of sampling …

Recent work on imitation learning has generated policies that reproduce expert behavior from multi-modal data. However, past approaches have focused only on recreating a small number of distinct, expert maneuvers, or have relied on supervised learning techniques that produce unstable policies. This work extends InfoGAI…

ULA estimates covariance of log-concave distributions efficiently.

Communication costs, resulting from synchronization requirements during learning, can greatly slow down many parallel machine learning algorithms. In this paper, we present a parallel Markov chain Monte Carlo (MCMC) algorithm in which subsets of data are processed independently, with very little communication. First, w…

Curriculum learning improves model training efficiency and performance.

Parallelized bandit algorithms speed up decision-making.

SGD shows distinct phases in learning single-index models, achieving optimal sample complexity and regret.

New bounds on trajectory safety in training models with Langevin Dynamics.

Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining Markov chain Monte Carlo (MCMC) and particle filtering. The latter is used to estimate the intractable likelihood. In its original formulation, PMH makes use of a marginal MCMC proposal for the parame…

GD with large, adaptive stepsizes achieves optimal risk in logistic regression.

Observer learns optimal policy from learner's actions without rewards.

Two algorithms learn Gaussian graphical models from Glauber dynamics trajectories.

The paper analyzes Adam and SGD in nonstationary optimization, revealing tradeoffs between noise and drift.

We present a general framework for accelerating a large class of widely used Markov chain Monte Carlo (MCMC) algorithms. Our approach exploits fast, iterative approximations to the target density to speculatively evaluate many potential future steps of the chain in parallel. The approach can accelerate computation of t…

Study bounds noise level in linear regression with dependent data.

In this paper we address the following question: Can we approximately sample from a Bayesian posterior distribution if we are only allowed to touch a small mini-batch of data-items for every sample we generate?. An algorithm based on the Langevin equation with stochastic gradients (SGLD) was previously proposed to solv…

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on Metropolis-Hastings (MH) algorithm for unimodal distributions. Here, an enhanced MH algorithm …

New RL algorithm reduces sample complexity for optimal learning.

New algorithm reduces regret in infinite MDPs with optimal variance-dependent bounds.

Optimizes MCMC output compression by selecting a subset of states.

Particle MCMC is a class of algorithms that can be used to analyse state-space models. They use MCMC moves to update the parameters of the models, and particle filters to propose values for the path of the state-space model. Currently the default is to use random walk Metropolis to update the parameter values. We show …

New algorithm finds critical points in non-convex optimization with heavy-tailed gradients.

New GLB algorithm handles non-stationary data with forgetting.

This work analyzes the convergence rate of unrolling for optimizing quadratic objectives.

Regularized Stein thinning improves MCMC output approximations.

Bayesian realized EGARCH models improve tail risk forecasting.

New analysis shows SGD with noise doesn't leak more privacy with more iterations.

New compression methods handle biased input sequences for more accurate posterior summaries.

The paper improves importance sampling and MCMC methods for complex distributions.

UCRL3 improves UCRL2's efficiency in reinforcement learning by reducing exploration.

Spectral gradient methods outperform Euclidean in certain deep learning scenarios.

Near-optimal tests and confidence sequences for non-parametric data.

This study provides an explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.

Cost-aware BO minimizes function evaluations with varying costs.

Paper optimizes broker performance by estimating execution costs.

Paper proposes new costs for learning multiple centers in MDNs.

Using a methodology similar to that used the in the worldwide research, the cost performance of Dutch large-scale transport infrastructure projects is determined. In the Netherlands, cost overruns are as common as cost underruns but because cost overruns are larger than cost underruns projects on average have a cost ov…

Proposes resilience metrics for large blackout costs with logarithmic resilience.

Label embedding (LE) is an important family of multi-label classification algorithms that digest the label information jointly for better performance. Different real-world applications evaluate performance by different cost functions of interest. Current LE algorithms often aim to optimize one specific cost function, b…

Optimal benchmark design varies based on costs in financial manipulation.

BART improves predictive performance but slows down with more data.