arXiv research

Improved theoretical guarantees for Top Two algorithms.

Top-two algorithm improved for best-k-arm selection.

We investigate and provide new insights on the sampling rule called Top-Two Thompson Sampling (TTTS). In particular, we justify its use for fixed-confidence best-arm identification. We further propose a variant of TTTS called Top-Two Transportation Cost (T3C), which disposes of the computational burden of TTTS. As our …

Unified algorithm for efficient pure exploration using dual variables.

BCI system improves word selection efficiency using sequential best-arm identification.

New algorithm reduces sample complexity for Top Two method.

Unified model optimizes experiment performance and reduces duration.

Study adaptive sensing of Cox processes using posterior sampling and positive bases.

Paper recovers top-two answers and confusion probability in multi-choice crowdsourcing.

UCB algorithm's arm-sampling behavior is revealed, leading to new insights and proofs.

Thompson sampling provides a solution to bandit problems in which new observations are allocated to arms with the posterior probability that an arm is optimal. While sometimes easy to implement and asymptotically optimal, Thompson sampling can be computationally demanding in large scale bandit problems, and its perform…

Optimizes Thompson sampling policies using policy gradient methods.

MOTS improves Thompson sampling to match minimax bounds for bandit problems.

New method targets vaccines for new variants using Thompson sampling.

New Thompson sampling algorithm for stochastic partial monitoring achieves logarithmic regret.

Thompson sampling used for linear bandits with normal-gamma priors.

Thompson sampling has impressive empirical performance for many multi-armed bandit problems. But current algorithms for Thompson sampling only work for the case of conjugate priors since these algorithms require to infer the posterior, which is often computationally intractable when the prior is not conjugate. In this …

Improved Thompson sampling for bandits with Langevin algorithms.

Improved Thompson Sampling reduces regret in contextual bandits and reinforcement learning.

Improved Thompson Sampling algorithms for bandits with tighter regret bounds.

Thompson sampling, a Bayesian method for balancing exploration and exploitation in bandit problems, has theoretical guarantees and exhibits strong empirical performance in many domains. Traditional Thompson sampling, however, assumes perfect compliance, where an agent's chosen action is treated as the implemented actio…

Paper improves Thompson Sampling for linear contextual bandits.

A new thompson sampling method controls for time-varying effects.

Thompson sampling is an efficient algorithm for sequential decision making, which exploits the posterior uncertainty to address the exploration-exploitation dilemma. There has been significant recent interest in integrating Bayesian neural networks into Thompson sampling. Most of these methods rely on global variable u…

Extends Thompson sampling for RL with fewer episodes.

Thompson Sampling, one of the oldest heuristics for solving multi-armed bandits, has recently been shown to demonstrate state-of-the-art performance. The empirical success has led to great interests in theoretical understanding of this heuristic. In this paper, we approach this problem in a way very different from exis…

Improved statistical inference for adaptive Thompson Sampling.

This paper applies Thompson Sampling to asymmetric $\alpha$-stable bandits for financial and wireless data.

TS-Insight visualizes Thompson Sampling for better debugging and trust.

Improved Thompson Sampling for high-dimensional sparse bandits.

Thompson Sampling shows polynomial regret for combinatorial semi-bandits with subgaussian rewards.

TS-UCB improves Thompson Sampling with minimal extra computation.

Recently, it has been shown how sampling actions from the predictive distribution over the optimal action-sometimes called Thompson sampling-can be applied to solve sequential adaptive control problems, when the optimal policy is known for each possible environment. The predictive distribution can then be constructed b…

Distributed Thompson sampling improves regret convergence in constrained communication networks.

Model shows screening for infectious disease is hard but Thompson sampling works well.

ERTS uses Thompson sampling for Gaussian entropic risk bandits, achieving regret bounds.

New Thompson Sampling for partially observed context bandits reduces regret logarithmically with time.

Improved Thompson Sampling outperforms existing Bayesian optimization methods.

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards drawn from symmetric $α$-stable distributions, which are a class of heavy-taile…

Thompson Sampling bounds for contextual bandits with sub-Gaussian rewards.

Ensemble sampling approximates Thompson sampling for complex models.

We discuss a variant of Thompson sampling for nonparametric reinforcement learning in a countable classes of general stochastic environments. These environments can be non-Markov, non-ergodic, and partially observable. We show that Thompson sampling learns the environment class in the sense that (1) asymptotically its …

Neural Thompson Sampling uses deep neural networks for contextual bandit problems.

VITS improves Thompson Sampling for contextual bandits with efficient approximate inference.

Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for simple special cases. This paper develops ensemble sampling, which aims to approx…

Recent advances in deep reinforcement learning have made significant strides in performance on applications such as Go and Atari games. However, developing practical methods to balance exploration and exploitation in complex domains remains largely unsolved. Thompson Sampling and its extension to reinforcement learning…

Predictive sampling improves on Thompson sampling for non-stationary bandit environments.

Batch Thompson Sampling reduces exploration-exploitation trade-off in online decision making.