This work optimizes MCMC algorithms for modern accelerators without synchronization overheads.
problem Synchronization overheads in vectorized MCMC algorithms.
method Designing single-chain MCMC algorithms as finite state machines (FSMs) to avoid synchronization.
result Achieves up to an order of magnitude speed-up in experiments.