New statistical methods improve TD learning for policy evaluation.
problem Improving statistical inference for reinforcement learning.
method Polyak-Ruppert averaging, refined high-dimensional Berry-Esseen bounds, online plug-in estimator, asymptotic covariance matrix.
result Guaranteed finite-sample coverage of confidence regions and simultaneous confidence intervals.