Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

1122 · May 202319922001200920172026
9 results for uniform-PAC

New algorithms achieve uniform-PAC guarantees for RL with bounded eluder dimension.

problem Achieving strong performance guarantees in reinforcement learning.
method Proposes algorithms for nonlinear bandits and model-based episodic RL with a bounded eluder dimension.
result Achieves uniform-PAC sample complexity that matches state-of-the-art regret bounds or sample complexity guarantees.

New algorithm FLUTE achieves uniform-PAC convergence in RL with linear approx.

problem RL with linear function approximation lacks uniform-PAC guarantees.
method FLUTE algorithm with minimax value function estimator and multi-level partition scheme.
result Uniform-PAC convergence to optimal policy with high probability.

Survey of reinforcement learning guarantees with data constraints.

problem Guaranteeing near-optimal policies with limited data in reinforcement learning.
method Coverage-Structure-Objective (CSO) framework to decompose sample complexity results.
result Progress on PAC guarantees for reinforcement learning, covering various models and settings.

This paper introduces a new metric, ULI, for RL that ensures both cumulative and instantaneous performance.

problem High-stakes applications require RL algorithms to avoid playing bad policies.
method Introduces uniform last-iterate (ULI) guarantee, a stronger metric capturing both cumulative and instantaneous performance.
result ULI directly implies near-optimal cumulative performance across various metrics, but not the other way around.

Efficient RL algorithm for MDPs with linear QπQ^π realizability, achieving optimal regret bound.

problem Efficient reinforcement learning under linear QπQ^π realizability assumption for MDPs with stochastic dynamics.
method Frozen Policy Iteration algorithm that uses high-confidence data and freezes policy for well-explored states.
result Achieves optimal regret bound of O~(d2H6T)\widetilde{O}(\sqrt{d^2H^6T}) for linear (contextual) bandits.