On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “Unichain”

Regret Analysis of Average-Reward Unichain MDPs via an Actor-Critic Approachcs.LG

Actor-Critic method achieves optimal regret for unichain MDPs.

problem Scalable regret analysis for infinite-horizon average-reward MDPs.

method NAC-B, a Natural Actor-Critic with batching.

result Order-optimal regret of

ilde{O}(\sqrt{T})

in infinite-horizon average-reward MDPs.

Actor-Critic Natural Actor-Critic MDP Regret Analysis Unichain

2025-05-26abs ↗pdf ↗

Restless Bandits with Average Reward: Breaking the Uniform Global Attractor Assumptioncs.LG

New framework improves restless bandit policies for large numbers of arms.

problem Efficiently compute policies for large numbers of arms in restless bandit problems.

method Follow-the-Virtual-Advice framework, converting single-armed policies to N-armed policies.

result Achieves an O(1/\sqrt{N}) optimality gap in both discrete and continuous settings.

restless bandits average reward asymptotic optimality Follow-the-Virtual-Advice uniform global attractor

2023-05-31abs ↗pdf ↗