On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “occupancy-measure-based”

Near-Optimal Dynamic Regret for Adversarial Linear Mixture MDPscs.LG

New algorithm reduces dynamic regret for MDPs with unknown transition and adversarial rewards.

problem Episodic linear mixture MDPs with unknown transition and adversarial rewards.

method Combines occupancy-measure-based global optimization and policy-based variance-aware value-targeted regression.

result Achieves near-optimal dynamic regret of

\widetilde{\mathcal{O}}(d \sqrt{H^3 K} + \sqrt{HK(H + \bar{P}_K)})

dynamic regret linear mixture MDPs unknown transition adversarial rewards occupancy-measure-based

2024-11-05abs ↗pdf ↗

Horizon-free Reinforcement Learning in Adversarial Linear Mixture MDPscs.LG

New algorithm tackles adversarial RL without horizon constraints.

problem Adversarial reinforcement learning with unknown transition kernel.

method Uses weighted least square estimator and occupancy measure for policy search.

result Achieves near-optimal regret bound of

O(\sqrt{K})

Reinforcement Learning Adversarial Horizon-free Policy Search Regret Bound

2023-05-15abs ↗pdf ↗