Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.1% · Dec 202219922001200920172026
6 results for Rare-Switching

Two algorithms achieve optimal regret with limited adaptivity in multinomial logistic bandits.

problem Achieving optimal regret with limited adaptivity in multinomial logistic bandits.
method Presented two algorithms, B-MNL-CB and RS-MNL, for batched and rarely-switching paradigms.
result Achieved ildeO(T) ilde{O}(\sqrt{T}) regret with limited adaptivity.

New RL algorithm achieves nearly optimal performance for linear MDPs.

problem Optimal reinforcement learning for episodic linear MDPs.
method Weighted linear regression with variance estimator and rare-switching policy.
result Achieves nearly minimax optimal regret ildeO(dH3K) ilde O(d\sqrt{H^3K}).

New actor-critic algorithm achieves optimal sample efficiency in RL.

problem Achieving εε-optimal policies with minimal samples in RL.
method Integrates optimism, off-policy critic estimation, and rare-switching policy resets.
result Sample complexity of O(dH5logA/ε2+dH4logF/ε2)O(dH^5 \log|\mathcal{A}|/ε^2 + d H^4 \log|\mathcal{F}|/ ε^2) trajectories.

We develop a robust RL algorithm for off-dynamics environments with improved suboptimality bounds and computational efficiency.

problem Learning policies robust to uncertainties in transition dynamics between training and deployment environments.
method Distributionally robust Markov decision processes (DRMDPs) with a novel algorithm We-DRIVE-U.
result Improved suboptimality bound of O~(dHmin{1/ρ,H}/K)\widetilde{\mathcal{O}}\big({d H \cdot \min \{1/ρ, H\}/\sqrt{K} }\big), near-optimal up to O(H)\mathcal{O}(\sqrt{H}).