New algorithms learn from fixed data without exploration.
problem Learning from fixed data without additional exploration.
method Introduces batch-constrained reinforcement learning.
result First continuous control RL algorithm for fixed data.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
4 results for “batch-constrained”
This paper benchmarks batch RL algorithms on Atari, finding DQN and partially-trained policies perform best.
problem Deep RL algorithms fail in batch setting.
method Benchmarked batch RL algorithms on Atari using a single partially-trained policy.
result Many batch RL algorithms underperform DQN and partially-trained policies.
CoDA augments data with counterfactuals from local causal structures.
problem Improving sample efficiency in RL with complex dynamic processes.
method Local causal models (LCMs) and Counterfactual Data Augmentation (CoDA).
result CoDA significantly improves RL agent performance in locally factored tasks.
State-constrained offline RL expands RL's learning scope.
problem Batch-constrained offline RL limits policies to seen actions.
method Introduces state-constrained offline RL focusing on state distribution.
result Policy can take high-quality out-of-distribution actions.