On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

3 results for “TD3-BC”

Improving TD3-BC: Relaxed Policy Constraint for Offline Learning and Stable Online Fine-Tuningcs.LG

Improved RL policies from offline data with relaxed BC constraints.

problem Overestimation bias in offline RL due to lack of interaction with environment.

method Introducing a policy constraint via behavioural cloning (BC) and adjusting the balance between RL and BC.

result Refined policies outperform baseline and match/exceed complex alternatives.

offline RL policy constraint TD3-BC overestimation bias stable fine-tuning

2022-11-21abs ↗pdf ↗

Offline RL With Resource Constrained Online Deploymentcs.LG

Offline RL tackles resource-constrained online deployment with improved policy transfer.

problem Training policies with limited online features using a rich offline dataset.

method Introduce a policy transfer algorithm that first trains a teacher agent with full offline features and then transfers knowledge to a student agent with limited online features.

result Consistent improvement in performance over baseline methods on resource-constrained datasets.

Offline RL Policy Transfer Resource Constrained D4RL RC-D4RL

2021-10-07abs ↗pdf ↗

Model-based trajectory stitching for improved behavioural cloning and its applicationsstat.ML

Improves BC policies by generating new plausible trajectories.

problem Sub-optimal data quality in BC leads to poor policy performance.

method Trajectory Stitching (TS) generates new plausible transitions.

result TS significantly improves behavioural policies over original data.

Behavioural Cloning Trajectory Stitching Offline Reinforcement Learning Plausible Transitions State-Value Function

2022-12-08abs ↗pdf ↗