On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “contingency-awareness”

Contingency-Aware Exploration in Reinforcement Learningcs.LG

The paper explores how contingency-awareness improves exploration in reinforcement learning.

problem Improving exploration in reinforcement learning environments with sparse rewards.

method Developed an attentive dynamics model (ADM) to discover controllable elements of observations and used it for state representation in exploration.

result Combining actor-critic algorithms with count-based exploration using the ADM representation achieved impressive results on Atari games.

reinforcement learning exploration contingency-awareness Atari games actor-critic

2018-11-05abs ↗pdf ↗

Zero-shot Policy Learning with Spatial Temporal RewardDecomposition on Contingency-aware Observationcs.LG

Paper tackles zero-shot policy learning for agents in new environments.

problem Learning in one environment and generalizing to unseen environments without additional data.

method Decomposes sparse rewards into spatial-temporal regions and uses Model Predictive Control (MPC).

result Method achieves natural generalization to new environments, demonstrated on various tasks.

zero-shot learning policy learning contingency-aware Model Predictive Control sparse rewards

2019-10-17abs ↗pdf ↗