Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.1% · Sep 202119922001200920172026
9 results for state-marginal

Exploration is critical to a reinforcement learning agent's performance in its given environment. Prior exploration methods are often based on using heuristic auxiliary predictions to guide policy behavior, lacking a mathematically-grounded objective with clear properties. In contrast, we recast exploration as a proble…

2019-06-12abs ↗pdf ↗

Unified probabilistic perspective on imitation learning methods using divergence minimization.

problem Understanding and improving imitation learning methods for limited demonstration scenarios.
method Unified probabilistic perspective based on divergence minimization.
result State-marginal matching objective contributes most to IRL's superior performance.

New CTRL algorithm adapts to varying problem difficulty.

problem Adapting to varying levels of problem difficulty in CTRL.
method MLE with a general function approximator, estimating state marginal density.
result Regret bound scales with reward variance and measurement resolution, independent of measurement strategy.

Improved exploration in RL with latent state marginalization.

problem Complexity of deep probabilistic models limits their practical use in reinforcement learning.
method Adopting latent variable policies within the MaxEnt framework, with low-cost marginalization of latent states.
result Effective marginalization leads to better exploration and more robust training.

A new method for learning policies from demonstrations without reinforcement.

problem Learning policies from demonstrations without access to reinforcement signals.
method Energy-based distribution matching (EDM) to learn policy parameters and state marginals.
result EDM yields consistent performance gains over existing algorithms for strictly batch imitation learning.

GDT improves reinforcement learning by matching future state information efficiently.

problem Efficient learning of multi-task policies from trajectory data.
method Generalized Decision Transformer (GDT) for offline hindsight information matching.
result GDT enables effective offline multi-task state-marginal matching and imitation learning.