On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

6 results for “policy-matching”

A Behavior Regularized Implicit Policy for Offline Reinforcement Learningstat.ML

A new framework for offline RL improves policy flexibility and regularity.

problem Lack of environmental interactions in offline RL leads to poor policy performance.

method Proposes a behavior-regularized implicit policy framework with modified policy-matching methods.

result The framework improves policy effectiveness and robustness beyond static datasets.

offline reinforcement learning behavior regularization implicit policy policy-matching Jensen-Shannon divergence

2022-02-19abs ↗pdf ↗

Apprenticeship Learning using Inverse Reinforcement Learning and Gradient Methodscs.LG

In this paper we propose a novel gradient algorithm to learn a policy from an expert's observed behavior assuming that the expert behaves optimally with respect to some unknown reward function of a Markovian Decision Problem. The algorithm's aim is to find a reward function such that the resulting optimal policy matche…

2012-06-20abs ↗pdf ↗

Smoothness-Adaptive Contextual Banditscs.LG

We study a non-parametric multi-armed bandit problem with stochastic covariates, where a key complexity driver is the smoothness of payoff functions with respect to covariates. Previous studies have focused on deriving minimax-optimal algorithms in cases where it is a priori known how smooth the payoff functions are. I…

2019-10-22abs ↗pdf ↗

Invariant Causal Imitation Learning for Generalizable Policiesstat.ML

ICIL learns policies invariant to multiple environments, improving generalization.

problem Learning policies from multiple environments leads to spurious correlations.

method ICIL learns invariant feature representations and a matching imitation policy.

result ICIL policies generalize better to unseen environments.

imitation learning generalization invariant features causal inference control tasks

2023-11-02abs ↗pdf ↗

Learning Continuous Treatment Policy and Bipartite Embeddings for Matching with Heterogeneous Causal Effectscs.LG

Proposes a new method to estimate continuous treatment policies and match treatments effectively.

problem Current methods struggle with continuous treatment policies and complex matching.

method Formulates treatment effectiveness as a parametrizable model, using deep learning for optimization.

result Significant improvement in treatment effectiveness and matching efficiency.

causal inference treatment effects continuous policy matching deep learning

2020-04-21abs ↗pdf ↗

Generalized Decision Transformer for Offline Hindsight Information Matchingcs.LG

GDT improves reinforcement learning by matching future state information efficiently.

problem Efficient learning of multi-task policies from trajectory data.

method Generalized Decision Transformer (GDT) for offline hindsight information matching.

result GDT enables effective offline multi-task state-marginal matching and imitation learning.

reinforcement learning offline learning sequence modeling hindsight information matching policy matching

2021-11-19abs ↗pdf ↗