Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

0111 · Oct 201919922001200920172026
9 results for CTRL

New CTRL algorithm adapts to varying problem difficulty.

problem Adapting to varying levels of problem difficulty in CTRL.
method MLE with a general function approximator, estimating state marginal density.
result Regret bound scales with reward variance and measurement resolution, independent of measurement strategy.

CtrlNS learns latent factors and distribution shifts from sparse transitions without prior knowledge.

problem Lack of prior knowledge of domain variables limits causal temporal representation learning.
method Sparse transition assumption and identifiability results from theoretical perspective.
result Effective in identifying distribution shifts and latent factors without prior knowledge.

We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms so as to improve the exploration of the state-space, and substantially reduce learning times by leveraging some limited knowledge of the plant encoded into a tutoring model-based control strategy. …

2019-12-12abs ↗pdf ↗

A RL-based method adds conditional controls to pre-trained diffusion models.

problem Precise control over generated samples in diffusion models.
method Formulates the task as an RL problem, using a classifier and KL divergence as reward functions.
result Produces soft-optimal policies that maximize reward functions, enabling conditional sampling.

This work develops efficient methods for continuous-time distributional reinforcement learning.

problem Continuous-time reinforcement learning with return distributions.
method Parameterizing return distributions using quantile representation and showing topological properties.
result Efficient approximation algorithm for continuous-time distributional reinforcement learning.

When learning behavior, training data is often generated by the learner itself; this can result in unstable training dynamics, and this problem has particularly important applications in safety-sensitive real-world control tasks such as robotics. In this work, we propose a principled and model-agnostic approach to miti…

2019-10-09abs ↗pdf ↗