Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

1223 · Feb 202619922001200920172026
15 results for Decision-Estimation-Coefficient

Improved model-free reinforcement learning with decision-estimation coefficient.

problem Interactive decision making, including structured bandits and reinforcement learning.
method Combining Estimation-to-Decisions with optimistic estimation to achieve better regret bounds.
result Regret bounds for model-free reinforcement learning with value function approximation.

New bounds show complexity of adversarial decision making.

problem Understanding sample efficiency in adversarial decision making.
method New upper and lower bounds on Decision-Estimation Coefficient.
result Decision-Estimation Coefficient is necessary and sufficient for low regret in adversarial decision making.

New bounds for γγ-regret using modified Decision-Estimation Coefficient.

problem Statistical characterization of γγ-regret for complex bandit problems.
method Statistical characterization via γγ-DEC, a modified Decision-Estimation Coefficient.
result Upper and lower bounds for γγ-regret nearly match, showing fundamental limits.

New DEC variant improves sample complexity bounds in decision making.

problem Understanding sample-efficient learning guarantees in decision making.
method Introducing a new Constrained Decision-Estimation Coefficient (DEC) and using it to derive improved lower bounds.
result New lower bounds improve upon prior work in three aspects: expectation, global applicability, and improper reference models.

New complexity measure for interactive learning reduces regret to near-optimal levels.

problem Challenges in sample-efficient, adaptive learning algorithms for interactive decision making.
method Introduces the Decision-Estimation Coefficient and the Estimation-to-Decisions (E2D) principle.
result Unified algorithm design principle E2D achieves optimal sample-efficient learning.

Unified algorithm tackles various RL goals like reward-free and preference-based learning.

problem Unified approach to multiple RL learning goals.
method Decision-Estimation Coefficient (DEC) framework.
result Unified algorithm handles various learning goals with a single framework.

OE2D framework reduces contextual bandits to offline regression for near-optimal regret.

problem Efficiently learning contextual bandits with large action spaces and complex reward functions.
method Offline Estimation to Decisions (OE2D) algorithm that reduces contextual bandits to offline regression.
result Near-optimal regret for contextual bandits with large action spaces and O(logT)O(\log T) calls to an offline regression oracle.

Unified framework for lower bounds in interactive decision making.

problem Challenges in interactive decision making, especially bandits and reinforcement learning.
method Interactive Fano method and Fractional Covering Number.
result Unified characterization of learnability for stochastic bandit problems and tight lower bounds for interactive decision making.

We characterize learnability for stochastic noisy bandits, identifying optimal query complexities.

problem Learnability of stochastic noisy bandit models.
method Complete characterization through model class analysis and proof of optimal query complexities.
result Characterization of learnability for stochastic noisy bandit models.

New algorithms reduce sample complexity for multiclass contextual bandits.

problem Designing efficient algorithms for multiclass contextual bandits with sparse rewards.
method Two complementary approaches: decision-estimation coefficient analysis and low-variance exploration.
result Achieved optimal sample complexity bounds for multiclass contextual bandits.

Framework for robust decision making in changing environments with privacy constraints.

problem Interactive decision making in changing environments with constraints.
method Hybrid Decision Making with Structured Observations (hybrid DMSO) framework, local differentially private decision making, query-based learning, robust and smooth decision making.
result Strong connections and bounds derived for DEC, SQ dimension, local minimax complexity, learnability, and joint differential privacy.

Framework reduces contextual bandit learning to offline regression with near-optimal regret.

problem Efficient learning with large action spaces and complex reward functions.
method Offline Estimation to Decisions (OE2D) algorithm that minimizes regret with near-optimal oracle calls.
result Near-optimal regret for contextual bandits with large action spaces and O(log(T))O(log(T)) offline oracle calls.

Study on multi-agent decision making complexity, showing sample efficiency gaps.

problem Understanding sample efficiency in multi-agent decision making.
method General framework for interactive decision making, focusing on equilibrium computation.
result No 'reasonable' complexity measure can close gaps between single and multiple agents.

Study shows offline RL under QQ^\star-approximation and partial coverage is harder than previously thought.

problem Theoretical limits of offline reinforcement learning under QQ^\star-approximation and partial coverage.
method Introduced a decision-estimation framework to decompose offline RL complexity into decision and value estimation errors.
result Answered the open question by proving sample inefficiency under partial coverage is not guaranteed by QQ^\star-realizability and Bellman completeness.