Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3717421,1131,484 · Jun 202019922001200920172026
48 results for Correlated Reward Models

Optimizing rewards under budget constraints with correlated costs and rewards.

problem Maximizing total expected reward under a budget constraint on total cost with correlated and potentially heavy-tailed cost-reward pairs.
method Proposes algorithms exploiting correlation between cost and reward via linear minimum mean-square error estimation to achieve tight regret bounds.
result Achieves O(logB)O(\log B) regret for a budget B>0B>0 under certain moment conditions.

Mitigates biases in reward models using variational inference.

problem Spurious correlations in reward models that align large language models with human preferences.
method Formulates data-generating process, identifies non-spurious latent variables, and uses variational inference to recover them.
result Effective mitigation of spurious correlation issues, yielding more robust reward models.

Resolves spurious correlations in causal models via intervention design.

problem Spurious correlations lead to incorrect causal models in reinforcement learning environments.
method Proposes a method to design interventions that improve causal models by incentivizing agents to find errors.
result Experimental results show improved causal models compared to baselines.

The paper tackles statistical and computational challenges in learning correlated reward models.

problem The Independence of Irrelevant Alternatives (IIA) assumption collapses human preferences into a universal utility function, leading to coarse approximations.
method The paper investigates the statistical and computational challenges of learning a correlated probit model using best-of-three preference data.
result Best-of-three preference data overcomes the limitations of pairwise preference data, allowing for more fine-grained modeling of human preferences.

PROBE optimizes best-arm identification with cheap proxies, improving sample complexity.

problem Fixed-confidence best-arm identification with costly rewards and correlated cheap proxies.
method PROBE uses control-variate adjustment and phase elimination to learn residual variance online.
result PROBE achieves oracle sample complexity up to a constant factor and additive calibration cost.

New method uses correlated auxiliary feedback to reduce regret in parameterized bandits.

problem Reducing regret in parameterized bandits with correlated auxiliary feedback.
method Develops a reward estimator using auxiliary feedback with tight confidence bounds.
result Shows significant reduction in regret compared to standard methods.

A major challenge in reinforcement learning is exploration, when local dithering methods such as epsilon-greedy sampling are insufficient to solve a given task. Many recent methods have proposed to intrinsically motivate an agent to seek novel states, driving the agent to discover improved reward. However, while state-…

2019-06-19abs ↗pdf ↗

We consider a multi-armed bandit framework where the rewards obtained by pulling different arms are correlated. We develop a unified approach to leverage these reward correlations and present fundamental generalizations of classic bandit algorithms to the correlated setting. We present a unified proof technique to anal…

2019-11-06abs ↗pdf ↗

The study categorizes reward errors in reinforcement learning, finding some can be beneficial.

problem Training language models with imperfect proxy rewards.
method Theoretical analysis of policy gradient optimization and categorization of reward errors.
result Reward errors can be benign or even beneficial, preventing policy from stalling.

We consider the problem of learning to play a repeated multi-agent game with an unknown reward function. Single player online learning algorithms attain strong regret bounds when provided with full information feedback, which unfortunately is unavailable in many real-world scenarios. Bandit feedback alone, i.e., observ…

2019-09-18abs ↗pdf ↗

DART optimizes subset selection in non-linear bandit problems.

problem Optimizing subset selection in non-linear bandit problems with correlated rewards.
method DART algorithm for combinatorial bandits without individual arm feedback or linearity assumption.
result DART achieves a regret bound of ildeO(KKNT) ilde{\mathcal{O}}(K\sqrt{KNT}).

In this paper we consider the problem of online stochastic optimization of a locally smooth function under bandit feedback. We introduce the high-confidence tree (HCT) algorithm, a novel any-time X\mathcal{X}-armed bandit algorithm, and derive regret bounds matching the performance of existing state-of-the-art in term…

2014-02-04abs ↗pdf ↗

Reinforcement learning algorithms use correlations between policies and rewards to improve agent performance. But in dynamic or sparsely rewarding environments these correlations are often too small, or rewarding events are too infrequent to make learning feasible. Human education instead relies on curricula--the break…

2019-09-27abs ↗pdf ↗

ARC algorithm optimizes dynamic pricing with correlated observations.

problem Optimizing dynamic pricing with correlated and generally distributed observations.
method Extends ARC algorithm to batched bandits with generalised linear model.
result ARC algorithm outperforms alternative approaches in dynamic pricing.

The paper explores how mining costs, rewards, and blockchain security are interconnected.

problem Understanding the interdependencies between mining costs, mining rewards, and blockchain security.
method Theoretical derivation and empirical analysis using daily crypto market data and autoregressive distributed lag approach.
result Cryptocurrency price and mining rewards are intrinsically linked to blockchain security outcomes.

New algorithm uses machine learning to predict rewards for decision-making problems.

problem Sequential decision-making under uncertainty with scarce online data.
method Machine Learning-Assisted Upper Confidence Bound (MLA-UCB) algorithm.
result Proves to improve cumulative regret even with biased surrogate rewards.

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement learning provides a framework to automatically acquire suitable reward functions…

2019-07-30abs ↗pdf ↗

New algorithms ensure fair selection in combinatorial semi-bandit with unrestricted delays.

problem Fair selection in stochastic combinatorial semi-bandit with delayed feedback.
method Introduced merit-based fairness constraints and new bandit algorithms for reward and fairness.
result Achieved sublinear expected reward and fairness regrets with dependence on delay distribution quantiles.

This work improves wireless network learning by using side-information about interference.

problem Improving online learning algorithms in wireless networks.
method Exploiting side-information like interference levels to improve learning algorithms.
result Improved learning algorithms achieve higher throughput with fewer samples.

Two novel methods identify influential features in CMABs for better reward distribution.

problem Suboptimal features degrade rewards, interpretability, and efficiency in CMABs.
method Heterogeneous Incremental Effect (HIE) and Heterogeneous Distribution Divergence (HDD) methods.
result Consistent ability to identify influential HTE features, enhancing CMAB performance.

Paper proposes a new portfolio model for better investment decisions.

problem Traditional portfolio models fail to adapt to nonstationary markets.
method Developed a mean-detrended cross-correlation portfolio model (M-DCCP model).
result The M-DCCP model outperforms traditional models in constructing optimal portfolios.

Improved control approach for correlated bandits with better performance.

problem General multi-armed bandit problem with correlated elements.
method Introducing entropy regularisation to obtain a smooth asymptotic approximation of the value function, leading to a semi-index approximation of the optimal decision process.
result Performance of Asymptotic Randomised Control (ARC) algorithm compares favorably with other approaches.

A RL framework selects features to balance bias and accuracy dynamically.

problem Bias in automated feature selection when predictors are correlated.
method Multi-component reward function with policy gradient for dynamic regularization and bias mitigation.
result Model balances fairness and accuracy during training.

A deep reinforcement learning method for cost-sensitive portfolio selection.

problem Non-stationary price series and complex asset correlations make feature learning hard, and practical cost constraints are not considered.
method A two-stream portfolio policy network and a cost-sensitive reward function are developed using deep reinforcement learning.
result The method achieves superior performance in profitability, cost-sensitivity, and representation abilities.

A new reinforcement learning method reduces action complexity for robust control.

problem Deep reinforcement learning's susceptibility to spurious correlations.
method Minimizing trajectory entropy to encourage simple, predictable actions.
result Trajectory Entropy Reinforcement Learning achieves superior performance and robustness.

A central challenge in reinforcement learning is discovering effective policies for tasks where rewards are sparsely distributed. We postulate that in the absence of useful reward signals, an effective exploration strategy should seek out {\it decision states}. These states lie at critical junctions in the state space …

2019-01-30abs ↗pdf ↗

Proposes method to discover diverse near-optimal policies in reinforcement learning.

problem Finding different solutions to the same problem in reinforcement learning.
method Formalizes problem as CMDP, uses Successor Features, proposes new diversity rewards.
result Proposed method discovers diverse near-optimal policies that are robust and distinct.

AGG-UCB uses neural networks to optimize group behaviors in contextual bandits.

problem Optimizing group behaviors in contextual bandits with mutual impacts.
method Introduces Arm Group Graph (AGG) and AGG-UCB algorithm using neural networks and graph neural networks.
result Achieves near-optimal regret bound with over-parameterized neural networks.

AlphaZeroBeta uses deep reinforcement learning for market-neutral portfolios, outperforming traditional methods.

problem Traditional portfolio management methods often fail during market regime shifts or when assumptions break down.
method Combines a composite reward function and CNN-GRU policy trained end-to-end via Recurrent PPO.
result Achieves higher Sharpe ratios than baselines while maintaining near-zero benchmark correlations.

We tackle the Multi-task Batch Reinforcement Learning problem. Given multiple datasets collected from different tasks, we train a multi-task policy to perform well in unseen tasks sampled from the same distribution. The task identities of the unseen tasks are not provided. To perform well, the policy must infer the tas…

2019-09-25abs ↗pdf ↗

Study how untrained policies explore in RL environments.

problem Challenges in reinforcement learning, especially sparse or adversarial reward structures.
method Theoretical and empirical analysis of untrained deep neural policies in a toy model.
result Untrained policies generate correlated actions and non-trivial state-visitation distributions.

New algorithms boost SAT solver performance by optimizing restart strategies.

problem Optimizing decision-making under time constraints with restarts.
method Developed online learning algorithms for a bandit problem with controlled restarts.
result Achieved O(log(τ))O(\log(τ)) and O(τlog(τ))O(\sqrt{τ\log(τ)}) regret bounds.

Simplifies large action space bandits by selecting representative actions.

problem Efficiently managing large action spaces with correlated outcomes.
method Random sampling and solving of bandit instances to identify representative actions.
result The algorithm selects a smaller set of representative actions that perform nearly as well as the full action space.

This paper analyzes switchback experiments in A/B testing, revealing key factors affecting their effectiveness.

problem Understanding the effectiveness of different switchback designs in A/B testing.
method Comprehensive comparative analysis of various switchback designs in Markovian environments, covering state-of-the-art RL estimators.
result The effectiveness of switchback designs depends on the size of the carryover effect and reward autocorrelations.

Fine-tuning LLMs with observational data can lead to spurious correlations, but DeconfoundLM can mitigate this.

problem Aligning LLMs with human preferences and business objectives using observational data.
method DeconfoundLM, a method that removes confounders from reward signals.
result DeconfoundLM improves recovery of causal relationships and mitigates spurious correlations.