Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

306089119 · Jun 202019922001200920172026
48 results for sequential allocation

Study resource allocation strategies in sequential decisions with unknown rewards.

problem Sequential resource allocation with unknown rewards.
method Design combinatorial multi-armed bandit algorithms for discrete or continuous budgets.
result Prove algorithms achieve logarithmic cumulative regret under semi-bandit feedback.

Sequential processing biases asset allocation in artificial stock markets.

problem Systematic bias in asset allocation due to sequential processing of order books.
method Examined the impact of sequential versus parallel clearing mechanisms on multi-asset price dynamics.
result Sequential processing introduces a significant bias affecting the allocation of traders' capital.

New method optimizes Gaussian process allocation for BO.

problem Existing methods for inducing point allocation in BO hinder performance.
method Proposes a new allocation strategy using quality-diversity decomposition.
result Demonstrates improved BO performance through local high-fidelity modeling.

In treatment allocation problems the individuals to be treated often arrive sequentially. We study a problem in which the policy maker is not only interested in the expected cumulative welfare but is also concerned about the uncertainty/risk of the treatment outcomes. At the outset, the total number of treatment assign…

2017-05-28abs ↗pdf ↗

Annealed Entropic Allocation improves ranking and selection by mitigating hard switching and improving finite-budget discrimination.

problem Sequential budget allocation in ranking and selection
method Annealed weighted soft-min framework
result Surrogate converges uniformly to the hard minimum, soft-min weights concentrate on active challengers, and target allocation map is continuous.

Adaptive RL optimizes testing resource allocation for dynamic software environments.

problem Optimizing resource allocation for evolving software testing environments.
method Integrates Q-learning with hybrid reward design for sequential decision-making.
result Consistently outperforms static and optimization-based baselines in simulation studies.

Adaptive AI delegation framework for dynamic decision authority allocation.

problem Dynamic allocation of decision authority to AI-generated recommendations under evolving evidence quality and uncertainty.
method Formulated as a Governance-Aware POMDP, using Bayesian inference for informational state estimation and sequential optimization for authority allocation.
result Sequential Bayesian governance provides the strongest general-purpose policy across AI-quality regimes, adapting to evolving evidence.

Study on optimizing task allocation for agents receiving proposals sequentially.

problem Optimizing task allocation for agents receiving proposals sequentially.
method An agent receives task proposals sequentially and can either accept or reject a proposal. The study considers two scenarios: known reward function but unknown task duration distribution, and unknown reward function.
result Regret incurred by the agent in both scenarios.

Study optimizes portfolio allocation policies using off-policy data and constraints.

problem Optimizing portfolio allocation policies under constraints using off-policy data.
method Solves a minimax objective with off-policy estimators and online learning to control constraint violations.
result Constructs near-optimal allocation policies for various regimes of operation and constraints.

Adaptive batching improves Gaussian process surrogates for noisy level set estimation.

problem Learning the level set of noisy simulator responses.
method Developed four novel adaptive batching schemes for Gaussian process metamodels.
result Adaptive batching brings significant computational speed-ups with minimal loss of modeling fidelity.

Bridges uplift modeling and sequential decision-making with online budget allocation.

problem Treatment allocation under budget constraints in digital advertising.
method Budget-Constrained Causal Bandits (BCCB) integrates learning, exploration, and budget pacing.
result Data-efficiency crossover: BCCB operates effectively from the first user, 3-5x lower performance variance.

Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using value function approximation, we derive an approximately optimal allocation policy. We show that this poli…

2017-10-07abs ↗pdf ↗

This paper proposes a new method to optimize portfolio allocation with transaction costs using Wiener chaos expansion.

problem Optimizing portfolio allocation with transaction costs in multi-period settings.
method Wiener chaos expansion approach to represent and solve the optimization problem.
result The proposed method finds an optimal strategy for portfolio allocation with transaction costs.

Algorithm reduces long-term policy regret in ML decision-making.

problem Capturing long-term impacts of ML decisions in communities.
method Modeling communities as arms in a multi-armed bandit problem, defining policy regret as a stronger metric than external regret.
result Algorithm achieves provably sub-linear policy regret for long time horizons.

We study a sequential resource allocation problem between a fixed number of arms. On each iteration the algorithm distributes a resource among the arms in order to maximize the expected success rate. Allocating more of the resource to a given arm increases the probability that it succeeds, yet with a cut-off. We follow…

2018-03-28abs ↗pdf ↗

Maximising the detection of intrusions is a fundamental and often critical aim of perimeter surveillance. Commonly, this requires a decision-maker to optimally allocate multiple searchers to segments of the perimeter. We consider a scenario where the decision-maker may sequentially update the searchers' allocation, lea…

2018-10-04abs ↗pdf ↗

New framework for fair online allocation in continuous time with deadlines.

problem Fair allocation under deadlines in continuous-time online learning.
method Continuous-time utility maximization, dual ascent optimization for time averages.
result Achieves ildeO(B1/2) ilde{O}(B^{-1/2}) regret bound in the absence of statistical knowledge.

Study optimizes sampling to avoid extreme tail risks in unknown heavy-tailed distributions.

problem Identify optimal alternative with minimal extreme tail risk from unknown heavy-tailed distributions.
method Data-driven sequential sampling policies to maximize likelihood of selecting the optimal alternative.
result Proposed methods outperform existing approaches in identifying the optimal alternative.

Dynamic risk factor model improves portfolio performance in high dimensions.

problem Dynamic portfolio allocation in high-dimensional financial markets.
method Time-varying sparsity on factor loadings, sequential learning of parameters and volatilities.
result Significant portfolio performance improvements and higher utility gains.

Develops adaptive framework for estimating survival effects with censoring.

problem Estimating causal effects in survival data with censoring.
method Derives semiparametric efficiency bound, proposes efficiency-optimal allocation policy, and develops Adaptive Survival Estimator (ASE).
result ASE achieves asymptotic normality via martingale central limit theorem and demonstrates efficiency gains over uniform randomization.

RL learns to ignore factors in factor investing portfolios.

problem Combining factor investing and reinforcement learning for optimal portfolio allocation.
method RL agent learns through sequential allocations based on firms' characteristics using Dirichlet distributions.
result RL-based portfolios are very close to equally-weighted allocations, indicating agnostic factor learning.

HL algorithms improve resource allocation in cloud environments.

problem Sequential decision-making under uncertainty with exogenous variables.
method HL algorithms leverage exogenous variable samples to infer counterfactual consequences.
result HL algorithms outperform classic methods and reinforcement learning in resource allocation.

Optimal online data collection for semiparametric inference reduces regret.

problem Sequential data collection decisions for efficient estimation under budget constraints.
method Online Moment Selection framework; Explore-then-Commit and Explore-then-Greedy policies.
result Online data collection policies achieve zero regret relative to an oracle policy.

Framework for online resource allocation using social welfare functions.

problem Optimal allocation of resources over time steps in a population.
method Confidence sequence framework for SWF-based online learning and inference, valid for any monotonic, concave, and Lipschitz-continuous SWF.
result Achieves near-optimal regret of ildeO(n+nkT) ilde{O}(n+\sqrt{nkT}) for SWF-agnostic algorithm SWF-UCB.

Study capacity constraints in continual learning with a simple model.

problem Understanding optimal resource allocation for agents with limited memory and compute resources.
method Analyzes a capacity-constrained linear-quadratic-Gaussian (LQG) sequential prediction problem and demonstrates optimal capacity allocation strategies.
result Derives a solution to the capacity-constrained LQG sequential prediction problem and shows how to optimally allocate capacity across sub-problems in the steady state.

Batch Thompson Sampling reduces exploration-exploitation trade-off in online decision making.

problem Balancing exploration and exploitation in online decision making.
method Introducing a batch Thompson Sampling framework for stochastic multi-arm bandit and linear contextual bandit problems.
result Achieves asymptotic regret bound with O(logT)O(\log T) batch queries, significantly reducing interactions.

New method improves treatment effect estimation in adaptive experiments with noncompliance.

problem Estimating average treatment effect in adaptive experiments with binary instrumental variable.
method AMRIV estimator that balances outcome noise and compliance variability.
result AMRIV achieves semiparametric efficiency bound and is robust to noncompliance.

The paper improves PCS approximation for ranking and selection under limited simulation budgets.

problem Improving finite sample performance in Ranking and Selection.
method Develops a Bahadur-Rao type expansion for PCS, proposes a novel FCBA policy.
result FCBA policy achieves superior PCS performance compared to traditional methods.

Heterogeneous SVO leads to diverse policies in sequential social dilemmas.

problem Understanding how diverse social value orientations affect behavior in sequential social dilemmas.
method Extending prior reinforcement learning studies, we instantiated heterogeneous SVO in a sequential social dilemma setting and measured task-specific diversity metrics.
result Heterogeneous SVO leads to meaningfully diverse policies across various incentive structures.

New approach optimizes decisions based on uncertainty in predictions.

problem Mismatch between prediction accuracy and decision loss in sequential design.
method Directional uncertainty-guided approach to sequential experimental design.
result Directional uncertainty-based design stops earlier and performs better.

We consider the classical problem of sequential resource allocation where a decision maker must repeatedly divide a budget between several resources, each with diminishing returns. This can be recast as a specific stochastic optimization problem where the objective is to maximize the cumulative reward, or equivalently …

2019-02-12abs ↗pdf ↗

Enhances multi-project scheduling with multiple priority rules.

problem Resource allocation in multi-project scheduling with limited time and resources.
method Simulation-based approach using composite priority rules.
result Increased probability of finding schedules with shortest duration.

Sparse Gaussian process quantile regression tackles computational challenges in Bayesian quantile regression.

problem Nonconjugacy and computational cost in Gaussian process quantile regression.
method Sparse Gaussian process framework with Laplace approximation, adaptive inducing-input placement, and sequential data acquisition.
result Accuracy of Laplace approximation and effectiveness of adaptive mechanisms in reducing predictive uncertainty.

We consider a multi-armed bandit problem with covariates. Given a realization of the covariate vector, instead of targeting the treatment with highest conditional expectation, the decision maker targets the treatment which maximizes a general functional of the conditional potential outcome distribution, e.g., a conditi…

2020-01-29abs ↗pdf ↗

We study a novel machine learning (ML) problem setting of sequentially allocating small subsets of training data amongst a large set of classifiers. The goal is to select a classifier that will give near-optimal accuracy when trained on all data, while also minimizing the cost of misallocated samples. This is motivated…

2015-12-31abs ↗pdf ↗