Gittins index optimizes decision-making under uncertainty, even in complex scenarios.
problem Optimal decision-making under uncertainty.
method Gittins index optimizes allocation of resources among uncertain options.
result Gittins index can be effectively applied to practical problems, including Bayesian optimization and queue latency minimization.
New RL algorithms learn Gittins indices for unknown Markovian states.
problem Learning Gittins indices for unknown Markovian state transitions.
method Tabular (QGI) and Deep RL (DGN) algorithms based on retirement formulation.
result Lower run time, less storage space, better convergence to Gittins index.
I analyse the frequentist regret of the famous Gittins index strategy for multi-armed bandits with Gaussian noise and a finite horizon. Remarkably it turns out that this approach leads to finite-time regret guarantees comparable to those available for the popular UCB algorithm. Along the way I derive finite-time bounds…
Bayesian optimization with cost-awareness using Gittins index.
problem Optimizing unknown functions with limited data evaluations and costs.
method Developed a connection between cost-aware Bayesian optimization and the Pandora's Box problem, using the Gittins index as an acquisition function.
result The Gittins index-based acquisition function performs well in cost-aware Bayesian optimization, especially in high dimensions.
Study of bandit problem with Poisson decision times and Lévy processes.
problem Continuous-time multi-armed bandit problem with Poisson decision times.
method Gittins index policy applied to spectrally one-sided Lévy processes.
result Gittins index converges to classical Lévy bandit index.
This note gives a short, self-contained, proof of a sharp connection between Gittins indices and Bayesian upper confidence bound algorithms. I consider a Gaussian multi-armed bandit problem with discount factor γ. The Gittins index of an arm is shown to equal the γ-quantile of the posterior distribution of the arm'…
This paper proposes a general framework of multi-armed bandit (MAB) processes by introducing a type of restrictions on the switches among arms evolving in continuous time. The Gittins index process is constructed for any single arm subject to the restrictions on switches and then the optimality of the corresponding Git…
New dynamic allocation methods for multi-armed bandit models.
problem Dynamic allocation problems in multi-armed bandit models.
method New types of dynamic allocation problems and proofs for Gittins index decomposition.
result New proofs for Gittins index decomposition and related results.
We study dynamic allocation problems for discrete time multi-armed bandits under uncertainty, based on the the theory of nonlinear expectations. We show that, under strong independence of the bandits and with some relaxation in the definition of optimality, a Gittins allocation index gives optimal choices. This involve…
Gittins indices provide an optimal solution to the classical multi-armed bandit problem. An obstacle to their use has been the common perception that their computation is very difficult. This paper demonstrates an accessible general methodology for the calculating Gittins indices for the multi-armed bandit with a detai…
This paper is about index policies for minimizing (frequentist) regret in a stochastic multi-armed bandit model, inspired by a Bayesian view on the problem. Our main contribution is to prove that the Bayes-UCB algorithm, which relies on quantiles of posterior distributions, is asymptotically optimal when the reward dis…
This paper proposes an active sampling method for meta-learning using MDPs.
problem Exploiting relationships between tasks and classes in meta-learning.
method Formulates the problem as a MDP, uses UCB, Gittins Index, and linear programming solutions.
result Significant reductions in sample complexity for active selection schemes.
The Knowledge Gradient (KG) policy was originally proposed for online ranking and selection problems but has recently been adapted for use in online decision making in general and multi-armed bandit problems (MABs) in particular. We study its use in a class of exponential family MABs and identify weaknesses, including …
Multi-armed bandits are a quintessential machine learning problem requiring the balancing of exploration and exploitation. While there has been progress in developing algorithms with strong theoretical guarantees, there has been less focus on practical near-optimal finite-time performance. In this paper, we propose an …
We consider a finite-horizon multi-armed bandit (MAB) problem in a Bayesian setting, for which we propose an information relaxation sampling framework. With this framework, we define an intuitive family of control policies that include Thompson sampling (TS) and the Bayesian optimal policy as endpoints. Analogous to TS…
Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that it can use to obtain information to help identify the optimal model. To better u…
A new clustering evaluation index based on density estimation.
problem Improving internal clustering evaluation indices.
method The index is a mixture of Ambiguous and Similarity sub-indices, calculated using density estimation.
result The new index significantly outperforms other internal clustering evaluation indices.
Study on symmetric operators on non-compact manifolds, focusing on their index modulo 2.
problem Investigating elliptic operators with a specific symmetry and their index modulo 2.
method Analysis of Callias-type operators on non-compact manifolds, establishing mod 2 versions of index theorems.
result Established mod 2 versions of the Gromov-Lawson relative index theorem, Callias index theorem, and Boutet de Monvel's index theorem for Toeplitz operators.
New index formula connects numerical and K-theoretic indices.
problem Equivariant index for proper group actions on manifolds.
method Developed a trace on group conjugacy classes to relate numerical and K-theoretic indices. result Shows that numerical index equals K-theoretic index under certain conditions. The paper explores global index formulas for one-dimensional holomorphic foliations.
problem Global index formulas for one-dimensional holomorphic foliations.
method Microlocal point of view and short proofs for existing index formulas.
result Generalizations of existing index formulas.
Explain Arnold's proof of the Morse index theorem using Maslov index.
problem Proving the Morse index theorem in Riemannian geometry.
method Using symplectic arguments and the Maslov index.
result Self-contained exposition of Arnold's proof.
Paper introduces danceability index as a new bridge index definition.
problem Defining the bridge index in various mathematical contexts.
method Proves danceability index as equivalent to bridge index, extends to virtual knots.
result Danceability index is a new equivalent definition of the bridge index.
The p-index improves investment performance for NYSE stocks but not for SSE stocks.
problem Improving investment performance for stocks using the p-index.
method Comparing different p-ratio strategies and empirical efficient frontiers for SSE and NYSE stocks.
result The p-index enhances investment performance for NYSE stocks but not for SSE stocks.
Study Whittle index learning algorithms for restless bandits with constant stepsizes.
problem Optimizing decisions in restless multi-armed bandits with constant stepsizes.
method Developed Q-learning algorithms with constant stepsizes for index learning in restless bandits, extending to DQN and function approximations.
result The algorithms learn the Whittle index effectively.
A new index rebalancing strategy reduces large constituent weights without undesirable effects.
problem Undesirable effects of current Nasdaq-100 index rebalancing.
method A simple rebalancing strategy that avoids undesirable effects.
result Preserves the order of index weights and prevents maximum weight increase.
We study bounded pseudoconvex domains in complex Euclidean space. We define an index associated to the boundary and show this new index is equivalent to the Diederich-Fornæss index defined in 1977. This connects the Diederich-Fornæss index to boundary conditions and refines the Levi pseudoconvexity. We also prove the $…
Study on symmetric braid index of ribbon knots, deriving bounds and characterizations.
problem Understanding the symmetric braid index of ribbon knots.
method Defining symmetric braid index, using Khovanov homology, and calculating bounds.
result Existence of knots with symmetric braid index greater than braid index.
Study proves bridge and braid indices match for twist positive knots.
problem Determining when bridge and braid indices are equal for knots.
method Used knot Floer torsion order to prove for all twist positive knots.
result Bridge and braid indices coincide for all twist positive knots.
Minimal grid diagrams for 15,735 knots with 14 crossings and arc index 14.
problem Representing prime knots with 14 crossings and specific arc indices using grid diagrams.
method Enumerated all prime knots with 14 crossings, categorized by arc index, and found minimal grid diagrams for those with arc index 14.
result 8,027 knots with arc index 13 and 15,735 knots with arc index 14 were represented by minimal grid diagrams.
Given a proper, cocompact action of a Lie groupoid, we define a higher index pairing between invariant elliptic differential operators and smooth groupoid cohomology classes. We prove a cohomological index formula for this pairing by applying the van Est map and algebraic index theory. Finally we discuss in examples th…
Proves the index of a Möbius band in 4D ball equals 5.
problem Determining the Morse index of critical non-orientable surfaces.
method Comparison theorem between Steklov spectral index and energy index.
result Proves the index of critical Möbius band in B4 equals 5. Finite index subgroups of relatively hyperbolic groups have equal index.
problem Finite index subgroups of relatively hyperbolic groups have equal index.
method Demonstrating that the number of simplices in a simplicial classifying space grows linearly with index.
result Finite index subgroups of relatively hyperbolic groups have equal index.
Enhanced indexation uses equity and index options for better performance.
problem Improving portfolio performance through enhanced indexation.
method Integrating index options into an enhanced indexation strategy based on second-order stochastic dominance.
result Introducing option strategies in enhanced indexation leads to improved out-of-sample performance.
The abstract discusses connecting quantum mechanics and algebraic index theories.
problem Exploring the connection between quantum mechanics and algebraic index theories.
method Explains how the classical algebraic index theorem can be proved in terms of BV quantization of topological quantum mechanics and 2d chiral CFT.
result Shows how the generating function of all genus Gromov-Witten invariants on elliptic curves is mirror equivalent to an elliptic chiral index.
Researchers construct an index map for contact manifolds using K-theory.
problem Constructing an index for maximally hypoelliptic operators on contact manifolds.
method Using Higson's construction for symbol class in K-theory, they derive a series of maps whose induced map in K-theory is the Heisenberg Atiyah-Singer index map.
result Explicit construction of a series of maps leading to the Heisenberg Atiyah-Singer index map.
New index formula for hypoelliptic operators on manifolds.
problem Index computation for hypoelliptic differential operators.
method Generalized index formula for *-maximally hypoelliptic operators.
result Explicit index computations for Hormander's sum of squares operators.
Deep learning predicts market sensitivities for cost-effective index tracking.
problem Costly and impractical replication of index funds.
method Learning to predict market sensitivities using deep learning models.
result Significant reduction in prediction errors compared to historical methods.
Study on minimal surfaces with free boundary in a half-space, improving index estimates.
problem Non-existence of index two embedded minimal surfaces with free boundary in a half-space.
method Improved estimates of Neumann and Dirichlet indices, simplified proof of lower bounds.
result Answered Ambrozio et al.'s question and provided new lower bounds.
Listed 19,513 prime knots with arc index 12-16.
problem Tabulating prime knots with specific arc indices.
method Provided list of prime knots with minimal grid diagrams.
result 19,513 prime knots with arc index 12-16.
An upper bound of the superbridge index of the connected sum of two knots is given in terms of the braid index of the summands. Using this upper bound and minimal polygonal presentations, we give an upper bound in terms of the superbridge index and the bridge index of the summands when they are torus knots. In contrast…
A new stock index model simplifies high-dimensional stock data.
problem Reflecting the overall stock market activity in high-dimensional data.
method Manifold learning and feature detection on discrete Laplace-Beltrami operator.
result The MF index series approximates the stock market better and has lower risk.
New method accurately reconstructs Russell 3000 index, revealing crowded portfolios.
problem Crowding in index portfolios during reconstitution events.
method Developed a Python package for accurate index reconstruction using CRSP US Stock data.
result Annual Russell 3000 portfolios are more crowded than quarterly ones, suggesting lower transaction costs.
In this paper we study the chord index of virtual knots, which can be thought of as an extension of the chord parity. We show how to use the chord index to define finite type invariants of virtual knots. The notions of indexed Jones polynomial and indexed quandle are introduced, which generalize the classical Jones pol…
Formula for Z_2-valued index of symmetric operators on manifolds.
problem Index of symmetric operators on manifolds with boundary.
method Cohomological formula for Z_2-valued index.
result A formula for the Z_2-valued index of operators on manifolds.
We introduce a notion of cobordism of Callias-type operators over complete Riemannian manifolds and prove that the index is preserved by such a cobordism. As an application we prove a gluing formula for Callias-type index. In particular, a usual index of an elliptic operator on a compact manifold can be computed as a s…
We study differential operators on complete Riemannian manifolds which act on sections of a bundle of finite type modules over a von Neumann algebra with a trace. We prove a relative index and a Callias-type index theorems for von Neumann indexes of such operators. We apply these results to obtain a version of Atiyah's…
Proves a lattice version of the Atiyah-Singer index theorem.
problem Index problems of Wilson-Dirac operators on lattice approximations of manifolds.
method Formulates and proves a K-theoretic formula for an index-type invariant. result Main theorem gives a formula for an index-type invariant of operators on lattice approximations of closed integral affine manifolds.
Improved upper bound on superbridge index from 5b-3 to 3b-1.
problem Improving bounds on superbridge index for knots.
method Improved upper bound formula for superbridge index.
result Upper bound on superbridge index reduced from 5b-3 to 3b-1.