arXiv research

Study identifies change points in piecewise constant reward functions with fixed exploration budget.

A method identifies abrupt changes in functions with fixed confidence under noisy feedback.

We study online optimization of smoothed piecewise constant functions over the domain [0, 1). This is motivated by the problem of adaptively picking parameters of learning algorithms as in the recently introduced framework by Gupta and Roughgarden (2016). Majority of the machine learning literature has focused on Lipsc…

We investigate the piecewise-stationary combinatorial semi-bandit problem. Compared to the original combinatorial semi-bandit problem, our setting assumes the reward distributions of base arms may change in a piecewise-stationary manner at unknown time steps. We propose an algorithm, \texttt{GLR-CUCB}, which incorporat…

Study shows nonstationary bandits require T-dependent regret even with minimal nonstationarity.

DAL enhances black-box bandit algorithms for non-stationary environments.

Study adapts combinatorial semi-bandit for piecewise stationary, causally related rewards.

Algorithm identifies best arm in piecewise stationary linear bandits with minimal samples.

Study shows efficient neural network approach for stochastic bandits.

We introduce GLR-klUCB, a novel algorithm for the piecewise iid non-stationary bandit problem with bounded rewards. This algorithm combines an efficient bandit algorithm, kl-UCB, with an efficient, parameter-free, changepoint detector, the Bernoulli Generalized Likelihood Ratio Test, for which we provide new theoretica…

New approach limits regret in non-stationary bandits.

New algorithms detect changes in non-stationary MABs for better performance.

The multi-armed bandit problem has been extensively studied under the stationary assumption. However in reality, this assumption often does not hold because the distributions of rewards themselves may change over time. In this paper, we propose a change-detection (CD) based framework for multi-armed bandit problems und…

The fused lasso is analyzed for high-dimensional piecewise-constant regression coefficients.

The paper tackles efficient change point detection with limited samples.

We show that on a two-dimensional compact nontrapping manifold with strictly convex boundary, a piecewise constant function is determined by its integrals over geodesics. In higher dimensions, we obtain a similar result if the manifold satisfies a foliation condition. These theorems are based on iterating a local uniqu…

Cascading bandit (CB) is a popular model for web search and online advertising, where an agent aims to learn the $K$ most attractive items out of a ground set of size $L$ during the interaction with a user. However, the stationary CB model may be too simple to apply to real-world problems, where user preferences may ch…

GraN-GAN normalizes gradients for better GAN performance.

This paper studies the impact of limited switches on resource-constrained dynamic pricing with demand learning. We focus on the classical price-based blind network revenue management problem and extend our results to the bandits with knapsacks problem. In both settings, a decision maker faces stochastic and distributio…

The Heston stochastic volatility model is a standard model for valuing financial derivatives, since it can be calibrated using semi-analytical formulas and captures the most basic structure of the market for financial derivatives with simple structure in time-direction. However, extending the model to the case of time-…

Algorithm reduces decision-making errors in multi-agent bandit problems.

We show injectivity of the geodesic X-ray transform on piecewise constant functions when the transform is weighted by a continuous matrix weight. The manifold is assumed to be compact and nontrapping of any dimension, and in dimension three and higher we assume a foliation condition. We make no assumption regarding con…

New algorithm catches moving subspaces in bandit problems.

We show that on a two-dimensional compact nontrapping Riemannian manifold with strictly convex boundary, a piecewise constant function can be recovered from its integrals over geodesics. We adapt the injectivity proof which uses variations through geodesics to recover the function and we improve this result when the ma…

In this paper we develop an approach to conformal geometry of piecewise flat metrics on manifolds. In particular, we formulate the combinatorial Yamabe problem for piecewise flat metrics. In the case of surfaces, we define the combinatorial Yamabe flow on the space of all piecewise flat metrics associated to a triangul…

Paper designs a bandit algorithm without reward distribution info.

Investigates chaotic financial time series with monthly contributions and devaluation.

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where the reward distributions may change in a piecewise-stationary fashion at unknown …

The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.

New algorithm reduces individual regret and communication costs in cooperative bandits.

Piecewise constant denoising can be solved either by deterministic optimization approaches, based on the Potts model, or by stochastic Bayesian procedures. The former lead to low computational time but require the selection of a regularization parameter, whose value significantly impacts the achieved solution, and whos…

Neural network models improve survival analysis with reduced computation time.

We show that if $g$ is a Riemannian metric on a closed piecewise locally symmetric manifold $M$, then the lift of $g$ to the universal cover $\widetilde{M}$ has a discrete isometry group. We also show that the index $[\Isom(\widetilde{M}): π_1(M)]$ is bounded by a constant independent of $g$.

Defines hierarchical clustering axioms for various densities.

Study Whittle index learning algorithms for restless bandits with constant stepsizes.

Narendra-Shapiro (NS) algorithms are bandit-type algorithms that have been introduced in the sixties (with a view to applications in Psychology or learning automata), whose convergence has been intensively studied in the stochastic algorithm literature. In this paper, we adress the following question: are the Narendra-…

The paper proves a theorem for discretizing Gaussian curvature on surfaces.

A piecewise constant curvature manifold is a triangulated manifold that is assigned a geometry by specifying lengths of edges and stipulating that for a chosen background geometry (Euclidean, hyperbolic, or spherical), each simplex has an isometric embedding into the background geometry with the chosen edge lengths. Ad…

New GMM models fit high-dimensional data with fewer parameters.

We prove a Gauss-Bonnet type formula for Riemann-Finsler surfaces of non-constant indicatrix volume and with regular piecewise smooth boundary. We give a Hadamard type theorem for N-parallels of a Landsberg surface.

Transformers struggle to approximate smooth functions, relying on piecewise constant approximations.

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $Ω$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function. Our density estimate is a piecewise constant function defined on a binary partition o…

A piecewise flat manifold is a triangulated manifold given a geometry by specifying edge lengths (lengths of 1-simplices) and specifying that all simplices are Euclidean. We consider the variation of angles of piecewise flat manifolds as the geometry varies in a particular way, which we call a conformal variation. This…

XGBoost is often presented as the algorithm that wins every ML competition. Surprisingly, this is true even though predictions are piecewise constant. This might be justified in high dimensional input spaces, but when the number of features is low, a piecewise linear model is likely to perform better. XGBoost was exten…

We introduce a new multi-dimensional nonlinear embedding -- Piecewise Flat Embedding (PFE) -- for image segmentation. Based on the theory of sparse signal recovery, piecewise flat embedding with diverse channels attempts to recover a piecewise constant image representation with sparse region boundaries and sparse clust…

New method uses DC functions for piecewise linear regression.

A new method solves complex financial equations efficiently.

Paper introduces differentiable sorting and ranking with $O(n \log n)$ time complexity.