New algorithm reduces online logistic regression regret without exponential constant.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper explores rate-preserving reductions between Blackwell approachability and no-regret learning.
Study shows improper learning can outperform proper learning in misspecified models.
We revisit the question of reducing online learning to approximate optimization of the offline problem. In this setting, we give two algorithms with near-optimal performance in the full information setting: they guarantee optimal regret and require only poly-logarithmically many calls to the approximation oracle per it…
The paper generalizes offset Rademacher complexities to convex and non-convex problems.
New DEC variant improves sample complexity bounds in decision making.
New algorithm reduces dynamic regret for exp-concave losses.
Reduces dynamic regret to static problem in RKHS.
The paper studies a new class of affine maximal surfaces with singularities.
New algorithm tackles smooth online learning with optimal regret.
Learning linear predictors with the logistic loss---both in stochastic and online settings---is a fundamental task in machine learning and statistics, with direct connections to classification and boosting. Existing "fast rates" for this setting exhibit exponential dependence on the predictor norm, and Hazan et al. (20…
The study classifies singularities in discrete improper affine spheres.
Two machine learning models detect anomalies in ER claims, saving up to 40% in improper payments.
Fine-grained gap-dependent regret bounds for reinforcement learning.
In this paper we consider convex improper affine maps of the 3-dimensional affine space and classify their singularities. The main tool developed is a generating family with properties that closely resembles the area function for non-convex improper affine maps.
We study online prediction where regret of the algorithm is measured against a benchmark defined via evolving constraints. This framework captures online prediction on graphs, as well as other prediction problems with combinatorial structure. A key aspect here is that finding the optimal benchmark predictor (even in hi…
We consider the problem of controlling a possibly unknown linear dynamical system with adversarial perturbations, adversarially chosen convex loss functions, and partially observed states, known as non-stochastic control. We introduce a controller parametrization based on the denoised observations, and prove that apply…
We present an efficient and practical algorithm for the online prediction of discrete-time linear dynamical systems with a symmetric transition matrix. We circumvent the non-convex optimization problem using improper learning: carefully overparameterize the class of LDSs by a polylogarithmic factor, in exchange for con…
We construct a new representation formula for indefinite improper affine spheres in terms of two para-holomorphic functions and study singularities which appear in this representation formula. As a result, it follows that cuspidal cross caps never appear as the singularities on indefinite improper affine spheres and so…
Given a pair of planar curves, one can define its generalized area distance, a concept that generalizes the area distance of a single curve. In this paper, we show that the generalized area distance of a pair of planar curves is an improper indefinite affine spheres with singularities, and, reciprocally, every indefini…
The study classifies certain types of incomplete surfaces with low curvature.
We give a conformal representation for indefinite improper affine spheres which solve the Cauchy problem for their Hessian equation. As consequences, we can characterize their geodesics and obtain a generalized symmetry principle. Then, we classify the helicoidal indefinite improper affine spheres and find a new family…
There are exactly two different types of bi-dimensional improper affine spheres: the non-convex ones can be modeled by the center-chord transform of a pair of planar curves while the convex ones can be modeled by a holomorphic map. In this paper, we show that both constructions can be generalized to arbitrary even dime…
Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this limitation, new performance measures, including dynamic regret and adaptive regr…
Regret minimization is a powerful tool for solving large-scale problems; it was recently used in breakthrough results for large-scale extensive-form game solving. This was achieved by composing simplex regret minimizers into an overall regret-minimization framework for extensive-form game strategy spaces. In this paper…
Hierarchical clustering is a popular method for analyzing data which associates a tree to a dataset. Hartigan consistency has been used extensively as a framework to analyze such clustering algorithms from a statistical point of view. Still, as we show in the paper, a tree which is Hartigan consistent with a given dens…
New bounds show simple predictors can learn complex concepts online.
We give the best possible upper bound for the number of exceptional values of the Lagrangian Gauss map of complete improper affine fronts in the affine three-space. We also obtain the sharp estimate for weakly complete case. As an application of this result, we provide a new and simple proof of the parametric affine Be…
Given a compact Riemannian manifold with boundary, we prove that the space of embedded, which may be improper, free boundary minimal hypersurfaces with uniform area and Morse index upper bound is compact in the sense of smoothly graphical convergence away from finitely many points. We show that the limit of a sequence …
New bounds for non-convex estimators without Bernstein condition.
Bayesian evidence computation revisited for model selection with improper priors.
New algorithms achieve near-optimal cumulative loss in nonparametric online learning and games.
Improper affine spheres have played an important role in the development of geometric methods for the study of the Hessian one equation. Here, we review most of the advances we have made in this direction during the last twenty years.
We present in this article a survey of recent results in value distribution theory for the Gauss maps of several classes of immersed surfaces in space forms, for example, minimal surfaces in Euclidean -space (=3 or 4), improper affine spheres in the affine 3-space and flat surfaces in hyperbolic 3-space. In parti…
Improved multi-group learning with group-realizable concepts.
The area distance to a convex plane curve is an important concept in computer vision. In this paper we describe a strong link between area distances and improper affine spheres. This link makes possible a better understanding of both theories. The concepts of the theory of affine spheres lead to a new definition of an …
This paper provides an algorithm for simulating improper (or noncircular) complex-valued stationary Gaussian processes. The technique utilizes recently developed methods for multivariate Gaussian processes from the circulant embedding literature. The method can be performed in operations, where…
Algorithm minimizes regret and converges to equilibria in Markov games.
We consider regret minimization in repeated games with non-convex loss functions. Minimizing the standard notion of regret is computationally intractable. Thus, we define a natural notion of regret which permits efficient optimization and generalizes offline guarantees for convergence to an approximate local optimum. W…
The paper tackles best arm identification with minimal regret in experiments.
New algorithms minimize simple and cumulative regret in contextual bandits.
New examples of non-bumpy metrics on spheres and projective spaces with multiplicity.
There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are a sub-class of MABs where, at every time step, the learner has access to side in…
New algorithm minimizes worst-case regret in uncertain, time-varying dynamics.
The paper minimizes Borda regret in dueling bandits models.
This paper begins with a study on the dual representations of risk and regret measures and their impact on modeling multistage decision making under uncertainty. A relationship between risk envelopes and regret envelopes is established by using the Lagrangian duality theory. Such a relationship opens a door to a decomp…
New online conformal prediction methods minimize strongly adaptive regret and achieve near-optimal coverage.
We study the question of learning an adversarially robust predictor. We show that any hypothesis class with finite VC dimension is robustly PAC learnable with an improper learning rule. The requirement of being improper is necessary as we exhibit examples of hypothesis classes with finite VC…