Improved analysis of UCRL2 with empirical Bernstein inequality reduces exploration-exploitation regret.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Sharp inequalities for matrix means with unknown variance.
New inequality for ternary variables improves on existing measures.
Study introduces new Bernstein inequalities for dependent data in Hilbert spaces.
Law of iterated logarithm derived from betting strategy.
We prove semi-empirical concentration inequalities for random variables which are given as possibly nonlinear functions of independent random variables. These inequalities describe concentration of random variable in terms of the data/distribution-dependent Efron-Stein (ES) estimate of its variance and they do not requ…
In this paper we study nonconvex penalization using Bernstein functions whose first-order derivatives are completely monotone. The Bernstein function can induce a class of nonconvex penalty functions for high-dimensional sparse estimation problems. We derive a thresholding function based on the Bernstein penalty and di…
We present a new PAC-Bayesian generalization bound. Standard bounds contain a $\sqrt{L_n \cdot \KL/n}$ complexity term which dominates unless , the empirical error of the learning algorithm's randomized predictions, vanishes. We manage to replace by a term which vanishes in many more situations, essentially …
Machine learning selects the best prediction rules from noisy data.
Paper refines PAC-Bayes bounds for bandit problems.
The betting CI outperforms classical methods in constructing confidence intervals for bounded means.
We give improved constants for data dependent and variance sensitive confidence bounds, called empirical Bernstein bounds, and extend these inequalities to hold uniformly over classes of functionswhose growth function is polynomial in the sample size n. The bounds lead us to consider sample variance penalization, a nov…
New concentration inequality for U-statistics of Markov chains.
New algorithm learns policies without uniform overlap assumption.
We introduce a Bernstein-type inequality which serves to uniformly control quadratic forms of gaussian variables. The latter can for example be used to derive sharp model selection criteria for linear estimation in linear regression and linear inverse problems via penalization, and we do not exclude that its scope of a…
This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be included. We show that when the stochastic processes satisfy a generalized Bernstein-type inequality, a u…
Minimal surface equation results in constant solutions on RCD spaces.
We improve bounds for stochastic processes, especially those with heavy tails.
New algorithms avoid non-monotonic risk curves in statistical learning.
New bound improves on weighted majority vote risk estimation.
The study models insurance dependence using Bernstein copulas.
New method improves RL in continuous spaces with kernel smoothing.
Proves new concentration inequalities for sub-gaussian and sub-exponential variables.
Study Bernstein-Gelfand-Gelfand complexes on Lipschitz domains, computing cohomology and applying to elasticity models.
We are concerned with obtaining novel concentration inequalities for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We not only derive - for the first time - distribution-free Bernstein-like deviation bounds with sublinear exponents in deviation size for missing mass, but …
In this paper we study nonconvex penalization using Bernstein functions. Since the Bernstein function is concave and nonsmooth at the origin, it can induce a class of nonconvex functions for high-dimensional sparse estimation problems. We derive a threshold function based on the Bernstein penalty and give its mathemati…
This note gives a simple analysis of a randomized approximation scheme for matrix multiplication proposed by Sarlos (2006) based on a random rotation followed by uniform column sampling. The result follows from a matrix version of Bernstein's inequality and a tail inequality for quadratic forms in subgaussian random ve…
We study model-based reinforcement learning in an unknown finite communicating Markov decision process. We propose a simple algorithm that leverages a variance based confidence interval. We show that the proposed algorithm, UCRL-V, achieves the optimal regret up to logarithmic factors…
Study improves self-normalized bounds for vector-valued processes beyond sub-Gaussianity.
The paper develops concentration inequalities for structured random data, extending beyond independent terms.
Spacelike surfaces in Generalized Robertson-Walker spacetimes whose mean curvature function satisfies a natural nonlinear inequality are analyzed. Several uniqueness and nonexistence results for such compact spacelike surfaces are proved. In the nonparametric case, new Calabi-Bernstein type problems are solved as a con…
Paper estimates curvature of minimal surfaces in a specific geometric space.
We derive exponential tail inequalities for sums of random matrices with no dependence on the explicit matrix dimensions. These are similar to the matrix versions of the Chernoff bound and Bernstein inequality except with the explicit matrix dimensions replaced by a trace quantity that can be small even when the dimens…
We give concentration bounds for martingales that are uniform over finite times and extend classical Hoeffding and Bernstein inequalities. We also demonstrate our concentration bounds to be optimal with a matching anti-concentration inequality, proved using the same method. Together these constitute a finite-time versi…
Paper analyzes Nyström regularization for time series forecasting with sequential sub-sampling.
Using simple facts from harmonic analysis, namely Bernstein inequality and Plansherel isometry, we prove that the pseudodifferential equation improves the Sobolev regularity of solutions provided the potential is integrable with the critical power .
Deep neural networks are optimal for dependent data using PAC-Bayes bounds.
We obtain a Bernstein-type inequality for sums of Banach-valued random variables satisfying a weak dependence assumption of general type and under certain smoothness assumptions of the underlying Banach norm. We use this inequality in order to investigate in the asymptotical regime the error upper bounds for the broad …
We give tight concentration bounds for mixtures of martingales that are simultaneously uniform over (a) mixture distributions, in a PAC-Bayes sense; and (b) all finite times. These bounds are proved in terms of the martingale variance, extending classical Bernstein inequalities, and sharpening and simplifying prior wor…
Exponential inequalities are main tools in machine learning theory. To prove exponential inequalities for non i.i.d random variables allows to extend many learning techniques to these variables. Indeed, much work has been done both on inequalities and learning theory for time series, in the past 15 years. However, for …
When I first encountered PAC-Bayesian concentration inequalities they seemed to me to be rather disconnected from good old-fashioned results like Hoeffding's and Bernstein's inequalities. But, at least for one flavour of the PAC-Bayesian bounds, there is actually a very close relation, and the main innovation is a cont…
The study sharpens local Bernstein estimates for Laplace eigenfunctions on compact manifolds.
Estimates barycenter in geodesic spaces with finite sample bounds.
Develops a deep learning framework for various data types.
Develops a method for identifying structured dynamical systems from data.
We propose to use nonparametric Bernstein copulas as bivariate pair-copulas in high-dimensional vine models. The resulting smooth and nonparametric vine copulas completely obviate the error-prone need for choosing the pair-copulas from parametric copula families. By means of a simulation study and an empirical analysis…
The paper improves confidence regions for band-limited functions using tighter norm bounds and majority voting.
We explore a connection between the Finslerian area functional and well-investigated Cartan functionals to prove new Bernstein theorems, uniqueness and removability results for Finsler-minimal graphs, as well as enclosure theorems and isoperimetric inequalities for minimal immersions in Finsler spaces. In addition, we …