Deviation inequalities for stochastic approximation methods.
problem Establishing bounds on the deviation of stochastic approximation methods.
method Martingale approximation method for separately Lipschitz functions.
result Established various deviation inequalities for stochastic approximation by averaging and minimization.
Deviation inequalities and limit laws for random walks on metric spaces.
problem Understanding random walks on metric spaces with contracting isometries.
method Adapting Gouëzel's pivotal time construction to establish deviation inequalities.
result Exponential bounds and limit laws for random walks on mapping class groups and CAT(0) spaces.
New inequality criterion for a mean field equation on spheres.
problem Finding uniqueness in a mean field equation on spheres.
method Established a new Moser-Trudinger-Onofri inequality with a constraint on moments deviation.
result A threshold for deviation is a uniqueness criterion for the mean field equation.
We study random walks on groups with the feature that, roughly speaking, successive positions of the walk tend to be "aligned". We formalize and quantify this property by means of the notion of deviation inequalities. We show that deviation inequalities have several consequences including Central Limit Theorems, the lo…
New Gini indices capture more nuanced income inequality.
problem Measuring joint dispersion across multiple observations.
method Axiomatic approach to define and characterize n-th order Gini deviations.
result Higher-order Gini coefficients reveal more extreme income disparities.
The paper improves inequalities for nearly spherical sets using quermassintegrals.
problem Improving inequalities for nearly spherical sets.
method Establishing quantitative Alexandrov-Fenchel inequalities for quermassintegrals.
result Lower bounds on the (k,m)-isoperimetric deficit found using spherical deviation and asymmetry. Novel concentration inequalities are obtained for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We derive distribution-free deviation bounds with sublinear exponents in deviation size for missing mass and improve the results of Berend and Kontorovich (2013) and Yari Saeed…
The paper provides a finite-sample deviation bound for stable autoregressive processes.
problem Deviation bounds for least squares estimators in Gaussian AR(n) processes.
method Utilizes martingale concentration inequalities and tail-bound for χ² distributed variables.
result Problem-dependent finite-time bound on the deviation probability of AR(n) process parameters.
In this paper, we study the risk bounds for samples independently drawn from an infinitely divisible (ID) distribution. In particular, based on a martingale method, we develop two deviation inequalities for a sequence of random variables of an ID distribution with zero Gaussian component. By applying the deviation ineq…
Proves inequality linking function deviation to gradient norm on compact manifolds.
problem Analyzing coupled elliptic systems on compact manifolds.
method Develops a new Poincaré-Sobolev inequality with a density-free reference average.
result Poincaré constant depends on the density's gradient norm.
We are concerned with obtaining novel concentration inequalities for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We not only derive - for the first time - distribution-free Bernstein-like deviation bounds with sublinear exponents in deviation size for missing mass, but …
This paper presents new deviation inequalities that are valid uniformly in time under adaptive sampling in a multi-armed bandit model. The deviations are measured using the Kullback-Leibler divergence in a given one-dimensional exponential family, and may take into account several arms at a time. They are obtained by c…
Sharp inequalities for matrix means with unknown variance.
problem Estimating matrix means with unknown variance.
method Empirical Bernstein inequalities for symmetric random matrices.
result Adapts to unknown variance with tight deviation bounds.
Stress shocks are often calculated as multiples of the standard deviation of a history set. This paper investigates how many standard deviations are required to guarantee that this shock exceeds any observation within the history set, given the additional constraint of kurtosis. The results of this analysis are then us…
Sharp concentration results for sums of heavy-tailed random variables.
problem Analyzing sums of independent heavy-tailed random variables.
method Using concentration inequalities and large deviation principles for distributions satisfying specific tail bounds.
result Sharp concentration inequalities and large deviation results for sums of heavy-tailed random variables.
The paper provides bounds for high-dimensional U-statistics with novel order-explicit inequalities.
problem Bounding the deviation of high-dimensional U-statistics from their Hájek projections.
method Develops novel order-explicit moment inequalities for higher-order Hoeffding components.
result The maximum deviation of a high-dimensional U-statistic from its Hájek projection is of order Op(φbn−1log2(dn)). Study on discrepancy principle for learning algorithms in nonparametric regression.
problem Determining optimal iteration number in nonparametric regression with unknown optimal iteration.
method Investigates discrepancy principle and modified principles for kernelized spectral filters, using deviation inequalities and change-of-norm arguments.
result Classical discrepancy principle is adaptive for slow rates, while modified principles are adaptive for faster rates.
Sharp concentration bounds for i.i.d. variables.
problem Controlling the tail probabilities of independent variables.
method Extension of Sanov's theorem using large deviations and information theory.
result Matching concentration and anti-concentration bounds for i.i.d. samples of any size.
New inequality on sphere generalizes circle inequality.
problem Generalizing circle inequality to sphere.
method Develops a new inequality on the sphere that incorporates mass center deviation.
result Improves Aubin's inequality and Onofri's inequality.
In this paper, we are concerned with obtaining distribution-free concentration inequalities for mixture of independent Bernoulli variables that incorporate a notion of variance. Missing mass is the total probability mass associated to the outcomes that have not been seen in a given sample which is an important quantity…
Improved concentration inequalities for sub-Weibull variables enhance statistical and machine learning applications.
problem Improving concentration inequalities for sub-Weibull random variables.
method Developed new concentration inequalities for sums of independent sub-Weibull random variables, including a new sub-Weibull parameter.
result New concentration inequalities with sharper constants and a mixture of sub-Gaussian and sub-Weibull tails.
Paper develops a new inequality for non-causal machine learning.
problem Current concentration inequalities cannot be applied to non-causal machine learning.
method Develops a framework for non-causal random fields and proves a Hoeffding-type inequality.
result Obtains a Hoeffding-type concentration inequality for non-causal random fields.
Sharp upper bounds derived for Alexandrov-Fenchel deficit using weighted Minkowski integral formulas.
problem Deriving upper bounds for the Alexandrov-Fenchel deficit.
method Using weighted Minkowski integral formulas and an integral formula for the deficit in Jensen's inequality.
result Quantitative estimates under weaker convexity assumptions, including a distance term.
This article provides a new toolbox to derive sparse recovery guarantees from small deviations on extreme singular values or extreme eigenvalues obtained in Random Matrix Theory. This work is based on Restricted Isometry Constants (RICs) which are a pivotal notion in Compressed Sensing and High-Dimensional Statistics a…
Mounting evidences are being gathered suggesting that income and wealth distribution in various countries or societies follow a robust pattern, close to the Gibbs distribution of energy in an ideal gas in equilibrium, but also deviating significantly for high income groups. Application of physics models seem to provide…
We give the proof of a tight lower bound on the probability that a binomial random variable exceeds its expected value. The inequality plays an important role in a variety of contexts, including the analysis of relative deviation bounds in learning theory and generalization bounds for unbounded loss functions.
Paper extends nonparametric regression bounds for dependent β-mixing samples.
problem Analyzing error in nonparametric regression with dependent data.
method Extends uniform deviation inequalities from independent to dependent β-mixing samples. result Derives generalization bounds for nonparametric regression with dependent data.
Unified proof for various bandit algorithms with logarithmic regret.
problem Achieving logarithmic regret in stochastic bandit algorithms.
method Minimal high-probability concentration condition and two deterministic lemmas.
result Unified proofs for classical and contemporary bandit algorithms.
We obtain a sharp lower bound on the isoperimetric deficit of a general polygon in terms of the variance of its side lengths, the variance of its radii, and its deviation from being convex. Our technique involves a functional minimization problem on a suitably constructed compact manifold and is based on the spectral t…
The paper proves inequalities for hyperbolic sets and curves.
problem Proving inequalities for sets and curves in hyperbolic geometry.
method Defining horocyclic Minkowski sums and proving inequalities for hyperbolic areas.
result Horocyclic Brunn-Minkowski inequality holds for hyperbolic sets.
We provide a brief tutorial on the use of concentration inequalities as they apply to system identification of state-space parameters of linear time invariant systems, with a focus on the fully observed setting. We draw upon tools from the theories of large-deviations and self-normalized martingales, and provide both d…
New algorithm reduces sketching dimension to effective problem size.
problem Solving L2-regularized least-squares problems efficiently.
method Randomized algorithm using Gaussian and SRHT embeddings.
result Preserves convergence guarantees with reduced embedding dimension.
The paper characterizes Pólya's conjecture for spheres and hemispheres, deriving inequalities and bounds.
problem Characterizing Pólya's conjecture for eigenvalues on spheres and hemispheres.
method Analyzing eigenvalues of the Laplace-Beltrami operator on spheres and hemispheres, deriving inequalities and bounds.
result Pólya's conjecture holds for hemispheres in the Neumann case but not in the Dirichlet case when n>2. Trading strategy uses Hoeffding's Inequality to predict financial regime change.
problem Predicting financial regime change for trading strategies.
method Applies Hoeffding's Inequality to trading performance data.
result Early warning of financial regime change can be detected.
We analyze the probabilistic variance of a solution of Liouville's equation for curvature, given suitable bounds on the Gaussian curvature. The related systolic geometry was recently studied by Horowitz, Katz, and Katz, where we obtained a strengthening of Loewner's torus inequality containing a "defect term", similar …
In this paper, we present the Bennett-type generalization bounds of the learning process for i.i.d. samples, and then show that the generalization bounds have a faster rate of convergence than the traditional results. In particular, we first develop two types of Bennett-type deviation inequality for the i.i.d. learning…
Short proof shows how ridge regression works with random data.
problem Understanding prediction error in ridge regression with random design.
method Combination of exchangeability arguments, matrix perturbation, and operator convexity.
result Elementary proof of prediction error without complex inequalities.
Study sharp inequalities for perimeter functionals in capillarity and convex cones.
problem Quantitative isoperimetric inequalities for perimeter functionals in capillarity and convex cones.
method Derivation of Fuglede-type estimates and application of selection principle.
result Sharp quantitative isoperimetric inequalities in strong and barycentric forms.
The paper develops bounds for predictive values in binary classification.
problem Lack of confidence intervals for positive and negative predictive values.
method Bi-criterion framework and distribution-free large deviation and uniform convergence bounds.
result New bounds for predictive values without relying on concentration inequalities.
Extends probabilistic approach for Kahler-Einstein metrics on Fano manifolds.
problem Constructing Kahler-Einstein metrics on log Fano manifolds with non-discrete automorphism groups.
method Introduces Gibbs polystability and uses moment map constraint to break symmetry.
result Gibbs polystability conjectured to be equivalent to existence of Kahler-Einstein metric.
Paper develops robust methods for large-scale testing without tuning parameters.
problem Heavy-tailed data in high-dimensional settings.
method Revisits Hodges-Lehmann estimator for robust inference without tuning parameters.
result Develops confidence intervals and controls false discovery proportion.
Given a finite family of functions, the goal of model selection aggregation is to construct a procedure that mimics the function from this family that is the closest to an unknown regression function. More precisely, we consider a general regression model with fixed design and measure the distance between functions by …
Mathematical study of excess growth rate connects info theory with finance.
problem Understanding the excess growth rate in portfolio theory.
method Axiomatic characterization theorems of excess growth rate in terms of relative entropy, Jensen's inequality gap, and logarithmic divergence.
result Established rich connections between information theory and finance.
The study provides a theory for causal machine learning with generalization bounds.
problem Lack of theoretical guarantees for causal machine learning algorithms.
method Introduces a novel change-of-measure inequality to bound model loss.
result Tight bounds on model loss in terms of treatment propensities deviation.
Unified stopping rules ensure accurate policies in contextual learning.
problem Stopping data collection to ensure accurate policies in personalized decision problems.
method Developed unified stopping rules based on GLR statistics for pairwise action comparisons.
result Unified stopping rules achieve target precision with fewer samples than benchmarks.
In this paper, we propose a novel framework to analyze the theoretical properties of the learning process for a representative type of domain adaptation, which combines data from multiple sources and one target (or briefly called representative domain adaptation). In particular, we use the integral probability metric t…
Introduces Star-Shaped deviation measures for risk analysis.
problem Risk measurement and analysis in finance.
method Characterizes Star-Shaped deviation measures through acceptance sets and convex deviation measures.
result Exposes the relationship between Star-Shaped risk measures and deviation measures.
Improved bounds for Monte Carlo Rademacher Averages using self-bounding functions.
problem Proving sharper concentration bounds for MCERA.
method Deriving new bounds through self-bounding functions and concentration of measure.
result Novel bounds depend on data-dependent quantities, improving over standard methods.