McDiarmid's inequality under dependence via approximate tensorization of entropy
problem Dependent versions of McDiarmid's inequality
method Approximate tensorization of entropy (ATE)
result Derives McDiarmid's inequality for non-isotropic Gaussian random vectors
Concentration inequalities are indispensable tools for studying the generalization capacity of learning models. Hoeffding's and McDiarmid's inequalities are commonly used, giving bounds independent of the data distribution. Although this makes them widely applicable, a drawback is that the bounds can be too loose in so…
A crucial assumption in most statistical learning theory is that samples are independently and identically distributed (i.i.d.). However, for many real applications, the i.i.d. assumption does not hold. We consider learning problems in which examples are dependent and their dependency relation is characterized by a gra…
Increasingly, Internet of Things (IoT) domains, such as sensor networks, smart cities, and social networks, generate vast amounts of data. Such data are not only unbounded and rapidly evolving. Rather, the content thereof dynamically evolves over time, often in unforeseen ways. These variations are due to so-called con…
The study examines the generalization of Macro-AUC in multi-label learning, identifying label imbalance as a critical factor.
problem Theoretical understanding of Macro-AUC in multi-label learning is lacking.
method Characterization of generalization properties of learning algorithms based on surrogate losses w.r.t. Macro-AUC, identification of label imbalance as a critical factor.
result The widely-used univariate loss-based algorithm is more sensitive to label imbalance than pairwise and reweighted loss-based ones, implying worse performance.
Study on convergence of graph neural networks on random graphs.
problem Convergence of message passing graph neural networks on large random graphs.
method Extended convergence results to a broad class of aggregation functions using McDiarmid inequality.
result Non-asymptotic bounds for convergence quantified with high probability.
Study improves generalization bounds for equivariant networks on Markov data.
problem Challenges in integrating equivariance with Markov dependencies in neural networks.
method Applied McDiarmid's inequality and computed covering number using group theory.
result Derived upper bound on Rademacher complexity for equivariant neural networks on Markov datasets.
Logistic regression gets a new, simpler uniform bound.
problem Finding a uniform bound for logistic regression's empirical risk.
method PAC-Bayes approach with second-order expansion and Rademacher-complexity bounds.
result Provides a dimension-free uniform concentration bound.
New weighted Lasso estimates improve logistic regression performance with measurement error.
problem Improper Lasso estimates in sparse logistic regression with equal penalties.
method Proposed weighted Lasso estimates using McDiarmid inequality for non-asymptotic oracle inequalities.
result Finite sample behavior illustrated by non-asymptotic oracle inequalities for estimation and prediction errors.
New inequalities for unbounded functions improve denoising score matching.
problem Statistical error bounds for denoising score matching with unbounded objective functions.
method Derive new concentration inequalities using McDiarmid's inequality and Rademacher complexity bounds.
result Improved statistical error bounds for denoising score matching.
New stability framework relaxes boundedness assumptions for generalization bounds.
problem Overly restrictive assumptions for modern learning settings with heavy-tailed or unbounded losses.
method Develops a stability-based framework requiring only finite Lp moment conditions. result Sharp generalization bounds derived for various learning paradigms.
In this paper, we propose a novel framework to analyze the theoretical properties of the learning process for a representative type of domain adaptation, which combines data from multiple sources and one target (or briefly called representative domain adaptation). In particular, we use the integral probability metric t…
We explore in some detail the notion of algorithmic stability as a viable framework for analyzing the generalization error of learning algorithms. We introduce the new notion of training stability of a learning algorithm and show that, in a general setting, it is sufficient for good bounds on generalization error. In t…
We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and time-efficient estimators for all sufficiently smooth, symmetric and non-symmetric, …
One-pass SGD converges in overparametrized neural networks with random data.
problem Understanding convergence of SGD in neural networks with streaming data.
method Overparameterized two-layer neural networks, one-pass SGD, random initialization, NTK eigen-decomposition, VC dimension, McDiarmid's inequality.
result Prediction error converges in expectation under one-pass SGD in overparametrized neural networks.
There is an increasing concern that most current published research findings are false. The main cause seems to lie in the fundamental disconnection between theory and practice in data analysis. While the former typically relies on statistical independence, the latter is an inherently adaptive process: new hypotheses a…
The isoperimetric inequality and related inequalities are explored.
problem Proving the isoperimetric inequality and related inequalities.
method Discussing classical and recent proofs.
result Various proofs of the isoperimetric inequality and Sobolev inequality.
New proof of Willmore inequality using geometric divergence inequality.
problem Proving the Willmore inequality for bounded domains.
method Using a parametric geometric inequality derived from a divergence form geometric differential inequality.
result New proofs of quantitative Willmore-type and weighted Minkowski inequalities.
Lorentz-Finsler geometry reveals new and old inequalities.
problem Finding new inequalities using Lorentz-Finsler geometry.
method Applying reverse Cauchy-Schwarz and reverse triangle inequalities in Lorentz-Finsler geometry.
result Proved new and refined inequalities, including refinements of Aczél's inequality.
The paper derives new inequalities on manifolds and applies them to convex hypersurfaces.
problem Deriving new inequalities on manifolds and convex hypersurfaces.
method Using Fourier theory and geometric implications of Poincare-type inequalities.
result Sharp Minkowski-type inequalities, including stability and Alexandrov-Fenchel inequalities.
The paper proves inequalities on Finsler manifolds under Ricci curvature bounds.
problem Proving (p,q)-Sobolev and Nash inequalities on Finsler metric measure manifolds. method Global p-Poincaré inequality, (p,q)-Sobolev inequality, Nash inequality derivation. result Established global optimal (p,q)-Sobolev inequality with a sharp constant. New inequality on sphere generalizes circle inequality.
problem Generalizing circle inequality to sphere.
method Develops a new inequality on the sphere that incorporates mass center deviation.
result Improves Aubin's inequality and Onofri's inequality.
Paper proves anisotropic Minkowski inequality and related inequalities.
problem Proving anisotropic Minkowski inequality and related inequalities.
method Utilizes a nonlinear potential theoretic approach.
result Sharp anisotropic Minkowski inequality and related inequalities proved.
Explains geometric inequalities for minimal hypersurfaces.
problem Geometric inequalities for minimal hypersurfaces.
method Expository discussion of known inequalities.
result Discussion of classical inequalities for minimal hypersurfaces.
The paper finds new inequalities for convex polygons.
problem Finding precise inequalities for convex polygons.
method Analytic isoperimetric inequalities based on Schur convex functions, followed by Bonnesen-style and inverse Bonnesen-style inequalities.
result Sharp discrete isoperimetric inequalities for planar convex polygons.
The study improves Bochner inequality on Finsler manifolds to derive important inequalities.
problem Improving Bochner inequality on Finsler manifolds to derive new inequalities.
method Using improved Bochner inequality and its integrated form, the study derives a sharp Poincaré-Lichnerowicz inequality, a new proof for logarithmic Sobolev inequality, and an estimate of geodesic ball volumes.
result Derivation of new inequalities and estimates on Finsler manifolds.
The paper proves various inequalities on gradient shrinking Ricci solitons.
problem Understanding geometric inequalities on gradient shrinking Ricci solitons.
method Proving multiple inequalities equivalent on complete gradient shrinking Ricci solitons.
result Various inequalities (Sobolev, logarithmic Sobolev, Schrödinger, etc.) are equivalent on gradient shrinking Ricci solitons.
Sharp inequality found on three-balls for fourth order Sobolev traces.
problem Fourth order Sobolev trace inequality on three-balls.
method Established through equivalence to a third order Sobolev inequality on two-spheres.
result Sharp fourth order Sobolev trace inequality on three-balls.
Sharp inequalities for star bodies in 2D space.
problem Understanding star bodies in 2D space.
method Sharp inequalities for star bodies in R2. result New inequalities and proofs for star bodies.
The paper develops inequalities for log-concave functions and related surface areas.
problem Understanding log-concave functions and their inequalities.
method Establishing new inequalities through f-divergences and functional affine surface areas.
result New inequalities on functional affine surface area and bounds for Kullback-Leibler divergence.
Study on functional inequalities on simple edge spaces.
problem Whether classical functional inequalities hold in simple edge spaces.
method Analyzing Sobolev and Poincaré inequalities, proving optimality of Sobolev constant.
result Optimality result concerning the B-constant of the Sobolev inequality.
Proves inequalities on curved spaces with positive curvature.
problem Proving inequalities on manifolds with nonnegative Ricci curvature.
method Analyzes manifolds with nonnegative Ricci curvature and Euclidean volume growth.
result Proves Heisenberg-Pauli-Weyl, Hardy-Sobolev, and Caffarelli-Kohn-Nirenberg inequalities.
The paper derives inequalities on Finsler manifolds, influenced by their curvatures.
problem Deriving inequalities on Finsler manifolds.
method Local and global geometric inequalities on Riemannian and Finsler manifolds.
result Generalized Caffarelli-Kohn-Nirenberg and Hardy type inequalities on Finsler manifolds.
Paper refines Talagrand inequality on Euclidean spaces.
problem Improving Talagrand inequality for Euclidean spaces.
method Symmetrization and alternative proof methods.
result Several refined functional inequalities derived.
New inequalities for convex curves with multiple geometric factors.
problem Establishing inequalities for convex curves with multiple geometric factors.
method Parametric isoperimetric-type inequalities for closed convex curves with parameter conditions and equality conditions.
result Derived new inequalities and improved versions of existing inequalities.
Alternative proofs for various inequalities on Riemannian manifolds.
problem Various functional inequalities on Riemannian manifolds.
method Generic functional inequality, Riccati pairs, solving Riccati-type ODE.
result Alternative proofs for multiple inequalities, including Hardy-type and Caccioppoli inequalities.
The paper establishes inequalities and gradient estimates for harmonic functions on Finsler measure spaces.
problem Functional and geometric inequalities on Finsler measure spaces.
method Local uniform Poincaré and Sobolev inequalities, mean value inequality, Harnack inequalities, and gradient estimates.
result Global gradient estimates for positive harmonic functions on Finsler measure spaces.
The paper proves a Harnack inequality for heat equations on Finsler metric measure manifolds.
problem Proving a Harnack inequality for positive solutions to heat equations on Finsler metric measure manifolds.
method Volume comparison theorem, weighted Poincaré inequality, local uniform Sobolev inequality, mean value inequalities.
result Derives a Harnack inequality for positive solutions to heat equations.
Extends Riemannian geometry inequalities with sharper estimates.
problem Deriving new inequalities on Riemannian manifolds.
method Investigates advanced Hardy and Rellich-type inequalities on complete noncompact manifolds with weight functions.
result Provides sharper estimates conforming to the geometry and structure of the manifold.
The paper explores how information geometry impacts classical CR inequalities.
problem Deriving and generalizing CR inequalities using information geometry.
method Examining Eguchi's theory and applying Amari-Nagoaka's theory to KL-divergence, and then extending to other divergences.
result Generalized CR inequalities derived from various divergences.
The paper proves inequalities for hypersurfaces in weighted manifolds.
problem Willmore-type inequalities for closed hypersurfaces in weighted manifolds.
method Analyzes weighted manifolds with nonnegative Bakry-Émery Ricci curvature, proving sharp inequalities and characterizing equality cases.
result Derives sharp Willmore-type and Willmore-like inequalities in steady and shrinking gradient Ricci solitons.
Extends Gromov's optimal systolic inequality to manifolds with specific cohomology properties.
problem Finding optimal systolic inequalities for manifolds with complex cohomology structures.
method Extends Gromov's inequality to manifolds with fundamental cohomology classes as cup products of 2-dimensional classes.
result Provides an optimal systolic inequality for a new class of manifolds.
Study inequalities on hyperbolic spaces and Riemannian manifolds using symmetrization and heat semigroup.
problem Investigate functional and geometric inequalities on hyperbolic spaces and Riemannian manifolds.
method Employ symmetrization and semigroup approach based on sharp estimates for heat semigroup.
result Developed robust inequalities and methods relying on geometric and isoperimetric properties.
Paper connects Fenchel-Willmore and Sobolev inequalities for submanifolds in curved spaces.
problem Developing inequalities for submanifolds in curved spaces.
method Connecting Fenchel-Willmore and logarithmic Sobolev inequalities for mean-convex submanifolds.
result Established extensions of Fenchel-Willmore inequality and derived new Sobolev-type inequalities.
Sharp inequalities on curved spaces with bounded curvature.
problem Establishing inequalities on curved spaces with curvature constraints.
method Using Sobolev and Moser-Trudinger inequalities on noncompact Riemannian manifolds with Ricci curvature bounded below.
result Best constants for inequalities on curved spaces with curvature constraints.
Derives Weyl law for volume spectrum using parametric inequalities.
problem Deriving the Weyl law for the volume spectrum in compact Riemannian manifolds.
method Proves parametric generalizations of isoperimetric and coarea inequalities to derive the Weyl law.
result Derives the Weyl law for 1-cycles in 3-manifolds.
Extended a mathematical inequality by Andrews.
problem Mathematical inequality by Andrews.
method Proved extensions of Andrews inequality.
result Extended mathematical inequality by Andrews.
Study Hardy identities and inequalities on Cartan-Hadamard manifolds.
problem Existence and nonexistence of extremal functions in Hardy inequalities.
method Using the notion of a Bessel pair, we derive Hardy identities and inequalities.
result Established several Hardy type inequalities with improvements and understandings.