Introduces Fitzpatrick losses, tighter than Fenchel-Young losses.
problem Improving loss functions for machine learning.
method Introduces Fitzpatrick losses based on the Fitzpatrick function.
result Fitzpatrick losses are tighter than Fenchel-Young losses.
New algorithm expands FTRL framework with improved worst-case regret bounds.
problem Online learning with improved worst-case regret bounds.
method Generalized implicit Follow-The-Regularized-Leader (FTRL) algorithm.
result Unified framework for designing updates improving worst-case regret bounds.
This paper studies Fenchel-Young losses, a generic way to construct convex loss functions from a regularization function. We analyze their properties in depth, showing that they unify many well-known loss functions and allow to create useful new ones easily. Fenchel-Young losses constructed from a generalized entropy, …
Over the past decades, numerous loss functions have been been proposed for a variety of supervised learning tasks, including regression, classification, ranking, and more generally structured prediction. Understanding the core principles and theoretical properties underpinning these losses is key to choose the right lo…
New PAC-Bayes bounds derived using Legendre transform and f-divergences.
problem Deriving PAC-Bayes bounds under various assumptions.
method Combining Legendre transform and Fenchel--Young inequality to derive change-of-measure inequalities.
result Extended PAC-Bayesian guarantees under tailored assumptions.
New method uses FY loss for better inverse optimization.
problem Estimating unknown parameters from noisy and suboptimal solutions.
method Fenchel-Young loss approach for efficient gradient-based optimization.
result Significant improvement in parameter estimation accuracy and computational speed.
Gradient descent converges with arbitrary stepsize for separable data under Fenchel-Young losses.
problem Understanding the conditions under which gradient descent converges with arbitrary stepsize.
method Using Fenchel-Young losses and leveraging the classical perceptron argument to derive convergence rates.
result GD converges with arbitrary stepsize for a majority of Fenchel-Young losses, with better rates for specific loss functions.
This paper develops sparse alternatives to continuous distributions, including new types of Gaussians and attention mechanisms.
problem Creating flexible continuous distributions with varying support for machine learning applications.
method Defining Ω-regularized prediction maps and Fenchel-Young losses for arbitrary domains, and deriving new types of Gaussians and attention mechanisms. result Sparse alternatives to continuous distributions, including deformed exponential families and β-Gaussians, are introduced. We establish linear regret bounds for convex smooth losses using Fenchel-Young losses.
problem Establishing linear regret bounds for convex smooth losses.
method Constructing a convex smooth surrogate loss using Fenchel-Young losses generated by the convolutional negentropy.
result We derive a smooth loss with a linear surrogate regret bound.
Paper proposes new loss functions for training energy networks.
problem Challenges in computing gradients for training energy networks.
method Proposes generalized Fenchel-Young losses for efficient gradient computation.
result Demonstrates the calibration of excess risk for linear-concave energies.
The paper defines subdifferentials on Hadamard manifolds and identifies conditions for Fenchel conjugate equality.
problem Understanding convex analysis on Riemannian manifolds.
method Using Busemann functions to define subdifferentials and investigate Fenchel conjugate equality.
result Identifies conditions for equality in the Fenchel-Young inequality on Hadamard manifolds.
Unified binary and multiclass margin-based classification methods.
problem No consensus on multiclass loss functions analogous to binary margin loss.
method Showed multiclass loss functions can be expressed in relative margin form.
result Extended classification-calibration result to multiclass.
Paper proposes a new method to learn EBMs and their partition function.
problem Intractability of exact MLE for EBMs due to partition function computation.
method Jointly learns an energy model and its log-partition function using neural networks.
result First tractable method for optimizing sparsemax loss in large spaces.
The paper introduces PD learning to improve deep learning theory.
problem Lack of theoretical understanding in deep learning model fitting and generalization.
method Proposes a PD learning framework to analyze optimization and generalization mechanisms of deep learning.
result Established theoretical guarantees on optimizability and derived generalization error bounds.
Generalizes Fenchel conjugation to nonlinear functions on arbitrary sets.
problem Extending Fenchel conjugation to functions on arbitrary sets without structure.
method Replacing linear test functions with nonlinear ones, investigating properties including biconjugation.
result Derived further results on smooth manifolds and Lie groups, relating to convexity.
SRL embeds combinatorial optimization into RL for better decision-making.
problem Challenges of standard RL in complex, structured decision-making problems.
method Structured Reinforcement Learning (SRL) with combinatorial optimization layers in actor neural network.
result SRL outperforms unstructured RL and imitation learning by up to 92% on dynamic problems.
Study inverse problems with measure samples, improving estimator calibration and recovery.
problem Inverse problems with unknown potentials observed through measure samples.
method Introduced convex empirical objectives and sharpened Fenchel--Young losses for finite-dimensional potential classes.
result High-probability parameter recovery bounds for inverse entropic unbalanced optimal transport and inverse JKO learning.
The isoperimetric inequality and related inequalities are explored.
problem Proving the isoperimetric inequality and related inequalities.
method Discussing classical and recent proofs.
result Various proofs of the isoperimetric inequality and Sobolev inequality.
New proof of Willmore inequality using geometric divergence inequality.
problem Proving the Willmore inequality for bounded domains.
method Using a parametric geometric inequality derived from a divergence form geometric differential inequality.
result New proofs of quantitative Willmore-type and weighted Minkowski inequalities.
Lorentz-Finsler geometry reveals new and old inequalities.
problem Finding new inequalities using Lorentz-Finsler geometry.
method Applying reverse Cauchy-Schwarz and reverse triangle inequalities in Lorentz-Finsler geometry.
result Proved new and refined inequalities, including refinements of Aczél's inequality.
The paper derives new inequalities on manifolds and applies them to convex hypersurfaces.
problem Deriving new inequalities on manifolds and convex hypersurfaces.
method Using Fourier theory and geometric implications of Poincare-type inequalities.
result Sharp Minkowski-type inequalities, including stability and Alexandrov-Fenchel inequalities.
The paper proves inequalities on Finsler manifolds under Ricci curvature bounds.
problem Proving (p,q)-Sobolev and Nash inequalities on Finsler metric measure manifolds. method Global p-Poincaré inequality, (p,q)-Sobolev inequality, Nash inequality derivation. result Established global optimal (p,q)-Sobolev inequality with a sharp constant. New inequality on sphere generalizes circle inequality.
problem Generalizing circle inequality to sphere.
method Develops a new inequality on the sphere that incorporates mass center deviation.
result Improves Aubin's inequality and Onofri's inequality.
Paper proves anisotropic Minkowski inequality and related inequalities.
problem Proving anisotropic Minkowski inequality and related inequalities.
method Utilizes a nonlinear potential theoretic approach.
result Sharp anisotropic Minkowski inequality and related inequalities proved.
Explains geometric inequalities for minimal hypersurfaces.
problem Geometric inequalities for minimal hypersurfaces.
method Expository discussion of known inequalities.
result Discussion of classical inequalities for minimal hypersurfaces.
The paper finds new inequalities for convex polygons.
problem Finding precise inequalities for convex polygons.
method Analytic isoperimetric inequalities based on Schur convex functions, followed by Bonnesen-style and inverse Bonnesen-style inequalities.
result Sharp discrete isoperimetric inequalities for planar convex polygons.
The study improves Bochner inequality on Finsler manifolds to derive important inequalities.
problem Improving Bochner inequality on Finsler manifolds to derive new inequalities.
method Using improved Bochner inequality and its integrated form, the study derives a sharp Poincaré-Lichnerowicz inequality, a new proof for logarithmic Sobolev inequality, and an estimate of geodesic ball volumes.
result Derivation of new inequalities and estimates on Finsler manifolds.
The paper proves various inequalities on gradient shrinking Ricci solitons.
problem Understanding geometric inequalities on gradient shrinking Ricci solitons.
method Proving multiple inequalities equivalent on complete gradient shrinking Ricci solitons.
result Various inequalities (Sobolev, logarithmic Sobolev, Schrödinger, etc.) are equivalent on gradient shrinking Ricci solitons.
Sharp inequality found on three-balls for fourth order Sobolev traces.
problem Fourth order Sobolev trace inequality on three-balls.
method Established through equivalence to a third order Sobolev inequality on two-spheres.
result Sharp fourth order Sobolev trace inequality on three-balls.
Sharp inequalities for star bodies in 2D space.
problem Understanding star bodies in 2D space.
method Sharp inequalities for star bodies in R2. result New inequalities and proofs for star bodies.
The paper develops inequalities for log-concave functions and related surface areas.
problem Understanding log-concave functions and their inequalities.
method Establishing new inequalities through f-divergences and functional affine surface areas.
result New inequalities on functional affine surface area and bounds for Kullback-Leibler divergence.
Study on functional inequalities on simple edge spaces.
problem Whether classical functional inequalities hold in simple edge spaces.
method Analyzing Sobolev and Poincaré inequalities, proving optimality of Sobolev constant.
result Optimality result concerning the B-constant of the Sobolev inequality.
Proves inequalities on curved spaces with positive curvature.
problem Proving inequalities on manifolds with nonnegative Ricci curvature.
method Analyzes manifolds with nonnegative Ricci curvature and Euclidean volume growth.
result Proves Heisenberg-Pauli-Weyl, Hardy-Sobolev, and Caffarelli-Kohn-Nirenberg inequalities.
The paper derives inequalities on Finsler manifolds, influenced by their curvatures.
problem Deriving inequalities on Finsler manifolds.
method Local and global geometric inequalities on Riemannian and Finsler manifolds.
result Generalized Caffarelli-Kohn-Nirenberg and Hardy type inequalities on Finsler manifolds.
Paper refines Talagrand inequality on Euclidean spaces.
problem Improving Talagrand inequality for Euclidean spaces.
method Symmetrization and alternative proof methods.
result Several refined functional inequalities derived.
New inequalities for convex curves with multiple geometric factors.
problem Establishing inequalities for convex curves with multiple geometric factors.
method Parametric isoperimetric-type inequalities for closed convex curves with parameter conditions and equality conditions.
result Derived new inequalities and improved versions of existing inequalities.
Alternative proofs for various inequalities on Riemannian manifolds.
problem Various functional inequalities on Riemannian manifolds.
method Generic functional inequality, Riccati pairs, solving Riccati-type ODE.
result Alternative proofs for multiple inequalities, including Hardy-type and Caccioppoli inequalities.
The paper establishes inequalities and gradient estimates for harmonic functions on Finsler measure spaces.
problem Functional and geometric inequalities on Finsler measure spaces.
method Local uniform Poincaré and Sobolev inequalities, mean value inequality, Harnack inequalities, and gradient estimates.
result Global gradient estimates for positive harmonic functions on Finsler measure spaces.
The paper proves a Harnack inequality for heat equations on Finsler metric measure manifolds.
problem Proving a Harnack inequality for positive solutions to heat equations on Finsler metric measure manifolds.
method Volume comparison theorem, weighted Poincaré inequality, local uniform Sobolev inequality, mean value inequalities.
result Derives a Harnack inequality for positive solutions to heat equations.
The paper explores how information geometry impacts classical CR inequalities.
problem Deriving and generalizing CR inequalities using information geometry.
method Examining Eguchi's theory and applying Amari-Nagoaka's theory to KL-divergence, and then extending to other divergences.
result Generalized CR inequalities derived from various divergences.
Extends Riemannian geometry inequalities with sharper estimates.
problem Deriving new inequalities on Riemannian manifolds.
method Investigates advanced Hardy and Rellich-type inequalities on complete noncompact manifolds with weight functions.
result Provides sharper estimates conforming to the geometry and structure of the manifold.
The paper proves inequalities for hypersurfaces in weighted manifolds.
problem Willmore-type inequalities for closed hypersurfaces in weighted manifolds.
method Analyzes weighted manifolds with nonnegative Bakry-Émery Ricci curvature, proving sharp inequalities and characterizing equality cases.
result Derives sharp Willmore-type and Willmore-like inequalities in steady and shrinking gradient Ricci solitons.
The study establishes inequalities on path space for sub-Riemannian manifolds.
problem Understanding functional inequalities on path space for sub-Riemannian manifolds.
method Derivative and integration by parts formulae on path space with respect to a natural gradient operator, showing bounds of horizontal Ricci curvature.
result Established functional inequalities on path space analogous to Riemannian geometry.
Extends Gromov's optimal systolic inequality to manifolds with specific cohomology properties.
problem Finding optimal systolic inequalities for manifolds with complex cohomology structures.
method Extends Gromov's inequality to manifolds with fundamental cohomology classes as cup products of 2-dimensional classes.
result Provides an optimal systolic inequality for a new class of manifolds.
Study inequalities on hyperbolic spaces and Riemannian manifolds using symmetrization and heat semigroup.
problem Investigate functional and geometric inequalities on hyperbolic spaces and Riemannian manifolds.
method Employ symmetrization and semigroup approach based on sharp estimates for heat semigroup.
result Developed robust inequalities and methods relying on geometric and isoperimetric properties.
Paper connects Fenchel-Willmore and Sobolev inequalities for submanifolds in curved spaces.
problem Developing inequalities for submanifolds in curved spaces.
method Connecting Fenchel-Willmore and logarithmic Sobolev inequalities for mean-convex submanifolds.
result Established extensions of Fenchel-Willmore inequality and derived new Sobolev-type inequalities.
Sharp inequalities on curved spaces with bounded curvature.
problem Establishing inequalities on curved spaces with curvature constraints.
method Using Sobolev and Moser-Trudinger inequalities on noncompact Riemannian manifolds with Ricci curvature bounded below.
result Best constants for inequalities on curved spaces with curvature constraints.
Derives Weyl law for volume spectrum using parametric inequalities.
problem Deriving the Weyl law for the volume spectrum in compact Riemannian manifolds.
method Proves parametric generalizations of isoperimetric and coarea inequalities to derive the Weyl law.
result Derives the Weyl law for 1-cycles in 3-manifolds.