Study on online nonparametric regression using Sobolev kernel methods.
problem Adversarial nonparametric regression in high dimensions.
method Online kernelized ridge regression with Sobolev kernel analysis.
result Upper bounds on regret for Sobolev space classes, revealing optimality in certain cases.
Study shows rates for Laplacian-eigenmap methods in nonparametric regression.
problem Minimizing error in nonparametric regression using Laplacian-eigenmap.
method Adaptive and non-adaptive minimax rates using Sobolev space constraints.
result Extends minimax rates to various weighted Laplacian matrices.
Paper tackles functional linear regression using spectral algorithms with discrete observations.
problem Functional linear regression problem with discretely observed data.
method Combines distributed spectral algorithms with Sobolev kernels for regularization.
result Derives matching upper and lower bounds for convergence in Sobolev norm.
Develops nonparametric regression for non-smooth functions using fractional Laplacian.
problem Non-smooth regression functions in high dimensions.
method Fractional Laplacian eigenmaps for L2-fractional Sobolev spaces. result Upper bound on estimation error of $n^{- rac{2s}{2s+d}}$.
Optimal rates for vector-valued regression on various norms.
problem Optimal rates for vector-valued ridge regression on continuous norms.
method Combining standard capacity assumptions with tensor product constructions of vector-valued interpolation spaces.
result Optimal rates for vector-valued ridge regression, independent of output space dimension.
Optimal multiscale learning of linear operators
problem Statistical and computational limits of learning bounded linear operators between Sobolev spaces
method Reformulate as an infinite-dimensional matrix regression problem with heterogeneous multiscale structure
result Establish minimax rates and construct a finite-resolution blockwise least-squares estimator attaining these rates
PCR-LE achieves optimal rates for nonparametric regression over Sobolev spaces.
problem Nonparametric regression over Sobolev spaces with random design.
method PCR-LE using Laplacian Eigenmaps on neighborhood graphs.
result PCR-LE achieves minimax rates of convergence for both estimation and goodness-of-fit testing.
NTK neural networks are robust to adversarial attacks in nonparametric regression.
problem Adversarial robustness of neural networks in nonparametric regression.
method Gradient flow with early stopping for NTK neural networks, proving robustness in Sobolev spaces.
result NTK neural networks achieve optimal adversarial robustness rates in Sobolev spaces.
Scalable kernel methods for large datasets using Fourier representations and NUFFT.
problem Cubic complexity in kernel methods limits their use on large-scale datasets.
method Fourier representation of kernels combined with NUFFT for O(n log n) complexity.
result Achieves minimax convergence rates and processes up to tens of billions of samples.
Gradient descent achieves optimal learning for elliptic PDEs via Sobolev norms.
problem Learning elliptic PDEs from noisy data.
method Gradient descent on Sobolev norm objective functions.
result Gradient descent achieves statistical optimality for elliptic PDEs.
The paper explores how control variates can reduce variance in Monte Carlo simulations, especially for Sobolev functions.
problem Efficiency of control variates in reducing variance for Monte Carlo simulations.
method Study of a specific quadrature rule using nonparametric regression-adjusted control variates.
result A specific quadrature rule can improve the Monte Carlo rate and achieve the minimax optimal rate under sufficient smoothness assumptions.
Paper studies minimax optimal regression using Laplacian smoothing over graphs.
problem Minimax optimal regression over Sobolev spaces.
method Laplacian smoothing on neighborhood graphs.
result Upper bounds match minimax optimal rates for first-order Sobolev class.
Learning rates for least-squares regression are typically expressed in terms of L2-norms. In this paper we extend these rates to norms stronger than the L2-norm without requiring the regression function to be contained in the hypothesis space. In the special case of Sobolev reproducing kernel Hilbert spaces used …
Transformer networks approximate Hölder and Sobolev functions with fixed-depth networks.
problem Nonparametric regression with dependent observations.
method Established novel upper bounds for Transformer networks approximating Hölder and Sobolev functions under various β-mixing data assumptions. result Explicit convergence rates for nonparametric regression problems under β-mixing data assumptions. Kolmogorov-Arnold Networks achieve optimal convergence rates in nonparametric regression.
problem Nonparametric function approximation in multivariate settings.
method Structured additive and multiplicative KANs using B-splines.
result Achieve minimax-optimal convergence rate O(n−2r/(2r+1)) for Sobolev space functions. New method stabilizes machine learning for physics-informed inverse problems.
problem Reconstructing physical quantities from PDE-compliant measurements.
method Physics-informed learning with smooth inductive bias.
result PDE operators stabilize variance and prevent overfitting in fixed dimensions.
The paper proves LOO CV is reliable under estimator stability.
problem Ensuring the reliability of leave-one-out cross validation.
method Using concentration inequalities based on logarithmic Sobolev inequality.
result LOO CV is a valid procedure under estimator stability.
SDORE uses neural networks to estimate regression functions and their gradients, even with limited labeled data.
problem Nonparametric estimation of regression functions and their gradients.
method Semi-supervised deep ReQU neural networks with gradient norm regularization.
result Achieves minimax optimal convergence rates in L2-norm and plug-in gradient estimator convergence. The paper analyzes kernel classifiers' performance in Sobolev spaces and proves their optimality.
problem Theoretical analysis of kernel classifiers' performance in Sobolev spaces.
method Deriving upper and lower bounds on classification excess risk using kernel regression theory and estimating interpolation smoothness.
result The proposed kernel classifier is optimal in Sobolev spaces, with theoretical bounds confirmed by real data.
New estimator for estimating derivatives in nonparametric regression.
problem Estimating derivatives of regression functions.
method Plug-in kernel ridge regression (KRR) estimator.
result Plug-in property for derivatives estimation, optimal rate of convergence.
Kernel ridge regression imputation with consistent variance estimation for handling missing data.
problem Handling missing data in statistical analysis.
method Kernel ridge regression imputation combined with entropy method for variance estimation.
result Root-n consistency of the imputation estimator in a Sobolev space setting.
The paper analyzes how adding gradient data affects overparameterized models' performance.
problem The impact of Sobolev training on high-dimensional predictive models.
method Combining replica method from statistical physics and operator-valued free probability theory.
result Sobolev training does not universally improve performance for target functions described by single-index models.
Novel quasi-Bayesian method for IV regression using machine learning models.
problem Uncertainty quantification in IV regression with machine learning models.
method Quasi-Bayesian procedure based on kernelized IV models and dual formulation.
result Established minimax optimal contraction rates and scalable inference algorithm.
This paper analyzes shallow ReLU networks in L^p and Sobolev spaces, focusing on approximation and generalization.
problem Approximation and generalization of shallow ReLU networks in L^p and Sobolev spaces.
method Spherical harmonic analysis and embeddings into spectral Barron spaces for L^p spaces, path-norm control for Sobolev spaces.
result Minimax-optimal rates for nonparametric regression with shallow ReLU networks under path-norm control.
A new method improves flow matching by dynamically weighting density estimates.
problem High-dimensional integration inefficiency in flow matching.
method Density-weighted Dynamic Stein operators.
result Significant improvement in vector field smoothness and sampling efficiency.
Improves kernel ridge regression by optimizing scale and feature parameters.
problem Kernel ridge regression with fixed kernel.
method Introduces a matrix parameter U to optimize scale and feature parameters.
result Solves a nonlinear variational problem to optimize U.
Bayesian framework for sphere regression using Gaussian fields.
problem Nonparametric regression on the sphere with Gaussian priors.
method Isotropic Gaussian field priors, harmonic structure, exact posterior distributions, optimal spectral truncation, posterior contraction rates.
result Sharp posterior contraction rates for Gaussian priors with polynomially decaying angular power spectra.
New Sobolev inequalities on Kähler manifolds with positive Ricci curvature.
problem Proving Sobolev inequalities on Kähler manifolds.
method Using a classical Bidaut-Véron and Véron approach.
result Proved new Sobolev inequalities on compact Kähler manifolds with positive Ricci curvature.
Sharp inequality found on three-balls for fourth order Sobolev traces.
problem Fourth order Sobolev trace inequality on three-balls.
method Established through equivalence to a third order Sobolev inequality on two-spheres.
result Sharp fourth order Sobolev trace inequality on three-balls.
Novel algorithm speeds up computation of Sobolev IPM for graph-based probability measures.
problem Efficient computation of Sobolev IPM for graph-based probability measures.
method Established relation between Sobolev norm and weighted Lp-norm, proposed novel regularization, leveraged graph structure. result Proposed regularized Sobolev IPM provides closed-form expression for fast computation.
We propose a new Integral Probability Metric (IPM) between distributions: the Sobolev IPM. The Sobolev IPM compares the mean discrepancy of two distributions for functions (critic) restricted to a Sobolev ball defined with respect to a dominant measure μ. We show that the Sobolev IPM compares two distributions in hig…
Explains optimal functional inequalities, focusing on Sobolev and fractional Sobolev.
problem Optimal functional inequalities and their stability.
method Compactness theorems, characterization of optimizers, and quantitative stability analysis.
result Characterization and stability of optimizers for Sobolev inequalities and their fractional generalizations.
Noiseless KRR achieves optimal rates and exhibits saturation effects.
problem Understanding optimal rates and saturation phenomena in noiseless kernel ridge regression.
method Comprehensive study of noiseless KRR, establishing minimax optimal rates and uncovering phenomena of extra-smoothness and saturation.
result Noiseless KRR achieves minimax optimal rates and exhibits saturation effects.
Log Sobolev and Michael Simon inequalities for tensor fields on curved manifolds.
problem Establishing inequalities for tensor fields on curved manifolds.
method Applying the ABP method to symmetric tensor fields on manifolds with nonnegative sectional curvature.
result Log Sobolev and Michael Simon inequalities for tensor fields.
Paper proposes a method for early stopping in regression using reproducing kernels.
problem Early stopping for iterative learning algorithms in nonparametric regression.
method Data-driven rule based on minimum discrepancy principle, validated by fixed-point analysis of localized Rademacher complexities.
result The proposed rule is minimax-optimal and performs comparably to cross-validation.
In this paper we study the problem of deriving further Sobolev inequalities from a given Sobolev inequality. We use several different methods, including Bessel potentials and Riesz transforms. We apply the results to the Ricci flow to extend the author's results on the W1,2 Sobolev inequality along the Ricci flow …
Proves Sobolev inequality on manifolds with specific curvature properties.
problem Proving Sobolev inequality on manifolds with asymptotically nonnegative Bakry-Émery Ricci curvature.
method Density and Bakry-Émery Ricci curvature.
result Proves Sobolev inequality on manifolds with asymptotically nonnegative Bakry-Émery Ricci curvature.
Paper connects Fenchel-Willmore and Sobolev inequalities for submanifolds in curved spaces.
problem Developing inequalities for submanifolds in curved spaces.
method Connecting Fenchel-Willmore and logarithmic Sobolev inequalities for mean-convex submanifolds.
result Established extensions of Fenchel-Willmore inequality and derived new Sobolev-type inequalities.
Alternative proof of Michael-Simon-Sobolev inequality using optimal transport.
problem Proving the Michael-Simon-Sobolev inequality for submanifolds of codimension 2.
method Optimal transport techniques.
result Sharpness of the inequality for submanifolds of codimension 2.
Study shows how close functions are to optimal in Riemannian manifolds.
problem Understanding how close functions are to optimal in Riemannian manifolds.
method Analyzes quantitative stability of Sobolev inequalities on compact Riemannian manifolds.
result Functions that nearly saturate a critical Sobolev inequality are quantitatively close to extremal functions.
New Sobolev inequalities found for curved spaces.
problem Sobolev inequalities in curved spaces with specific decay conditions.
method Used ABP method developed by Cabré and Brendle.
result Established Sobolev inequalities for compact domains and submanifolds.
Study noncommutative Sobolev inequalities using quantum state metrics.
problem Establishing Sobolev inequalities in noncommutative settings.
method Generalizing monotone metrics in quantum states.
result Developed new matrix-valued Beckner inequalities.
The paper examines stability of Sobolev inequalities on manifolds with Ricci curvature bounds.
problem Stability of Sobolev inequalities on Riemannian manifolds with Ricci curvature lower bounds.
method Generalized Lions' concentration compactness and rigidity results of Sobolev inequalities on singular spaces.
result Almost extremal functions are close to extremal functions on the round sphere and Euclidean Sobolev inequality.
Study continuity of complex Sobolev functions, with applications to Kaehler metrics.
problem Continuity of functions in complex Sobolev spaces.
method Analysis of function regularity in Sobolev spaces, with applications to Kaehler metrics.
result Hermitian generalizations of recent results on Kaehler metrics.
Improved CR Sobolev inequalities on CR sphere established.
problem Establishing CR Sobolev inequalities on CR sphere.
method Nice commutator identities involving CR intertwining operators.
result Simpler proof of existence and classification of minimizers.
Generalizes Sobolev IPM for graph-based measures using Orlicz geometric structure.
problem Limitation of Le et al. (2025) framework to Lp geometry. method Generalizes Sobolev IPM through Orlicz geometric structure, employing convex functions to capture nuanced geometric relationships.
result GSI-M reduces to a simple univariate optimization problem, achieving remarkable computational efficiency.
The paper improves CR Sobolev inequalities and classifies minimizers.
problem Higher-order CR Sobolev inequalities on the CR sphere.
method Improvement through vanishing higher order moments of the volume element.
result New direct proof of minimizers' classification and existence of minimizers in C2k(N). Sharp Sobolev and Michael-Simon inequalities on curved manifolds.
problem Proving inequalities on manifolds with nonnegative curvature.
method Analyzing asymptotic volume ratio and curvature properties.
result Sharp Sobolev and Michael-Simon inequalities established.