Kernel smoothing on unknown manifolds with bounds and asymptotic normality.
problem Data on unknown manifolds without boundaries.
method Finite sample bounds and asymptotic normality for kernel smoothing and its derivatives.
result Established finite sample bounds and asymptotic normality for kernel smoothing.
New method improves RL in continuous spaces with kernel smoothing.
problem Sample efficiency and structural assumptions in classical RL.
method Kernel smoothing model-based approach with Bernstein-style exploration bonus.
result Achieves improved regret bound in finite-horizon settings.
Develops multi-kernel regression for graph signal processing.
problem Smoothness of graph signals over a graph.
method Estimates linear weights to learn effective kernel function using graph smoothness.
result Optimization problem is convex and accelerated projected gradient descent solution proposed.
Upper bounds for Bergman kernels from smooth Kähler potentials.
problem Bounding Bergman kernels from smooth Kähler potentials.
method Using Taylor coefficients of the Kähler potential, we give upper bounds for Bergman kernels of tensor powers of a smooth positive line bundle.
result Improved off-diagonal rate of decay for analytic, quasi-analytic, and Gevrey potentials.
Heat kernels exist and are Hölder for rough metrics on smooth manifolds.
problem Existence and regularity of heat kernels on rough metrics.
method Local parabolic Harnack estimates for weak solutions in weighted Sobolev spaces.
result Globally continuous heat kernels are Hölder continuous locally.
Generative models use kernel smoothing for conditioning on small example sets.
problem Improving generative models' performance with limited conditioning examples.
method Showed that cross-attention conditioning is equivalent to kernel smoothing, specifically a Nadaraya--Watson kernel smoother.
result The approach predicts and confirms three failure regimes for kernel-based conditioning.
New insights into simple kernel smoothing reveal surprising asymptotics.
problem Understanding precise asymptotics of Nadaraya-Watson kernel smoothing.
method Using ideas from the random energy model in statistical physics.
result Sharp asymptotics for the NW predictor on the sphere.
New algorithms learn in complex decision-making problems with smooth transitions.
problem Learning in complex decision-making problems with smooth transitions.
method UCB and PSRL philosophies applied to episodic Markov decision processes with kernel approximation.
result Low regret learning achieved in continuous state and action spaces.
SATL adapts to varying smoothness in hypothesis transfer learning.
problem Fixed kernel regularization fails in varying smoothness settings.
method Proposes SATL, a two-phase KRR algorithm with adaptive Gaussian kernels.
result SATL achieves minimax optimality with matching upper and lower bounds.
Smooth kernel regularizer improves deep neural networks' performance with less data.
problem Deep neural networks need large datasets for effective learning.
method Proposes a smooth kernel regularizer that encourages spatial correlations in convolution kernel weights, learned from previous experience.
result The smooth kernel regularizer improves visual recognition models over an L2 regularization baseline.
Characterizes neural kernel and NNGP for various activations.
problem Understanding neural kernels and NNGP for non-RELU activations.
method Characterization of RKHS for various activation functions.
result Broad class of non-infinitely smooth activations generate equivalent RKHSs at different depths.
The paper explores how approximation theory can improve understanding of smooth kernels in machine learning.
problem Understanding the inferential properties of smooth kernels in machine learning.
method Analysis of eigenvalue decay, properties of eigenfunctions/eigenvectors, and fitting capacity of kernels.
result Eigenvalues of kernel matrices show nearly exponential decay, highlighting the 'approximation beats concentration' phenomenon.
Kernel-Gradient Drifting improves generative modeling for non-Euclidean data.
problem Challenges in generative modeling for non-Euclidean data.
method Replaces Euclidean displacement with kernel-induced directions, exposing score-based structure.
result Kernel-gradient drifting enables state-of-the-art one-step generation for non-Euclidean data.
Gaussian kernel tests are optimal against smooth alternatives.
problem Understanding the statistical properties of nonparametric tests using Gaussian kernels.
method Analysis of Gaussian kernel-based goodness-of-fit, homogeneity, and independence tests.
result Gaussian kernel tests are minimax optimal against smooth alternatives in all three settings.
Kernel interpolation is inconsistent for norms with smoothness above a constant.
problem Inconsistency of kernel interpolation in reproducing kernel Hilbert spaces.
method Lower bounds for generalization error in Sobolev norms.
result Kernel interpolation is always inconsistent for norms with smoothness above a constant.
Smooth bundles with rough data maintain Hodge kernel isomorphism.
problem Maintaining Hodge kernel isomorphism for smooth bundles with non-smooth geometric data.
method Analyzing nilpotent differential operators and Hodge-Dirac-type operators under perturbations of geometric data.
result Kernels of Hodge-Dirac operators remain isomorphic under uniform perturbations of geometric data.
Paper addresses bias in kernel density estimation under minimal assumptions.
problem Kernel density estimation bias under minimal assumptions.
method Demonstrates the need for a balance between kernel decay and bandwidth eigenvalues, and rigorously derives bias bounds.
result Explicit constants and rigorous derivation of bias bounds under minimal assumptions.
Enhances random forests by smoothing predictions for better performance.
problem Suboptimal performance due to piecewise constant predictions in random forests.
method Kernel-based smoothing mechanism to introduce local regularity.
result Smoothed random forest model consistently improves predictive performance.
Study shows infinite kernels in topological monodromy for curve families.
problem Understanding kernels of topological monodromy representations.
method Extending Kuno's arguments and using Carlson-Toledo techniques.
result Kernels are infinite for certain linear systems on surfaces.
Improves probability distribution compression with KT algorithm.
problem Efficiently compressing probability distributions.
method Kernel thinning (KT) algorithm with four improvements.
result KT yields tighter, dimension-free guarantees for any kernel.
The paper studies local heat kernel properties on smooth manifolds.
problem Understanding heat kernel properties in open convex sets of smooth Riemannian manifolds.
method Utilizes path integral formulation to investigate properties like uniqueness, symmetry, and asymptotics.
result Uniqueness and symmetry of Seeley-DeWitt coefficients are established.
Paper proves KRR saturation effect for smooth functions.
problem Kernel ridge regression fails to reach theoretical limits for smooth functions.
method Proof of conjectured saturation lower bound for KRR.
result Proved the conjectured saturation lower bound for KRR.
New method improves optimization algorithms without Lipschitz smoothness.
problem Improving optimization algorithms in the absence of Lipschitz smoothness.
method Dual kernel conditioning (DKC) to provide dual Lipschitz continuity.
result First complexity bounds and iterate convergence for random reshuffling mirror descent.
The paper studies kernel smoothing and mean shift for directional data, deriving convergence rates and mode estimation.
problem Statistical and computational problems of kernel smoothing for directional data.
method Generalization of mean shift to directional data, derivation of convergence rates, and investigation of mode estimation.
result Statistical convergence rates of directional KDE and its derivatives, ascending property of directional mean shift, and mode estimation.
New kernel improves MMDs with theoretical guarantees for gradient flows.
problem Non-smoothness of negative distance kernel in MMDs.
method Smoothed 1D absolute value function followed by fractional integral transform.
result Improved theoretical guarantees for Wasserstein gradient flows.
Extends Tanimoto kernel to real-valued functions.
problem Measuring similarity between real-valued functions.
method Unified representation of real-valued functions via sets, derived general form of the kernel, explicit feature representation, and smooth approximation.
result General Tanimoto kernel for real-valued functions.
Prediction of dynamical time series with additive noise using support vector machines or kernel based regression has been proved to be consistent for certain classes of discrete dynamical systems. Consistency implies that these methods are effective at computing the expected value of a point at a future time given the …
The paper explores the identifiability and interpretability of Gaussian process models using different kernel structures.
problem Identifiability and interpretability issues in Gaussian process models.
method The paper examines both single-output and multi-output Gaussian process models using additive and multiplicative mixtures of Matérn kernels.
result The smoothness of a mixture of Matérn kernels is determined by the least smooth component, and none of the mixing weights or parameters are identifiable.
Optimizes graph spectral density learning for large networks.
problem Ad-hoc kernel function and bandwidth selection in graph spectral techniques.
method Maximum Entropy approach to learn a smooth graph spectral density.
result Outperforms comparable iterative spectral approaches on synthetic and real graphs.
KTBoost combines tree and kernel boosting for better function learning.
problem Learning functions with varying degrees of regularity.
method Combines regression trees and RKHS regression in each boosting iteration.
result KTBoost significantly outperforms tree and kernel boosting in predictive accuracy.
Robust learning method combines kernel smoothing and robust optimization.
problem Certifying robustness against distribution shifts in machine learning models.
method Adapting integral operator using supremal convolution for robustness, leveraging optimal transport.
result The method provides theoretical guarantees for certified robustness and competitive performance.
The paper studies heat kernels on modified manifolds and bounds their properties.
problem Bounding heat kernels on modified Riemannian manifolds.
method Derives upper bounds and gradient estimates for the heat kernel of ( M , i l d e g ) (M, ilde{g}) ( M , i l d e g ) . result Establishes upper bounds and gradient estimates for the heat kernel of modified manifolds.
Improved kernel ridge regression for large datasets using weighted random binning.
problem Efficiently approximating kernel matrices for large-scale datasets.
method Introduced weighted random binning features for locality sensitive hashing.
result Weighted random binning features generate Gaussian processes of any desired smoothness.
Conditional COT-GAN predicts sequences using past data and kernel smoothing.
problem Predicting sequences given past data.
method Conditional COT-GAN with kernel smoothing.
result Improved convergence results for sequence prediction.
Kernel-based quadrature rules are becoming important in machine learning and statistics, as they achieve super- n \sqrt{n} n convergence rates in numerical integration, and thus provide alternatives to Monte Carlo integration in challenging settings where integrands are expensive to evaluate or where integrands are high d…
Study shows quantum behavior near infinity in metric asymptotics.
problem Quantum behavior of metrics near infinity on quasi-projective manifolds.
method Analysis of Bergman kernel function near smooth divisor at infinity of Cheng-Yau metric.
result Quantum phenomenon observed for points very close to the divisor at infinity.
Paper analyzes subsampling for regression with low smoothness, achieving good rates with minimal regularization.
problem Regression with non-smooth target functions in misspecified kernel settings.
method Nyström subsampling approach under general source conditions, focusing on minimal regularization.
result Achieves good learning rates for a wide range of source conditions with one regularization parameter.
Kernel-smoothed scores improve diffusion models by reducing memorization.
problem Diffusion models can memorize training data, leading to biased samples.
method Interpret empirical score as noisy version of true score, kernel-smoothed.
result Kernel-smoothing reduces variance and improves generalization.
Paper introduces a new regularization method for kernel gradient descent learning.
problem Preventing overfitting in kernel gradient descent learning.
method Random smoothing regularization as novel convolution-based smoothing kernels.
result Optimal convergence rates achieved in various function spaces.
Method predicts crime hotspots with high resolution.
problem Forecasting sparse spatiotemporal events like crime.
method Combines RKHS methods with autoregressive smoothing kernels.
result Significantly outperforms baseline models for sparse events.
New STKR estimators use unlabeled data for smoother function learning.
problem Leveraging unlabeled data for smoother function learning.
method Spectrally transformed kernel regression (STKR) with scalable implementations.
result STKR can learn any sufficiently smooth function.
New algorithm optimizes Hölder smooth functions in RKHS with tighter regret bounds.
problem Optimizing Hölder smooth functions in RKHS with bounded norm.
method Proposes a new algorithm ( exttt{LP-GP-UCB}) using Local Polynomial (LP) estimators and multi-scale UCB.
result Derives high probability bounds on simple and cumulative regret, matching optimal performance for SE kernel and uniformly tighter bounds for Matérn kernels.
This paper aims at refined error analysis for binary classification using support vector machine (SVM) with Gaussian kernel and convex loss. Our first result shows that for some loss functions such as the truncated quadratic loss and quadratic loss, SVM with Gaussian kernel can reach the almost optimal learning rate, p…
Paper provides GOT convergence guarantees for sub-gamma distributions and dependent samples.
problem Estimating GOT distance under general settings.
method Gaussian-smoothed optimal transport (GOT) framework, sub-gamma distributions, dependent samples, kernel MMD distances.
result Convergence guarantees for GOT distance under more general settings.
The paper improves SVM learning rates for anisotropic Gaussian kernels.
problem Nonparametric regression with anisotropic Gaussian kernels.
method Establishing almost optimal learning rates for functions in anisotropic Besov spaces.
result Optimal learning rates up to logarithmic factors, faster than Sobolev space-based rates.
Kernel regression predicts graph signals in noisy environments.
problem Predicting smooth graph signals in the presence of sparse noise.
method Kernel regression with ℓ 1 \ell_1 ℓ 1 -norm and ℓ 2 \ell_2 ℓ 2 -norm optimization using IRLS. result Efficacy demonstrated on real-world temperature data.
New method interpolates training data and is consistent for various data distributions.
problem Establishing generalization guarantees for ensemble methods in the interpolating regime.
method Developed manifold-Hilbert kernel for Riemannian manifolds and used it in ensemble classification.
result Consistent ensemble classification method for broad data distributions.
We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature similarity or temporal information present in data sets, via non-parametric kernel sm…