Study RKHS on manifolds, linking Sobolev and diffusion spaces.
problem Characterizing RKHS on manifolds and their properties.
method Analyzing Sobolev and diffusion spaces on Riemannian manifolds.
result Sobolev spaces are RKHS under certain conditions, and diffusion spaces are introduced.
Constructs non-asymptotic confidence regions for unknown functions in RKHS.
problem Global probabilistic confidence regions for unknown functions in RKHS.
method Reduces confidence region construction to estimating RKHS norm.
result Valid confidence regions can be constructed non-asymptotically.
New analysis shows a gap between Gaussian RKHS and neural networks on unbounded domains.
problem Understanding the function space bias of neural networks compared to Gaussian RKHS.
method Infinite-center asymptotic analysis of neural network Banach space and Gaussian RKHS on unbounded domains.
result Certain functions in Gaussian RKHS have infinite norm in neural network Banach space on unbounded domains.
SKN learns multi-layer nonlinear features using kernel methods.
problem Limited representational power of classic kernel methods.
method Interleaves layers of nonlinear and linear transformations in a hierarchy of RKHS-based features.
result SKN and SKCN outperform competitive methods on various datasets.
Neural networks can approximate functionals on RKHS with error bounds.
problem Approximating functionals on RKHS using neural networks.
method Interpolating orthogonal projections in RKHS using point evaluations.
result Explicit error bounds for various kernels (inverse multiquadric, Gaussian, Sobolev).
Paper generalizes regression problems in hyper-RKHS for kernel learning.
problem Kernel learning and out-of-sample extensions in regression problems.
method Introduces two regularized regression models in hyper-RKHS, including KRR and SVR, and applies divide-and-conquer with Nyström approximation for scalability.
result Proves asymptotic convergence results and derives learning rates for regularized regression algorithms in hyper-RKHS.
Embedding RL policies in RKHS for robustness and theoretical guarantees.
problem Stability and theoretical guarantees in RL policy representation.
method Low-dimensional embedding of RL policies in RKHS.
result Embedded policies maintain high return with strong theoretical guarantees.
Deep neural kernels and Laplace kernel have equivalent RKHS on spheres.
problem Comparing RKHS of deep neural tangent and Laplace kernels.
method Proof of RKHS equivalence using sphere restrictions and kernel properties.
result RKHS of deep neural tangent kernel and Laplace kernel are the same on S d − 1 \mathbb{S}^{d-1} S d − 1 . New approach to supervised learning in RKHS and vvRKHS using C ∗ C^* C ∗ -algebras.
problem Traditional supervised learning in RKHS and vvRKHS.
method Generalizing supervised learning to RKHM using C ∗ C^* C ∗ -algebras. result Constructing RKHMs with enhanced representation power.
Reconstruction of a function from noisy data is often formulated as a regularized optimization problem over an infinite-dimensional reproducing kernel Hilbert space (RKHS). The solution describes the observed data and has a small RKHS norm. When the data fit is measured using a quadratic loss, this estimator has a know…
Study on how sampling works for complex data functions.
problem Analyzing convergence of sampling algorithms for RKHS functions.
method Minimalistic assumptions on kernel and data, error estimates in RKHS norm, uniform convergence on compact domains.
result New convergence rates for Lipschitz and Hölder continuous kernels.
Paper explores RKHS properties for derivative and integral operators.
problem Establishing sufficient conditions for reproducing property in RKHS.
method Establishing reproducing property for combinations of composition operators.
result Provides framework for regularized learning algorithms involving function values, gradients, or operators.
New method models Poisson intensity using RKHS for high-dimensional data.
problem Tractable nonparametric modeling of inhomogeneous Poisson intensity functions.
method Reproducing Kernel Hilbert Space (RKHS) formulation for intensity functions.
result Optimization of penalized likelihood can be cast as a tractable finite-dimensional problem.
This paper develops a general framework for metric learning in RKHS with theoretical guarantees.
problem Learning a metric in RKHS from triplet comparisons.
method Develops a general RKHS framework for metric learning with theoretical guarantees.
result Provides novel generalization guarantees and sample complexity bounds for metric learning in RKHS.
New algorithm optimizes functions in Matérn kernel RKHS with noisy feedback.
problem Optimizing functions in RKHS of Matérn kernel with noisy bandit feedback.
method π-GP-UCB algorithm with guaranteed sublinear regret for all ν > 1 and d ≥ 1.
result First practical approach with guaranteed sublinear regret for all ν > 1 and d ≥ 1.
Enhances DGPs with adaptive RKHS Fourier features for better non-stationary pattern modeling.
problem Capturing complex non-stationary patterns in non-linear dynamical systems.
method Integrates ODE-based RKHS Fourier features into DGPs using convolution operations for adaptive amplitude and phase modulation. Uses a doubly stochastic variational inference framework.
result Improved predictive performance across various regression tasks.
Paper introduces RKHM for more explicit variable structures analysis.
problem Explicitly analyzing structures among variables.
method Orthonormal systems in Hilbert C ∗ C^* C ∗ -modules, RKHM. result Theoretical and practical procedures for RKHM orthonormalization.
Wide neural networks can outperform kernel methods in certain tasks.
problem Understanding when neural networks outperform kernel methods in classification tasks.
method Analyzing the performance of wide neural networks and kernel methods on various tasks, considering the initialization of SGD and the structure of covariates.
result Wide neural networks can outperform kernel methods in tasks where covariates have a low-dimensional structure similar to the target function.
Study evaluates RKHS choices for assessing graph models using KSD tests.
problem Effect of RKHS choice on KSD tests for graph model assessment.
method Investigated power performance and computational runtime of KSD tests for ERGMs and synthetic graph generators.
result Different RKHS choices affect KSD test performance and computational runtime.
Study online learning in RKHS with dependent processes, focusing on \(β\)- and \(φ\)-mixing.
problem Online learning in RKHS with dependent data.
method Online regularized learning algorithm in RKHS, analyzing \(β\)- and \(φ\)-mixing sequences.
result Probabilistic upper bounds and convergence rates for mixing coefficients.
Kernel ε ε ε -Greedy optimizes multi-armed bandits with covariates for sub-linear regret.
problem Optimizing multi-armed bandits with covariates in a reproducing kernel Hilbert space.
method Online weighted kernel ridge regression estimator for mean reward function estimation.
result Achieves sub-linear regret rate and optimal T \sqrt{T} T regret rate under margin condition. A nonparametric kernel-based method for realizing Bayes' rule is proposed, based on representations of probabilities in reproducing kernel Hilbert spaces. Probabilities are uniquely characterized by the mean of the canonical map to the RKHS. The prior and conditional probabilities are expressed in terms of RKHS functio…
A Hilbert space embedding for probability measures has recently been proposed, wherein any probability measure is represented as a mean element in a reproducing kernel Hilbert space (RKHS). Such an embedding has found applications in homogeneity testing, independence testing, dimensionality reduction, etc., with the re…
Learn ODEs from noisy data using RKHS and optimization.
problem Learning nonparametric ODEs from noisy data.
method Using RKHS theory, solve a constrained optimization problem iteratively with penalty methods and Euler approximations.
result Prove a generalization bound for L2 distance between true and estimated solutions.
A new method for learning function parameters in operators using data-adaptive RKHS.
problem Learning function parameters in operators with robustness to noise and numerical error.
method Data Adaptive RKHS Tikhonov Regularization (DARTR) method.
result DARTR leads to an accurate estimator robust to noise and numerical error, converging at a consistent rate as data refines.
Develops RKHS framework for analyzing tree ensembles.
problem Analyzing the theoretical properties of tree ensembles.
method Reproducing Kernel Hilbert Spaces (RKHS) for tree ensembles.
result Characterizes Random Forest predictor as minimizer of a penalized empirical risk functional in RKHS.
The paper develops divergences for Gaussian processes and RKHS settings.
problem Estimating divergences in infinite-dimensional spaces.
method Formulations of Alpha Log-Det divergences, continuity in norm, laws of large numbers, consistent estimation from finite samples.
result Infinite-dimensional divergences can be estimated from finite-dimensional versions with dimension-independent sample complexities.
Enhances Koopman operator estimation with intrinsic observables in RKHS.
problem Accurate estimation of Koopman operator and its spectrum.
method Jet Extended Dynamic Mode Decomposition (JetEDMD) leveraging RKHS jets.
result Proves JetEDMD's superiority with error bounds and convergence rate.
Study convergence and approximations of entropic regularized Wasserstein distances for Gaussian and RKHS measures.
problem Convergence and approximations of entropic regularized Wasserstein distances in Gaussian and RKHS settings.
method Analysis of convergence and finite sample approximations of entropic regularized Wasserstein distances in Gaussian and RKHS settings.
result Strictly weaker convergence in 2-Sinkhorn divergence for Gaussian measures compared to exact 2-Wasserstein distance.
Paper proposes a method to stabilize estimation of KL divergence using a discriminator in RKHS.
problem High variance and instability in estimating KL divergence using neural network discriminators.
method Developed a novel construction of the discriminator in RKHS, controlled its complexity, and proved the consistency of the estimator.
result Reduced variance and stabilized training of KL divergence estimates.
Research aims to improve confidence intervals for RKHS elements in online learning.
problem Improper confidence intervals lead to suboptimal regret bounds in kernel-based bandit and reinforcement learning.
method Formalizes the open problem of online confidence intervals in RKHS and reviews existing results.
result Identifies the online nature of observation points as the main challenge for tight confidence intervals.
Paper proves non-equivalence of RKHS stability and kernel absolute summability.
problem Equivalence of RKHS stability and kernel absolute summability.
method Analyzes Reproducing Kernel Hilbert spaces and positive semidefinite kernels.
result Stable RKHSs can be induced by non-absolutely summable kernels.
Proposes CCME framework for estimating heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects in complex distributions.
method Embeds conditional distributions into RKHS, develops meta-estimators for CCME.
result Establishes finite-sample convergence rates and double robustness for CCME estimators.
New method links covariates to CTMCs using RKHS, improving state transitions modeling.
problem Traditional multistate models rely on linear relationships, limiting flexibility.
method Nonparametric approach using RKHS, with Frequentist and Bayesian versions.
result Effective in identifying nonlinear transition functions and predicting long-term behaviors.
Study analyzes learnability of RKHS under L∞ norm for kernel methods.
problem Understand performance of kernel methods and random feature models.
method Relate L∞ learnability to kernel spectrum decay and establish sample complexity bounds.
result Conditions for efficient L∞ learning of RKHS identified.
Develops a new method for learning non-parametric DAGs using RKHS.
problem Challenges of learning non-parametric causal models with large combinatorial search space.
method Uses reproducing kernel Hilbert spaces (RKHS) and sparsity-inducing regularization terms based on partial derivatives to enforce acyclicity.
result Shows improved performance through simulations and data analyses.
This study connects Gaussian processes and RKHS, bridging two machine learning communities.
problem Understanding the relationship between Gaussian processes and RKHS.
method Examining connections and equivalences in regression, interpolation, and other topics.
result Established the equivalence between Gaussian Hilbert space and RKHS.
This paper analyzes divide-and-conquer estimators for functional linear regression without assuming target function in the RKHS.
problem Functional linear regression without target function in RKHS.
method Integral operator approach to establish upper bounds and prove asymptotic optimality.
result Sharp finite sample upper bounds and asymptotic optimality of divide-and-conquer estimators.
We present a new framework for online Least Squares algorithms for nonlinear modeling in RKH spaces (RKHS). Instead of implicitly mapping the data to a RKHS (e.g., kernel trick), we map the data to a finite dimensional Euclidean space, using random features of the kernel's Fourier transform. The advantage is that, the …
The paper addresses instability in KL divergence estimation using a neural network discriminator.
problem Unstable estimation of KL divergence due to discriminator complexity.
method Using a Reproducing Kernel Hilbert Space (RKHS) to control discriminator complexity.
result Theoretical bound on error probability of KL estimates based on discriminator complexity in RKHS.
New method combines variational inference with particle filtering for nonlinear data.
problem Combining variational inference and Monte Carlo sampling for nonlinear data.
method Formulates gradient steepest descent method based on local optimal transport principles, embeds local mappings in RKHS, uses approximations to avoid adjoint evaluation.
result RKHS approximation is highly successful and superior to ensemble approximation for nonlinear observational operators.
Develops a new framework for estimating joint probability distributions.
problem Estimating joint probability distributions from large sample sizes.
method Tensor product reproducing kernel Hilbert spaces (RKHS) with normalized and positive model.
result Fast computation and applicability to prediction and classification problems.
Adapts RKHS methods to estimate density ratios with optimal error.
problem Estimating density ratios from limited data.
method Minimizes regularized Bregman divergence in RKHS, with Lepskii type parameter choice.
result Adaptive minimax optimal error rate for quadratic loss.
A new perspective on deep neural network regularization using RKHS norms.
problem Improving deep neural network performance and robustness.
method Using the norm of a reproducing kernel Hilbert space (RKHS) for regularization, with practical approximations.
result Effective regularization strategies for deep neural networks, including new penalties and hybrid approaches.
Study proposes a new metric for comparing Gaussian mixtures in RKHS.
problem Comparing complex multimodal densities in RKHS.
method Wasserstein-type metric for kernel Gaussian mixtures.
result Enhanced capability to model multimodal densities.
Paper tackles tensor decomposition for unaligned observations using RKHS and novel loss functions.
problem Tackles tensor decomposition for unaligned observations.
method Uses functions in RKHS to represent mode with unaligned observations, introduces versatile loss function, proposes optimization algorithm and stochastic gradient method.
result Demonstrates improved tensor decomposition efficiency and effectiveness with synthetic and real data.
Paper introduces RKHM and KME for richer data analysis.
problem Lack of rich data structures in kernel methods.
method Proposes RKHM and KME for functional data analysis.
result RKHM captures structural properties in functional data.
Proposes a method for fair regression using RKHS.
problem Ensuring fairness in regression models with multiple sensitive attributes.
method Uses reproducing kernel Hilbert space (RKHS) to construct a functional space that satisfies MP fairness.
result Derives a closed-form solution for fair regression that is efficient and interpretable.