New kernels allow learning from non-separable data.
problem Learning from non-separable data.
method Introducing entangled kernels and a two-step algorithm.
result Efficient algorithm for learning entangled kernels.
Develops a framework for learning nonlinear operators using Mercer kernels.
problem Learning nonlinear operators between infinite-dimensional spaces.
method Stochastic approximation framework with Mercer operator-valued kernels.
result Establishes dimension-free polynomial convergence rates for nonlinear operator learning.
Kernel Dynamic Mode Decomposition reconstructs dynamical systems using Laplacian kernel.
problem Reconstructing spatial-temporal dynamics of complex systems.
method Kernel Dynamic Mode Decomposition with Laplacian kernel.
result Laplacian kernel allows for the closability of Koopman operators in RKHS, enabling reconstruction.
Random features improve neural operators' generalization properties.
problem Improving generalization of neural operators.
method Unified framework for spectral regularization techniques and operator-valued kernels.
result Established optimal learning rates and required number of neurons.
Formula for Toeplitz operator kernel on CR manifolds.
problem Analyzing Toeplitz operators on CR manifolds.
method Formula for the symbol of the kernel, asymptotic expansions.
result Formula for the values at the diagonal of the second coefficient in the expansion of the symbol of the kernel.
Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of infinite-dimensional operator-valued kernels which are suitable for extending func…
To the best of our knowledge, there are no general well-founded robust methods for statistical unsupervised learning. Most of the unsupervised methods explicitly or implicitly depend on the kernel covariance operator (kernel CO) or kernel cross-covariance operator (kernel CCO). They are sensitive to contaminated data, …
Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the celebrated Random Fourier Feature methodology to get an approximation of operator-…
Deep learning framework for kernel methods using RKHM and Perron-Frobenius operators.
problem Kernel methods in deep learning with potential overfitting issues.
method Combining RKHM and Perron-Frobenius operator to derive a new Rademacher bound and analyze deep kernel methods.
result Theoretical interpretation of benign overfitting and milder dependency on output dimension.
This paper provides a K-theoretic obstruction for higher kernel dimension for Dirac operators. For this we use a fibre-wise Dirac operator that gives rise to a family of Fredholm operators representing a class in topological K-theory. Then Chern classes of this K-class contain some information about the kernel of…
Kernel method approximates dynamical operators from data.
problem Estimating eigenfunctions of dynamical operators from data.
method Kernel-based approach in reproducing kernel Hilbert spaces.
result Eigenfunctions estimated via matrix eigenvalue problems.
The paper studies convergence of kernel autocovariance operators for stationary processes.
problem Estimating autocovariance operators of stationary processes on Polish spaces.
method Investigates convergence of empirical estimates of autocovariance operators under various conditions.
result Provides consistency results for kernel PCA and spectral analysis methods.
Toeplitz operators linked to submultiplicative filtrations and weighted Bergman kernels.
problem Analyzing the asymptotics of weighted Bergman kernels for submultiplicative filtrations.
method Demonstrated that weight operator is a Toeplitz operator; analyzed asymptotics of weighted Bergman kernels.
result Local refinement of convergence of jumping measures towards geodesic ray pushforward measure.
Researchers approximate conditional expectation operators using kernel methods.
problem Statistical approximation of conditional expectation operators under minimal assumptions.
method Modifying the domain of the operator, approximating it by Hilbert-Schmidt operators in a reproducing kernel Hilbert space.
result The nonparametric estimate of the operator converges to a specific limiting object.
Constructs index for elliptic operators using rapidly decaying kernels.
problem Index of elliptic operators in Fréchet algebra.
method Uses heat operators and heat kernel asymptotics.
result Index can be represented by an idempotent involving heat operators.
New tools for analyzing Kähler manifolds, proving operator algebra and asymptotic kernel.
problem Analyzing Berezin-Toeplitz operators on Kähler manifolds.
method Introducing new tools for analytic microlocal analysis.
result Space of analytic Berezin-Toeplitz operators is an algebra.
Complex analysis techniques link Gaussian RBF kernels to quantum mechanics.
problem Understanding the Gaussian RBF kernel in machine learning and SVMs.
method Using Fock space and Segal-Bargmann theories in complex analysis.
result Proves connections between Gaussian RBF kernels and quantum mechanics operators.
Many unsupervised kernel methods rely on the estimation of the kernel covariance operator (kernel CO) or kernel cross-covariance operator (kernel CCO). Both kernel CO and kernel CCO are sensitive to contaminated data, even when bounded positive definite kernels are used. To the best of our knowledge, there are few well…
Scalable Gaussian Process Operator tackles high-dimensional PDEs.
problem Scaling Gaussian Process Operators to high-dimensional, data-intensive regimes.
method Nearest-neighbor-based local kernel approximations, sparse kernel approximation, structured Kronecker factorizations, operator-aware kernel structures, task-informed mean functions.
result Consistently achieves high accuracy across varying discretization scales.
This paper studies neural network operators and their convergence properties.
problem Understanding the approximation and convergence of neural network operators.
method Proves density results, convergence estimates, and Voronovskaya-type theorems.
result Establishes quantitative convergence estimates and derives Voronovskaya-type theorems.
Estimates kernel eigenvalues for compositional dot-product kernels.
problem Improving estimates for kernel eigenvalues.
method Eigenvalue decay estimates of integral operators associated with dot-product kernels.
result Improved estimates for kernel volumes in reproducing kernel Hilbert spaces.
We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) problem using operator-valued kernels. We show that some of the existing formulations of this problem are special cases of our framework. We then propose a c…
Local index theorem for chiral geometric operators proved using heat kernel.
problem Proving a local index theorem for geometric first-order differential operators.
method Using Gilkey's invariance theory and heat kernel techniques.
result Supertrace of heat kernel converges to Chern-Weil form.
Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on such spaces are, for instance, required to embed conditional probability distributi…
Automates GPU kernel optimization for diverse applications.
problem Lack of systematic evaluation for multi-scenario GPU kernel optimization.
method Introduces MSKernelBench and CUDAMaster for automated optimization.
result Significant speedups across various operators, outperforming existing tools.
Sharp Gaussian bounds derived for Schrödinger kernel on Ricci solitons.
problem Analyzing Schrödinger heat kernel on gradient shrinking Ricci solitons.
method Deriving sharp Gaussian upper bounds for the Schrödinger heat kernel.
result Sharp upper and lower bounds for eigenvalues of the Schrödinger operator.
Study Dirac operators on incomplete cusp edge spaces, proving self-adjointness and Fredholm properties.
problem Analyzing Dirac operators on complex geometric spaces.
method Construct heat kernel, prove self-adjointness and Fredholm properties, establish index formula.
result Proved Dirac operators are essentially self-adjoint and Fredholm.
Paper tackles conditional expectation estimation using compactification operators.
problem Estimating conditional expectations from product of two random variables.
method Operator theoretic approach using kernel integral operators in reproducing kernel Hilbert space.
result Solutions allow numerical approximation and convergence of data-driven implementations.
Kernel method approximates Koopman operator eigenfunctions.
problem Complexity of computing Koopman operator spectra.
method Kernel-based approach to construct principal eigenfunctions.
result Principal eigenfunctions match linearization eigenvalues.
RKUM is an R package for robust kernel-based unsupervised methods.
problem Robust analysis under contaminated or noisy data conditions.
method Robust kernel covariance and cross-covariance operators using generalized loss functions.
result RKUM reduces sensitivity to contamination and effectively identifies outliers.
Optimizes learning Hilbert-Schmidt operators between Sobolev spaces.
problem Statistical limits of learning mappings between infinite-dimensional function spaces.
method Minimax optimal regularization and multilevel training.
result Multilevel kernel operator learning achieves optimal learning rate.
New method learns kernels in nonlocal operators robustly.
problem Learning kernels in nonlocal operators is ill-posed.
method Nonparametric regression with Tikhonov regularization.
result Robust estimator of kernel yields homogenized model.
Kernel method learns PDEs from noisy data.
problem Discovering and solving PDEs from noisy data.
method Kernel smoothing, regression, and operator learning.
result Competitive performance compared to state-of-the-art algorithms.
Active data collection improves convergence rates in operator learning.
problem Improving convergence rates in operator learning with linear target and stochastic input.
method Active data collection strategies with mean-zero stochastic process and continuous covariance kernels.
result Achieves arbitrarily fast error convergence rates with eigenvalue decay of covariance kernels.
Kernel methods outperform neural nets in operator learning tasks.
problem Learning operators between Banach spaces from partial observations.
method Kernel-based framework with a priori error analysis and numerical comparisons.
result Kernel methods are competitive with neural nets in cost-accuracy trade-off.
For CR structures in dimension three, the CR pluriharmonic functions are characterized by the vanishing of a third order operator. This third order operator, after composition with the divergence operator, gives the fourth order analogue of the Paneitz operator. In this short note, we give criteria under which the kern…
Defines a new algebra for singular foliations, extending Schwartz kernels.
problem Extending Schwartz kernel operators to singular foliations.
method Defines convolution algebra of transverse distributions, proves representation as operators on spaces of functions.
result Generalizes Schwartz kernel operators to singular foliations.
This paper consists of two parts. In the first part we show that in odd dimension, as well as in even dimension below the critical weight (i.e. half the dimension), the logarithmic singularities of Schwartz kernels and Green kernels of conformal invariant pseudodifferential operators are linear combinations of Weyl con…
Kernel transfer operators, which can be regarded as approximations of transfer operators such as the Perron-Frobenius or Koopman operator in reproducing kernel Hilbert spaces, are defined in terms of covariance and cross-covariance operators and have been shown to be closely related to the conditional mean embedding fr…
In the framework of path integral the evolution operator kernel for the Merton-Garman Hamiltonian is constructed. Based on this kernel option formula is obtained, which generalizes the well-known Black-Scholes result. Possible approximation numerical schemes for path integral calculations are proposed.
Nyström approximation for scalable operator learning
problem Scalability of operator learning for large datasets
method Nyström subsampling with operator learning
result Minimax-optimal convergence rates for functional outputs
Kernel-based Bayesian filter for nonlinear systems using infinite-dimensional operators.
problem Modeling and predicting nonlinear dynamical systems.
method Functional Bayesian perspective, reproducing kernel Hilbert space, Gaussian kernel.
result Effective approximation and accurate results for nonlinear systems.
We consider second-order elliptic partial differential operators acting on sections of vector bundles over a compact Riemannian manifold without boundary, working without the assumption of Laplace-like principal part −NμNμ. Our objective is to obtain information on the asymptotic expansions of the corresponding r…
Framework extends neural operators to handle functions outside training set.
problem Robust handling of functions beyond the training set.
method Kernel approximation techniques and Reproducing Kernel Hilbert Spaces (RKHSs) theory.
result Theoretical framework and empirical validation for reliable function extension.
Random feature method approximates operators with theoretical guarantees and reduced computation.
problem Approximating operators between infinite dimensional Banach spaces using machine learning.
method Random feature operator learning method with theoretical guarantees and error bounds.
result The random feature method can achieve similar or better test errors than kernel-based methods and neural networks with significantly reduced training times.
Transfer operators such as the Perron--Frobenius or Koopman operator play an important role in the global analysis of complex dynamical systems. The eigenfunctions of these operators can be used to detect metastable sets, to project the dynamics onto the dominant slow processes, or to separate superimposed signals. We …
A new data-adaptive prior stabilizes kernel learning in operators.
problem Learning kernels in operators from data is ill-posed due to nonlocal dependence.
method Introduces a data-adaptive prior to stabilize the Bayesian posterior mean.
result The data-adaptive prior achieves a stable posterior with small noise limits.
Convolution and pooling improve kernel methods in image classification.
problem Understanding the interplay between approximation and generalization in convolutional architectures.
method Characterized RKHS of kernels with convolution, pooling, and downsampling, computed generalization error.
result Convolution and pooling operations trade off approximation with generalization power.