MKA incorporates manifold geometry into kernel alignment for more robust representation comparison.
problem Inadequate accounting for manifold geometry in kernel alignment metrics.
method Derives a theoretical framework for Manifold Approximated Kernel Alignment (MKA).
result MKA provides a more robust foundation for measuring representations.
Kernel-based SSL creates useful representations without labels.
problem Creating useful representations without labels using self-supervised learning.
method Derive methods for kernel-based SSL, focusing on contrastive and non-contrastive loss functions.
result Kernel-induced representations correlate related points and de-correlate unrelated ones.
CKA with Gaussian RBF kernels converges linearly as bandwidth increases.
problem Understanding the behavior of CKA with large bandwidth Gaussian kernels.
method Analyzing the convergence of CKA based on Gaussian RBF kernels in the large-bandwidth limit.
result CKA based on Gaussian RBF kernels converges linearly as bandwidth increases.
Enhances autoencoders with kernel alignment for better data representation.
problem Lack of clear properties for autoencoders to capture in data representations.
method Aligns inner products between codes with a kernel matrix to capture topological properties.
result Effective data representations learned, preserving input data similarities.
Efficiently searches through Gaussian process kernels using symbolic representation and Bayesian optimization.
problem Manual selection of kernels in Gaussian processes is complex and computationally expensive.
method Proposes a novel method using symbolic representation and Bayesian optimization to search through a structured kernel space.
result Empirically shows a computationally more efficient way of searching through a discrete kernel space.
Develops UKP for comparing feature representations in multitask learning.
problem Comparing feature representations learned by different models without access to test data.
method Uniform Kernel Prober (UKP) for comparing representations in kernel ridge regression tasks.
result UKP provides a uniform measure of prediction error on test data without access to test data.
Kernel embeddings help estimate causal effects from observational data.
problem Estimating causal effects from observational data with confounding variables.
method Kernel embeddings in reproducing kernel Hilbert spaces (RKHS).
result Robust nonparametric framework for causal inference.
Kernel and neural embeddings improve optimization and generalization in deep networks.
problem Improving optimization and generalization in deep neural networks.
method Investigated three kernel representations and their neural network approximations, comparing their optimization and generalization properties.
result Kernel and neural embeddings enhance both optimization and generalization in deep networks.
Study kernels of mapping class group representations on surface configuration spaces.
problem Understanding kernels of mapping class group representations on surface configuration spaces.
method Relate kernels to a natural twisted intersection pairing and analyze specific examples.
result Identify subrepresentations and find faithful representations for certain configurations.
New framework for node classification on graphs using kernel methods.
problem Graph kernel methods for node classification are ill-posed and rely on heuristics.
method Theoretical kernel-based framework for node classification, combining graph kernel methodology with node feature aggregation and data-driven similarity metrics.
result Our framework sets a new state of the art in node classification benchmarks.
Neural networks learn adaptive kernels that improve approximation and representation.
problem Improving neural network performance in approximating and representing functions from data.
method Dynamic reproducing kernel Hilbert space (RKHS) approach.
result Gradient flow in neural networks learns an adaptive RKHS representation and performs global least-squares projection.
Kernel VICReg improves SSL in RKHS, capturing nonlinear structures.
problem Limited ability of existing SSL methods to handle nonlinear dependencies.
method Kernel VICReg framework in RKHS, kernelizing VICReg objectives.
result Kernel VICReg mitigates representational collapse and improves performance.
Improves MKL for multi-class classification with better feature selection and representation.
problem Real-world multi-class classification problems with non-linear separations.
method Large-margin multiple kernel learning (LMMK) with sparsity term for discriminative feature selection.
result Competitive classification accuracy and sparse non-zero kernel weights.
A method for learning fair representations for kernel models.
problem Ensuring fairness in machine learning models.
method Using Sufficient Dimension Reduction (SDR) in the context of kernel-based models to construct fair representations in the reproducing kernel Hilbert space (RKHS).
result Demonstrates the effectiveness of model-aware fair representations for kernel models, including support for multiple fairness criteria and continuous/discrete data.
Neural networks can learn useful representations that kernels can't.
problem Learning functions that depend on only a few relevant directions.
method Gradient descent on a two-layer neural network.
result Improved sample complexity for learning polynomials.
Paper develops efficient estimator for Hawkes processes using representer theorem.
problem Estimating latent triggering kernels for Hawkes processes from event sequences.
method Penalized least squares minimization in RKHS framework.
result Efficient estimator with competitive accuracy and improved computational efficiency.
Graph convolutional deep kernel machine learns representations for graph tasks.
problem Limited representation learning in infinite-width neural networks.
method Developed a graph convolutional deep kernel machine as an infinite-width limit.
result Representation learning improves performance for heterophilous node classification tasks.
Paper analyzes how contrastive learning structures learned representations.
problem Understanding the structure of learned representations in contrastive learning.
method Kernel-based contrastive learning framework (KCL) and statistical dependency viewpoint.
result Theoretical upper bound and generalization error bound for KCL.
Modified group captures braid dynamics, revealing Burau kernel.
problem Detecting the kernel of the Burau representation for braids.
method Defined a modified group Gn3 and its representation. result The modified group's representation detects the Burau kernel.
Deep Divergence Graph Kernels learn graph representations without supervision.
problem Learning graph representations without feature engineering or labeled graphs.
method Unsupervised method using cross-graph attention networks and divergence scores.
result Learned representations achieve competitive results on graph classification tasks.
Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the computation tractable by leveraging the kernel trick. Classic kernel methods learn a single layer of nonl…
New theory explains deep learning's success in transforming inputs.
problem Standard theoretical approaches eliminate representation learning.
method Developed a new infinite width limit for representation learning.
result Deep Gaussian processes (DGPs) have multivariate Gaussian posteriors.
Proposes a framework to extract ordered eigenfunctions from contextual kernels.
problem Lack of exact spectral decomposition in existing methods.
method Modular building blocks for compatibility with contextual kernels and scalability.
result Extracted eigenfunctions provide effective importance scores for feature selection.
Extends Tanimoto kernel to real-valued functions.
problem Measuring similarity between real-valued functions.
method Unified representation of real-valued functions via sets, derived general form of the kernel, explicit feature representation, and smooth approximation.
result General Tanimoto kernel for real-valued functions.
Study subelliptic heat kernel on octonionic anti-de Sitter space.
problem Heat kernel of octonionic anti-de Sitter space.
method Lift Laplacian of octonionic hyperbolic space and use sub-Laplacian.
result Two integral representations for subelliptic heat kernel.
The paper studies how neural networks evolve representations, finding a unique fixed point for nonlinear activations.
problem Understanding how neural networks transform input data across layers.
method Theoretical framework for the evolution of the kernel sequence, using mean-field regime and Hermite polynomials.
result For nonlinear activations, the kernel sequence converges globally to a unique fixed point.
Kernel balancing weights are generalized as KRRR, providing better confidence intervals for treatment effects.
problem Lack of generalization error, correct feature specification, and limited to average effects.
method Interpreting kernel balancing weights as KRRR, relaxing feature specification, and extending Gaussian approximation.
result KRRR provides strong generalization properties and justifies confidence sets for causal functions.
Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric structures in the data. Recently, it was suggested to replace the standard kernel …
In this paper we study the variational problem associated to support vector regression in Banach function spaces. Using the Fenchel-Rockafellar duality theory, we give explicit formulation of the dual problem as well as of the related optimality conditions. Moreover, we provide a new computational framework for solving…
Geometric approach connects Burau representation to sphere metrics, identifying kernels.
problem Faithfulness of the Burau representation for the 4-strand case.
method Geometric and orbifold theory.
result Identifies the kernel of the Burau representation for some cases.
ABC learns context-aware representations for clustering.
problem Learning latent representations that adapt to context in machine learning.
method Attention-based neural architecture that learns a similarity kernel.
result Competitive results for clustering Omniglot characters.
Enhances GPLVM for multi-view data with scalable latent representation learning.
problem Limited kernel expressiveness and computational inefficiency in multi-view GPLVM.
method Introduces a new duality between spectral density and kernel function, uses NG-SM kernel, and applies random Fourier feature approximation for scalability.
result Consistently outperforms state-of-the-art models in learning meaningful latent representations across diverse datasets.
Graph kernels improve graph similarity and learning tasks.
problem Tackling graph similarity and learning tasks.
method Proposes a message passing scheme framework for designing graph kernels.
result Kernels derived from the framework are competitive with state-of-the-art methods.
New method tests conditional independence using spectral representations.
problem Untestable conditional independence in many settings.
method Spectral representations of partial covariance operators, bi-level contrastive learning.
result Asymptotic validity and power guarantees for CI testing.
In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from such a kernel space to input space. The proposed method is based on traditional a…
Invariance to nuisance transformations is one of the desirable properties of effective representations. We consider transformations that form a \emph{group} and propose an approach based on kernel methods to derive local group invariant representations. Locality is achieved by defining a suitable probability distributi…
We study the Gassner representation of the pure braid group Pn by considering its restriction to a free subgroup F. The kernel of the restriction is shown to lie in the subgroup [Γ3F,Γ2F], sharpening a result of Lipschutz.
Unified framework for constructing RKBSs with various norms and kernels.
problem Unclear relations among existing RKBS constructions.
method Generic definition of RKBS and reproducing kernel, continuous bilinear form, feature maps.
result Unified framework unifies existing RKBS constructions and develops representer theorems.
A theorem for Hilbert space-valued functions simplifies machine learning models.
problem Learning functions in Hilbert space-valued spaces.
method Generalized Representer Theorem for Hilbert space-valued functions.
result Unified view of supervised and semi-supervised learning methods.
The paper uses Banach spaces to analyze neural networks.
problem Understanding the function spaces of neural networks.
method Theory of reproducing kernel Banach spaces.
result Representer theorem for wide class of Banach spaces.
Develops a new method to learn kernels directly over function space.
problem Learning kernels for flexible function approximators.
method Functional Kernel Learning (FKL) using transformed Gaussian processes over spectral densities.
result Direct inference of functional posteriors over kernels enables rich representations.
Paper finds exact global optima for adversarial representation learning.
problem Obtaining data representations invariant to sensitive attributes.
method Spectral learning for linear functions, kernel representation for non-linear functions.
result Exact closed-form expression for global optima with performance guarantees.
DenseHMM improves HMMs by learning dense representations that enable gradient-based optimization.
problem Learning dense representations for hidden states and observables in HMMs.
method DenseHMM uses kernelized transition probabilities and two optimization schemes.
result DenseHMM achieves superior performance and expressiveness compared to standard HMMs.
The paper tackles model collapse in GPLVMs by improving kernel flexibility and projection variance.
problem Model collapse in GPLVMs leading to vague latent representations.
method Theoretical analysis of projection variance, integration of SM and RFF kernels, and variational inference.
result The advisedRFLVM outperforms competing models in informative latent representations and missing data imputation.
The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order interactions. However, until recently, there has been a strong reliance on a limi…
A new kernel framework analyzes spatio-temporal data from dynamic equations.
problem Analyzing spatio-temporal data from dynamic equations with noisy measurements.
method Kernel-based framework with representer theorem for minimizing error with given samples.
result Minimizes error in solutions of dynamic equations with noisy spatio-temporal data.
Paper introduces RKHM and KME for richer data analysis.
problem Lack of rich data structures in kernel methods.
method Proposes RKHM and KME for functional data analysis.
result RKHM captures structural properties in functional data.
IMKPL learns interpretable prototypes for better classification.
problem Efficient trade-offs between interpretability and prediction accuracy in kernel-based data.
method Local discrimination in feature space, condensed class-homogeneous neighborhoods, combined embedding.
result IMKPL achieves better interpretability and discriminative representation.