The object of our investigation is a point that gives the maximum value of a potential with a strictly decreasing radially symmetric kernel. It defines a center of a body in Rm. When we choose the Riesz kernel or the Poisson kernel as the kernel, such centers are called a radial center or an illuminating center, respec…
New method improves regression models by optimizing correntropy with variable center.
problem Improving regression models by optimizing correntropy with variable center.
method Proposed a new optimization criterion called Maximum Correntropy Criterion with Variable Center (MCC-VC) and an efficient approach to optimize kernel width and center location.
result Simulation results show desirable performance of the new method.
This work incorporates the multi-modality of the data distribution into a Gaussian Process regression model. We approach the problem from a discriminative perspective by learning, jointly over the training data, the target space variance in the neighborhood of a certain sample through metric learning. We start by using…
CKA with Gaussian RBF kernels converges linearly as bandwidth increases.
problem Understanding the behavior of CKA with large bandwidth Gaussian kernels.
method Analyzing the convergence of CKA based on Gaussian RBF kernels in the large-bandwidth limit.
result CKA based on Gaussian RBF kernels converges linearly as bandwidth increases.
Extends orbital integral evaluation to center of enveloping algebra.
problem Evaluate semisimple orbital integrals for arbitrary elements in the center of the enveloping algebra.
method Explicit geometric evaluation of Casimir operator to arbitrary elements in the center of the enveloping algebra.
result Extension of orbital integral evaluation to center of enveloping algebra.
Paper proposes new costs for learning multiple centers in MDNs.
problem Learning multiple centers for density approximation in MDNs.
method Combines MDNs with contrastive costs using four types of kernelized matrix costs.
result New costs improve data density approximation in MDNs.
A new kernel function centers at different points improves robust learning.
problem Robust learning in the presence of outliers.
method Introduces multi-kernel correntropy (MKC) with kernels centered at different points.
result Learning algorithms using MMKCC outperform those using MCC and MMCC.
Paper analyzes CKRR for large data, showing risks converge to deterministic values.
problem Analyzing risks of kernel ridge regression with large data.
method Large dimensional analysis using centered kernels and random matrix theory.
result Empirical and prediction risks converge to deterministic values under specific conditions.
Many pattern recognition methods rely on statistical information from centered data, with the eigenanalysis of an empirical central moment, such as the covariance matrix in principal component analysis (PCA), as well as partial least squares regression, canonical-correlation analysis and Fisher discriminant analysis. R…
Two methods solve kernel ridge regression problems efficiently.
problem Solving kernel ridge regression problems with large datasets.
method RPCholesky and KRILL preconditioning techniques.
result Efficient solutions to KRR problems with strong guarantees.
NKI integrates obfuscated datasets using nonlinear kernels for improved data collaboration.
problem Privacy-preserving data collaboration with reduced reconstruction risk.
method Formulates linear kernel integration, kernelizes it, and introduces graph regularization and centering constraints.
result NKI improves classification accuracy over existing linear integration methods under nonlinear dimensionality reduction.
Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This decomposition leads to a special case of ANOVA kernels, for which the functional ANOVA r…
MKA incorporates manifold geometry into kernel alignment for more robust representation comparison.
problem Inadequate accounting for manifold geometry in kernel alignment metrics.
method Derives a theoretical framework for Manifold Approximated Kernel Alignment (MKA).
result MKA provides a more robust foundation for measuring representations.
Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately, kernel means are faced with scalability issues. A single point evaluation of the …
Survey of kernels, RKHS, and their applications in machine learning.
problem Understanding kernels and their applications in machine learning.
method Review of historical context, mathematical definitions, and practical applications of kernels.
result Comprehensive overview of kernels, RKHS, and their applications.
New similarity index avoids limitations of CCA in neural networks.
problem Limitations of existing methods in measuring neural network representation similarity.
method Introducing a similarity index based on centered kernel alignment (CKA) to measure representational similarity matrices.
result CKA reliably identifies correspondences between representations in networks trained from different initializations.
The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision matrix, which is regarded as a generalization of the scalar width parameter. These…
The study computes Bergman kernels and point process asymptotics on Kähler manifolds.
problem Computing asymptotics of Bergman kernels and point process distributions on Kähler manifolds.
method Equivariant and partial Bergman kernels, determinantal point processes, asymptotic analysis.
result The distribution of linear statistics converges to a centered normal variable with specific variances.
The problem of estimating the kernel mean in a reproducing kernel Hilbert space (RKHS) is central to kernel methods in that it is used by classical approaches (e.g., when centering a kernel PCA matrix), and it also forms the core inference step of modern kernel methods (e.g., kernel-based non-parametric tests) that rel…
CDL index improves clustering validation for non-convex data.
problem Selecting clustering algorithms and hyperparameters without labeled data.
method CDL uses compactness, centers, and covariances to compute a probabilistic description length bound.
result CDL outperforms conventional CVIs on synthetic and image benchmarks.
Support Vector Data Description (SVDD) is a machine learning technique used for single class classification and outlier detection. SVDD based K-chart was first introduced by Sun and Tsung for monitoring multivariate processes when underlying distribution of process parameters or quality characteristics depart from Norm…
The paper proposes a novel Kernelized image segmentation scheme for noisy images that utilizes the concept of Smallest Univalue Segment Assimilating Nucleus (SUSAN) and incorporates spatial constraints by computing circular colour map induced weights. Fuzzy damping coefficients are obtained for each nucleus or center p…
This work proves the optimal estimation rates for popular kernel discrepancies.
problem Estimating the disagreement of distributions using kernel discrepancies.
method Proving minimax lower bounds for MMD, HSIC, and KSD.
result The minimax lower bound for estimation of MMD, HSIC, and KSD is \( n^{-1/2} \) on general topological spaces.
A classification algorithm, called the Linear Centralization Classifier (LCC), is introduced. The algorithm seeks to find a transformation that best maps instances from the feature space to a space where they concentrate towards the center of their own classes, while maximimizing the distance between class centers. We …
Proposes an online method for high-dimensional streaming data.
problem Increasing variable dimensions with sample size in online kernel sliced inverse regression.
method Introduces approximate linear dependence condition and dictionary variable sets to address the problem. Transforms into online generalized eigen-decomposition problem and uses stochastic optimization for updates.
result Achieves close performance to batch processing kernel sliced inverse regression.
A CNN-based method detects and counts corn kernels from images.
problem Manual counting of corn kernels is labor-intensive and prone to error.
method Sliding window approach with CNN for detection and NMS for overlapping removal.
result The method successfully detects and counts kernels with low error.
This paper introduces the kernel mixture network, a new method for nonparametric estimation of conditional probability densities using neural networks. We model arbitrarily complex conditional densities as linear combinations of a family of kernel functions centered at a subset of training points. The weights are deter…
Determinantal consensus clustering improves clustering robustness.
problem Robustness of clustering algorithms.
method Use of determinantal point processes (DPP) for random restart of clustering algorithms.
result Determinantal consensus clustering outperforms classical algorithms.
Kernel VICReg improves SSL in RKHS, capturing nonlinear structures.
problem Limited ability of existing SSL methods to handle nonlinear dependencies.
method Kernel VICReg framework in RKHS, kernelizing VICReg objectives.
result Kernel VICReg mitigates representational collapse and improves performance.
Study magnetic fields on special Lie groups, proving non-existence of certain types.
problem Existence of closed 2-forms with specific properties on non-singular 2-step nilpotent Lie groups.
method Analyzing left-invariant magnetic fields on 2-step nilpotent Lie groups, proving non-existence and existence results.
result Strong obstruction and non-existence of closed 2-forms of type II on non-singular Lie algebras.
Study convergence and approximations of entropic regularized Wasserstein distances for Gaussian and RKHS measures.
problem Convergence and approximations of entropic regularized Wasserstein distances in Gaussian and RKHS settings.
method Analysis of convergence and finite sample approximations of entropic regularized Wasserstein distances in Gaussian and RKHS settings.
result Strictly weaker convergence in 2-Sinkhorn divergence for Gaussian measures compared to exact 2-Wasserstein distance.
New method quantifies uncertainty in kernel models without distributional assumptions.
problem Uncertainty quantification in kernel methods without strong distributional assumptions.
method Gradient perturbation to extract uncertainty information.
result Exact, non-asymptotic confidence regions for kernel models.
We present in this work a new family of kernels to compare positive measures on arbitrary spaces $\Xcal$ endowed with a positive kernel κ, which translates naturally into kernels between histograms or clouds of points. We first cover the case where $\Xcal$ is Euclidian, and focus on kernels which take into account th…
New measures link neural representation geometry to decoding ability.
problem Understanding how neural representations relate to decoding ability.
method Showed that popular similarity measures can be interpreted from a decoding perspective.
result Proved that measures like CKA and CCA quantify alignment between optimal linear readouts.
FPC tackles big data challenges with polynomial kernels and ADMM.
problem Efficiently classify massive data with scalability and storage challenges.
method Polynomial feature mapping and ADMM for non-smooth convex optimization.
result FPC significantly reduces computational burden and storage memory without sacrificing generalization ability.
Study kernels of mapping class group representations on surface configuration spaces.
problem Understanding kernels of mapping class group representations on surface configuration spaces.
method Relate kernels to a natural twisted intersection pairing and analyze specific examples.
result Identify subrepresentations and find faithful representations for certain configurations.
Kernel embeddings separate distinct probability distributions, simplifying testing.
problem Testing equality of non-atomic probability distributions.
method Kernel covariance embeddings and Gaussian measures in reproducing kernel Hilbert spaces.
result Testing for singularity between Gaussian measures is equivalent to testing for equality of non-atomic probability distributions.
Compact RCD spaces are proven to be smooth manifolds under specific harmonicity conditions.
problem Characterizing compact RCD spaces as harmonic manifolds.
method Analyzing heat kernel and geodesic ball volumes for harmonicity.
result Compact RCD spaces are isometric to smooth manifolds under given conditions.
A new hybrid federated learning algorithm for combining clinical and omics data.
problem Combining clinical and omics data in federated learning settings.
method Reformulated Kernel Regularized Least Squares algorithm for hybrid federated learning.
result Validation of two variants of the hybrid algorithm on well-established datasets.
Empirical study compares wide neural networks to kernel methods, resolving open questions.
problem Understanding the relationship between wide neural networks and kernel methods.
method Large-scale empirical study using various neural network architectures and kernel methods.
result Wide neural networks outperform fully-connected finite-width networks in some cases, but underperform convolutional finite-width networks.
We introduce obstructions to the existence of a calibrated G_2-structure on a Lie algebra g of dimension seven, not necessarily nilpotent. In particular, we prove that if there is a Lie algebra epimorphism from g to a six-dimensional Lie algebra h with kernel contained in the center of g, then h has a symplectic form. …
We show obstructions to the existence of a coclosed G2-structure on a Lie algebra g of dimension seven with non-trivial center. In particular, we prove that if there exist a Lie algebra epimorphism from g to a six-dimensional Lie algebra h, with kernel contained in the center of $…
A. Borel proved that, if a finite group F acts effectively and continuously on a closed aspherical manifold M with centerless fundamental group π1(M), then a natural homomorphism ψ from F to the outer automorphism group Outπ1(M) of π1(M), called the associated abstract kernel, is a monomorphism.…
This work develops a non-parametric test for relational independence in non-i.i.d. data.
problem Testing independence in relational systems where data samples are not i.i.d.
method Kernel mean embedding for relational variables, consistent non-parametric scalable kernel test.
result Empirically validated effectiveness compared to state-of-the-art tests.
One of the basic aims of this paper is to study the relationship between the geometry of ``hypersurface like'' subsets of Euclidean space and the properties of the measures they support. In this context we show that certain doubling properties of a measure determine the geometry of its support. A Radon measure is said …
QMME balances cost and speed in convex optimization.
problem Slow convergence of first-order methods and high cost of second-order methods.
method Minimizing quadratic majorants with fixed curvature at each iteration.
result QMME framework achieves sequential convergence under standard assumptions.
Sharp Gaussian isoperimetry proven along Ricci flow.
problem Proving sharp Gaussian isoperimetric inequality for Ricci flow.
method Using monotonicity formula to prove inequality.
result Exact Gaussian enlargement theorem and concentration estimates.
A new method clusters heterogeneous subgroups for accurate causal learning.
problem Diverse causal relationships across different time spans, regions, or strategies.
method Nonlinear Causal Kernel Clustering
result Reduction in prediction error through enhanced causal learning.