arXiv research

A new embedding method for high-dimensional data.

A new GP inference method using simplices for high-dimensional data.

Early neural networks can be simplified to linear models, revealing surprising simplicity.

Study on Euler class and flux homomorphisms for non-orientable surfaces.

TopoNTK kernel captures higher-order interactions in simplicial complexes.

Kernel-based K-means clustering has gained popularity due to its simplicity and the power of its implicit non-linear representation of the data. A dominant concern is the memory requirement since memory scales as the square of the number of data points. We provide a new analysis of a class of approximate kernel methods…

We apply a fast kernel method for mask-based single-channel speech enhancement. Specifically, our method solves a kernel regression problem associated to a non-smooth kernel function (exponential power kernel) with a highly efficient iterative method (EigenPro). Due to the simplicity of this method, its hyper-parameter…

The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm is closely related to the Kalman filtering, and thus, the KLMS can be interpreted…

Clustering is one of the most important unsupervised problems in machine learning and statistics. Among many existing algorithms, kernel k-means has drawn much research attention due to its ability to find non-linear cluster boundaries and its inherent simplicity. There are two main approaches for kernel k-means: SVD o…

With the advent of kernel methods, automating the task of specifying a suitable kernel has become increasingly important. In this context, the Multiple Kernel Learning (MKL) problem of finding a combination of pre-specified base kernels that is suitable for the task at hand has received significant attention from resea…

New bounded cohomology classes found for exact forms on curved manifolds.

Multiple kernel learning (MKL), structured sparsity, and multi-task learning have recently received considerable attention. In this paper, we show how different MKL algorithms can be understood as applications of either regularization on the kernel weights or block-norm-based regularization, which is more common in str…

SKI accelerates GP inference with sparse grids to handle higher dimensions.

A new method predicts higher-order interactions in evolving graphs using simplicial complexes.

RPCholesky approximates kernel matrices with few evaluations.

New non-separable covariance kernels for spatiotemporal data derived from harmonic oscillator physics.

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge regression. Despite its simplicity, the algorithm we study is the first to achieve the op…

Kernelized PCovR reveals structure-property relations in chemistry and materials.

This work introduces a new quantum kernel, quantum tangent kernel, for improved performance.

Paper provides an upper bound for bias of Nadaraya-Watson kernel regression.

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a KLMS adaptive filter requires to select a so-called dictionary in order to get a…

New spectral mixture representation for isotropic kernels simplifies random Fourier features.

Paper proposes a robust LPR method using similarity kernels.

Graph-based kernels improve GP performance on graph data.

The paper develops formulas for hyperbolic simplices based on edge lengths.

Estimates dimensions of maximal simplices for rational and irrational trees in Outer space.

The paper establishes conditions for Riemannian connections and semi-simplicity of Lie algebras using spray structures.

It is proved that the volume of spherical or hyperbolic simplices, when considered as a function of the dihedral angles, can be extended continuously to degenerated simplices.

We present a method for metric optimization in the Large Deformation Diffeomorphic Metric Mapping (LDDMM) framework, by treating the induced Riemannian metric on the space of diffeomorphisms as a kernel in a machine learning context. For simplicity, we choose the kernel Fischer Linear Discriminant Analysis (KLDA) as th…

Clustering samples according to an effective metric and/or vector space representation is a challenging unsupervised learning task with a wide spectrum of applications. Among several clustering algorithms, k-means and its kernelized version have still a wide audience because of their conceptual simplicity and efficacy.…

We show that discrete $W_m$ lattices are bi-Hamiltonian, using geometric realizations of discretizations of the Adler-Gel'fand-Dikii flows as local evolutions of arc length-parametrized polygons in centro-affine space. We prove the compatibility of two known Hamiltonian structure defined on the space of geometric invar…

The paper explains generalization in kernel regression and deep neural networks using spectral bias and task-model alignment.

Improved Gaussian process experts model for complex data.

Geodesic simplices in pseudo-hyperbolic space get a cohomological treatment.

Develops a new tensor classification method for high-dimensional data.

New theory explains deep learning's success in transforming inputs.

Kernel methods offer the flexibility to learn complex relationships in modern, large data sets while enjoying strong theoretical guarantees on quality. Unfortunately, these methods typically require cubic running time in the data set size, a prohibitive cost in the large-data setting. Random feature maps (RFMs) and the…

Study PL bordism theories with quantitative bounds on filling simplices.

Framework reduces simplicity bias in NNs, improving OOD generalization and robustness.

Kernel methods outperform neural nets in operator learning tasks.

New framework shows $C^*$-simplicity for groups without certain subalgebras.

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data, however, they can be slow, especially for large problems. Piecewise linear classifie…

Structural equation models (SEMs) have been widely adopted for inference of causal interactions in complex networks. Recent examples include unveiling topologies of hidden causal networks over which processes such as spreading diseases, or rumors propagate. The appeal of SEMs in these settings stems from their simplici…

In this article, we prove a theorem comparing the dihedral angles of simplices in the hyperbolic, spherical and Euclidean geometries.

Paper improves Monte Carlo sampling with new theoretical insights and methods.

We study a natural intrinsic definition of geometric simplices in Riemannian manifolds of arbitrary dimension $n$, and exploit these simplices to obtain criteria for triangulating compact Riemannian manifolds. These geometric simplices are defined using Karcher means. Given a finite set of vertices in a convex set on t…

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $ε$-neighborhood methods are among the most common methods used for neighborhood selection, due to their computational simplicity. However, the choice of param…

We propose $\textit{weighted inner product similarity}$ (WIPS) for neural network-based graph embedding. In addition to the parameters of neural networks, we optimize the weights of the inner product by allowing positive and negative values. Despite its simplicity, WIPS can approximate arbitrary general similarities in…