The paper explores the identifiability and interpretability of Gaussian process models using different kernel structures.
problem Identifiability and interpretability issues in Gaussian process models.
method The paper examines both single-output and multi-output Gaussian process models using additive and multiplicative mixtures of Matérn kernels.
result The smoothness of a mixture of Matérn kernels is determined by the least smooth component, and none of the mixing weights or parameters are identifiable.
Criterion extends identifiability for continuous mixtures of kernels.
problem Identify continuous mixtures of kernels.
method Generating-function accessibility criterion based on moment-generating functions or Laplace transforms.
result Criterion applies to mixtures of discrete and continuous variables.
Imaging genetic research has essentially focused on discovering unique and co-association effects, but typically ignoring to identify outliers or atypical objects in genetic as well as non-genetics variables. Identifying significant outliers is an essential and challenging issue for imaging genetics and multiple source…
The paper explores identifiability and stability in drifting fields using companion-elliptic kernels.
problem Identifying and stabilizing drifting fields in generative modeling.
method Introduces companion-elliptic kernel families and analyzes their properties to address identifiability and stability issues.
result Established field identifiability for arbitrary Borel probability measures and demonstrated that field convergence alone does not guarantee weak convergence.
Study identifies unique minimizers for interaction kernels in particle systems.
problem Identifying unique interaction kernels in mean-field equations of interacting particles.
method Data-adaptive L2 spaces, RKHS analysis, regularization. result Characterization of identifiability in both finite and infinite particle systems.
Paper studies identifiability and stability of drifting fields in generative modeling.
problem Identify and stabilize drifting fields in generative modeling.
method Introduces companion-elliptic kernel families to address limitations of Laplace kernel.
result Establishes field identifiability and demonstrates scalar observables for weak convergence.
Kernel method improves instrumental variable regression rates.
problem Nonparametric instrumental variable regression with weak instruments.
method Kernel-based two-stage least-squares method, strong L2 convergence analysis. result Minimax optimal rates for instrumental regression under standard assumptions.
Meta two-sample testing uses auxiliary data to quickly find powerful tests from limited samples.
problem Challenges in identifying powerful kernels for distinguishing complex distributions with limited data.
method Introduces meta two-sample testing (M2ST) to leverage abundant auxiliary data on related tasks.
result Proposed algorithms improve over baselines and identify powerful tests from scarce observations.
Identifies a gradient flow to solve kernel learning problems with noise reduction.
problem Kernel learning problem with Gaussian noise.
method Riemannian gradient flow with continuous Lyapunov functionals.
result Flow reduces noise and finds stationary points.
For precision medicine and personalized treatment, we need to identify predictive markers of disease. We focus on Alzheimer's disease (AD), where magnetic resonance imaging scans provide information about the disease status. By combining imaging with genome sequencing, we aim at identifying rare genetic markers associa…
Kernel-Gradient Drifting improves generative modeling for non-Euclidean data.
problem Challenges in generative modeling for non-Euclidean data.
method Replaces Euclidean displacement with kernel-induced directions, exposing score-based structure.
result Kernel-gradient drifting enables state-of-the-art one-step generation for non-Euclidean data.
Identifies conditions for multiple invariant probabilities in Markov kernels.
problem Global irreducibility and recurrence do not guarantee uniqueness of invariant probabilities.
method Uses Jordan decomposition of the difference of two invariant probabilities.
result A Markov kernel has more than one invariant probability if and only if it admits a visible absorbing decomposition.
Kernel testing compares cell states in single-cell data.
problem Comparing non-linear cell states in single-cell data.
method Kernel-based testing framework for non-linear distribution comparison.
result Identifies subtle population variations in cell states.
TREX explains tree ensembles by identifying key training examples.
problem Identifying which training examples most influence tree ensemble predictions.
method TREX builds a surrogate model using a kernel that captures tree ensemble structure, approximating the original model.
result TREX provides accurate and effective explanations for tree ensembles.
The study explains how neural networks align their kernels to target functions during training.
problem Understanding how neural networks align their kernels to target functions during training.
method Theoretical analysis of kernel evolution in toy models and deep networks.
result Kernel alignment naturally emerges during training to accelerate convergence and improve generalization.
Generative models of eye gaze help identify viewers from images.
problem Identifying viewers from images based on their eye movements.
method Derived Fisher kernels from generative models of eye gaze to train a discriminative classifier.
result Performance of the classifier improves with better underlying generative models.
Study finds polynomial convergence rate for Farey sequences linked to Riemann hypothesis.
problem Understanding convergence rates of maximum mean discrepancies for Farey sequences.
method Identifying positive-semidefinite kernels and their polynomial convergence rates.
result Polynomial convergence rate of maximum mean discrepancies of Farey sequences is equivalent to the Riemann hypothesis.
New spectral mixture representation for isotropic kernels simplifies random Fourier features.
problem Applying Random Fourier Features to complex kernels.
method Decompose isotropic kernels into scale mixtures of α-stable random vectors.
result Constructive spectral sampling formula for various kernels.
The Wasserstein distance is a powerful metric based on the theory of optimal transport. It gives a natural measure of the distance between two distributions with a wide range of applications. In contrast to a number of the common divergences on distributions such as Kullback-Leibler or Jensen-Shannon, it is (weakly) co…
This paper constructs and studies the long-term factorization of affine pricing kernels into discounting at the rate of return on the long bond and the martingale component that accomplishes the change of probability measure to the long forward measure. The principal eigenfunction of the affine pricing kernel germane t…
New method learns kernels in nonlocal operators robustly.
problem Learning kernels in nonlocal operators is ill-posed.
method Nonparametric regression with Tikhonov regularization.
result Robust estimator of kernel yields homogenized model.
Identifying significant subsets of the genes, gene shaving is an essential and challenging issue for biomedical research for a huge number of genes and the complex nature of biological networks,. Since positive definite kernel based methods on genomic information can improve the prediction of diseases, in this paper we…
Advances in deep learning for spatio-temporal event modeling.
problem Limitations of traditional parametric models in capturing nonstationary dynamics.
method Integration of deep neural architectures to model conditional intensity function and influence kernels.
result Deep influence kernel approach enhances expressiveness and statistical explainability.
We study the problem of inferring readers' identities and estimating their level of text comprehension from observations of their eye movements during reading. We develop a generative model of individual gaze patterns (scanpaths) that makes use of lexical features of the fixated words. Using this generative model, we d…
In many-body physics, renormalization techniques are used to extract aspects of a statistical or quantum state that are relevant at large scale, or for low energy experiments. Recent works have proposed that these features can be formally identified as those perturbations of the states whose distinguishability most res…
Study on kernel regression risk in high dimensions using Pinsker bound.
problem Kernel regression risk in high-dimensional inner product spaces.
method Investigation of Pinsker bound for kernel regression on sphere Sd with sample size n=αdγ(1+od(1)). result Exact minimax risk and Pinsker constant identified for kernel regression.
In this paper, we provide a Banach-space formulation of supervised learning with generalized total-variation (gTV) regularization. We identify the class of kernel functions that are admissible in this framework. Then, we propose a variation of supervised learning in a continuous-domain hybrid search space with gTV regu…
A new method clusters heterogeneous subgroups for accurate causal learning.
problem Diverse causal relationships across different time spans, regions, or strategies.
method Nonlinear Causal Kernel Clustering
result Reduction in prediction error through enhanced causal learning.
Deep Gaussian Processes (DGPs) combine the expressiveness of Deep Neural Networks (DNNs) with quantified uncertainty of Gaussian Processes (GPs). Expressive power and intractable inference both result from the non-Gaussian distribution over composition functions. We propose interpretable DGP based on approximating DGP …
We present a scalable Gaussian process model for identifying and characterizing smooth multidimensional changepoints, and automatically learning changes in expressive covariance structure. We use Random Kitchen Sink features to flexibly define a change surface in combination with expressive spectral mixture kernels to …
Algorithm estimates nonparametric mixtures from grouped data.
problem Estimating identifiable nonparametric mixture models from grouped observations.
method Oracle inequality for weighted kernel density estimators and general consistency result.
result Consistent estimation of mixture components from grouped observations.
The generalization properties of Gaussian processes depend heavily on the choice of kernel, and this choice remains a dark art. We present the Neural Kernel Network (NKN), a flexible family of kernels represented by a neural network. The NKN architecture is based on the composition rules for kernels, so that each unit …
RKUM is an R package for robust kernel-based unsupervised methods.
problem Robust analysis under contaminated or noisy data conditions.
method Robust kernel covariance and cross-covariance operators using generalized loss functions.
result RKUM reduces sensitivity to contamination and effectively identifies outliers.
This study approximates neural network features for modeling relations and attention mechanisms.
problem Approximating neural network features for modeling relations and attention mechanisms.
method Analyzes inner products of multi-layer perceptrons for universal approximation of symmetric and asymmetric relation functions.
result Universal approximation of relation functions and attention mechanisms using inner products of neural networks.
Optimal kernel learning improves GP regression for high-dimensional inputs.
problem High computational costs and low prediction accuracy in GP models with many inputs.
method Approximates GP covariance with a convex combination of kernel functions, identifying active variables.
result Improves prediction accuracy and correctly identifies active input variables.
Kernel-based clustering algorithm can identify and capture the non-linear structure in datasets, and thereby it can achieve better performance than linear clustering. However, computing and storing the entire kernel matrix occupy so large memory that it is difficult for kernel-based clustering to deal with large-scale …
The paper identifies a 'small' set of functions containing Gaussian process samples.
problem Identifying a small set of functions containing Gaussian process samples.
method Using scaled RKHSs and Karhunen-Loève theorem, the paper defines the sample support set.
result The sample support set consists of functions with bounded squared basis coefficients.
Fundamental weight systems identified as quantum states.
problem Identifying which weight systems are quantum states.
method Analyzing the Cayley distance kernel on the symmetric group and its positivity.
result All fundamental gl(n)-weight systems are quantum states.
Geometric approach connects Burau representation to sphere metrics, identifying kernels.
problem Faithfulness of the Burau representation for the 4-strand case.
method Geometric and orbifold theory.
result Identifies the kernel of the Burau representation for some cases.
Algorithm learns interaction kernels for particle systems from data.
problem Understanding and modeling interactions in systems of interacting particles.
method Nonparametric algorithm using least squares with regularization, probabilistic error functional, and reproducing kernel Hilbert space convergence.
result The algorithm converges optimally and accurately learns interaction kernels.
Proposes a novel method to identify complex effects in multi-view datasets.
problem Challenges in analyzing multi-view biomedical datasets with complex interactions.
method Generalized kernel machine approach considering marginal and joint effects of features from different views.
result Effective identification of higher-order composite effects in multi-view datasets.
We derive analytical expressions for the generalization performance of kernel regression as a function of the number of training samples using theoretical methods from Gaussian processes and statistical physics. Our expressions apply to wide neural networks due to an equivalence between training them and kernel regress…
Many unsupervised kernel methods rely on the estimation of the kernel covariance operator (kernel CO) or kernel cross-covariance operator (kernel CCO). Both kernel CO and kernel CCO are sensitive to contaminated data, even when bounded positive definite kernels are used. To the best of our knowledge, there are few well…
Develops kernels for matchings, overcoming computational challenges.
problem Challenges in applying kernel methods to matchings due to their discrete, non-Euclidean nature.
method Characterizes stationary kernels, introduces heat and Matérn kernel families, and develops a sub-exponential algorithm for efficient evaluation.
result Establishes novel negative results and identifies an open problem in transferring the framework to trees.
Study on stability of 3D sessile drops, identifying degenerate kernel.
problem Linear stability of three-dimensional sessile drops with a free contact line.
method Derived constrained second variation, formulated Jacobi problem, combined geometric and Fourier analysis.
result Kernel of the constrained Jacobi operator is exactly the space of horizontal translations under pressure-volume nondegeneracy.
PKB framework boosts genomic data analysis by integrating pathway knowledge.
problem Boosting discovery power and connecting new findings with biological mechanisms in genomic data.
method Pathway-based Kernel Boosting (PKB) framework integrating clinical and pathway information for prediction of various outcomes.
result PKB substantially outperforms other methods in predicting drug response and cancer survival.
Paper identifies how neural networks learn features.
problem Understanding how neural networks automatically select features.
method Deep Neural Feature Ansatz, implementing average gradient outer product.
result Recursive Feature Machines achieve state-of-the-art performance.
VC dimensions of group CNNs are infinite for certain kernels and groups.
problem Estimating the generalization capacity of group convolutional neural networks.
method Identifying precise VC dimension estimates for simple sets of group CNNs.
result Two-parameter families of convolutional neural networks have an infinite VC dimension for infinite groups and certain kernels.