Two adaptive kernel selection methods improve the accuracy of Kernelized Diffusion Maps.
problem Selecting an appropriate kernel for Kernelized Diffusion Maps.
method Two complementary approaches: variational outer loop and unsupervised cross-validation.
result Both methods improve the quality and stability of the recovered eigenfunctions.
Diffusion maps are a commonly used kernel-based method for manifold learning, which can reveal intrinsic structures in data and embed them in low dimensions. However, as with most kernel methods, its implementation requires a heavy computational load, reaching up to cubic complexity in the number of data points. This l…
New method circumvents curse of dimensionality in Laplacian estimation.
problem High-dimensional data challenges spectral clustering and diffusion maps.
method Kernelized Laplacian estimation via reproducing kernel Hilbert space.
result Non-asymptotic statistical rates show improved performance in high dimensions.
DMPS uses diffusion maps and LAWGD for efficient generative modeling.
problem Efficiently modeling complex data distributions.
method Diffusion maps for manifold learning and LAWGD for sampling.
result DMPS outperforms other methods on moderate-dimensional data.
Conditional diffusion models can approximate target distributions well with Gaussian-mixture reverse kernels.
problem Approximating target distributions in conditional diffusion models.
method Using finite Gaussian mixtures with ReLU-network logits as reverse kernels, reducing the problem to static conditional density approximation.
result The resulting neural reverse-kernel class is dense in conditional KL divergence under exact terminal matching.
DM uses semigroup property to tune diffusion time for better data analysis.
problem Difficulty in tuning diffusion time for optimal data analysis.
method Proposes a semigroup criterion to select diffusion time.
result Effective and robust method for picking diffusion time.
We introduce {\em vector diffusion maps} (VDM), a new mathematical framework for organizing and analyzing massive high dimensional data sets, images and shapes. VDM is a mathematical and algorithmic generalization of diffusion maps and other non-linear dimensionality reduction methods, such as LLE, ISOMAP and Laplacian…
Unified kernel framework extends to stochastic systems, improving numerical stability.
problem Extending kernel methods to stochastic dynamical systems with diffusion.
method Unified kernel framework, Feynman-Kac path-integral representations, collocation-based computational framework.
result Kernel equivalence under uniform ellipticity assumptions and improved numerical stability with moderate diffusion.
GDMaps reduces high-dimensional data to lower dimensions for better classification.
problem High-dimensional data classification and representation.
method Grassmannian Diffusion Maps technique for nonlinear dimensionality reduction.
result GDMaps effectively identifies intrinsic subspace structures in high-dimensional data.
Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric structures in the data. Recently, it was suggested to replace the standard kernel …
New model generates data on constrained sets without losing tractability.
problem Generating data on constrained sets without losing tractability.
method Mirror Diffusion Models (MDM) learn diffusion processes in a dual space constructed from a mirror map.
result MDM generates data on convex constrained sets without losing tractability.
This research explores how different discrete diffusion kernels affect graph generation quality.
problem The impact of different discrete diffusion kernels on graph generation quality.
method Developed a family of discrete diffusion kernels that converge to different Bernoulli priors.
result The quality of generated graphs is sensitive to the prior used, challenging previous intuitions.
Enhanced probabilistic sampling on manifolds using Double Diffusion Maps and Geometric Harmonics.
problem Overfitting and loss of generalization in PLoM when N is small and dimensionality approaches N.
method Extending PLoM with Double Diffusion Maps and Geometric Harmonics to handle small N and high-dimensional data.
result Effective and robust method for generating statistically consistent realizations from limited data.
Improved diffusion map enhances manifold regularization for semi-supervised learning.
problem Limited performance of manifold regularization models in capturing global structure.
method Enhanced diffusion map with improved label propagation function.
result Proposed method improves manifold regularization model's performance.
Survey of Laplacian-based methods for data dimensionality reduction and embedding.
problem Efficiently reducing high-dimensional data to lower dimensions while preserving important features and structures.
method Laplacian-based methods including spectral clustering, Laplacian eigenmap, locality preserving projection, graph embedding, and diffusion map.
result Comprehensive overview of various optimization variants and applications of Laplacian-based techniques.
Kernel-smoothed scores improve diffusion models by reducing memorization.
problem Diffusion models can memorize training data, leading to biased samples.
method Interpret empirical score as noisy version of true score, kernel-smoothed.
result Kernel-smoothing reduces variance and improves generalization.
SM-netFusion estimates brain network atlas by considering multiple topological measures.
problem Limited BNA estimation methods that overlook topological measures and lack discriminative power.
method Supervised multi-topology network cross-diffusion framework using degree, closeness, and eigenvector centrality measures.
result SM-netFusion produces more centered and representative templates, and improves classification accuracy.
SJDs unify masked, continuous, and hybrid diffusion models.
problem Unified modeling of diffusion processes.
method Continuous-time Markov processes with token embeddings and hazard rates.
result Unified model recovers masked, continuous, and hybrid diffusion as limits.
Proposes GRAB-MDM for robust multiview data fusion.
problem Limited theoretical guarantees for multiview fusion methods in noisy high-dimensional data.
method Generalized Robust Adaptive-Bandwidth Multiview Diffusion Maps (GRAB-MDM) with adaptive bandwidth selection.
result Adaptive bandwidths lead to robust recovery of shared intrinsic structure in noisy multiview data.
Method learns SDEs from data snapshots.
problem Learning drift and diffusion of SDEs from data.
method Two-step process: learn drift by expected value, learn diffusion by SDP.
result Validated on examples and simulations.
We study reproducing kernel Hilbert spaces (RKHS) on a Riemannian manifold. In particular, we discuss under which condition Sobolev spaces are RKHS and characterize their reproducing kernels. Further, we introduce and discuss a class of smoother RKHS that we call diffusion spaces. We illustrate the general results with…
New method reduces computational cost for learning stationary diffusions.
problem Learning parameters of stationary diffusions efficiently.
method Stein-type discrepancy (SKDS) for estimating generator expectations.
result SKDS guarantees alignment with target stationary distribution.
HyBO optimizes hybrid structures using diffusion kernels.
problem Optimizing complex interactions between discrete and continuous variables.
method HyBO uses diffusion kernels over hybrid spaces with additive kernel formulation.
result HyBO significantly outperforms state-of-the-art methods on real-world benchmarks.
We present a novel Neural Embedding Spatio-Temporal (NEST) point process model for spatio-temporal discrete event data and develop an efficient imitation learning (a type of reinforcement learning) based approach for model fitting. Despite the rapid development of one-dimensional temporal point processes for discrete e…
Diffusion maps are an emerging data-driven technique for non-linear dimensionality reduction, which are especially useful for the analysis of coherent structures and nonlinear embeddings of dynamical systems. However, the computational complexity of the diffusion maps algorithm scales with the number of observations. T…
A new method estimates SDEs using occupation kernels.
problem Learning multivariate stochastic differential equations (SDEs).
method Two-step procedure: estimate drift, then diffusion. Occupation kernels used in RKHS.
result Validated on simulated and real-world data.
The paper introduces new methods for Asian option pricing using Laguerre quadrature.
problem Developing accurate pricing models for Asian options.
method Utilizes Laguerre quadrature and diffusion kernel approach.
result Demonstrates new techniques to solve complex Asian option pricing equations.
The paper connects Riemannian Gaussian distributions to random matrix theory and diffusion kernels.
problem Analyzing Riemannian Gaussian distributions on symmetric spaces.
method Analytical computation of marginals using orthogonal and skew orthogonal polynomials, and diffusion kernels.
result Riemannian Gaussian distributions are random matrix types, and their probability density functions can be computed analytically.
New graph kernels capture spatio-temporal interactions.
problem Lack of justified spatio-temporal graph kernels for graph problems.
method Derive graph kernels via SPDEs for spatio-temporal modelling.
result Non-separable spatio-temporal graph kernels outperform existing ones.
EntroPath learns manifold geometry from diffusion paths.
problem Learning geodesic geometry from data graphs with spurious shortcuts.
method Maximum Entropy Path Ensemble Embedding (MERW) with k-step diffusion paths.
result EntroPath converges to squared geodesic distance in the short-time limit.
Improved image generation quality using closed-form discriminator guidance in diffusion models.
problem Enhancing the quality of images generated by diffusion models.
method Theoretical framework to analyze GAN discriminator's effect on Langevin sampling, proposing IPM-GAN optimization as smoothed score-matching.
result Closed-form kernel-based discriminator guidance improves metrics like CLIP-FID and KID.
Model place cells as spatial embeddings for efficient path planning and cognitive map construction.
problem Encoding spatial navigation in the hippocampus.
method Model place cells using spectral decomposition of multi-step random walk transition kernels, inducing sparsity and adjacency.
result Place cells encode spatial information through non-negativity and inner-product structure, forming a cognitive map.
This paper analyzes error bounds for biased SMC samplers in conditional sampling.
problem Analyzing error bounds for biased SMC samplers in conditional sampling.
method Develops a non-asymptotic error analysis for SMC samplers with biased mutation kernels.
result Derives the first non-asymptotic error bound for conditional sampling with score-based diffusion models.
Generative model on manifolds reduces divergence computation and improves scalability.
problem Difficulties in modeling data on non-Euclidean spaces due to expensive divergence computation and approximations of heat kernel.
method Riemannian Diffusion Mixture, a principled framework using a mixture of bridge processes.
result Achieves superior performance on diverse manifolds with reduced simulation steps.
New BGs use diffusion models to improve sampling from complex distributions.
problem Sampling from complex, multi-modal distributions is challenging.
method Combines diffusion models with annealed Monte Carlo for improved sampling.
result Second-order denoising kernels can improve performance in high-dimensional spaces.
One of the major problems in natural language processing (NLP) is the word sense disambiguation (WSD) problem. It is the task of computationally identifying the right sense of a polysemous word based on its context. Resolving the WSD problem boosts the accuracy of many NLP focused algorithms such as text classification…
We solve a Schrödinger bridge with a quadratic state cost, finding a closed-form solution.
problem Optimizing diffusion processes between given distributions.
method Regularized Schrödinger bridge with a quadratic state cost.
result Closed-form solution for the Markov kernel of the regularized Schrödinger bridge.
Paper proposes a new method for supervised manifold learning using random forest proximities.
problem Existing supervised manifold learning methods fail to uncover meaningful embeddings due to using class-conditional distances.
method Proposes a data-geometry-preserving variant of random forest proximities as an initialization for manifold learning methods.
result Local and global structure preservation is near universal across manifold learning approaches using diffusion-based algorithms.
Algorithm learns interaction kernels for particle systems from data.
problem Understanding and modeling interactions in systems of interacting particles.
method Nonparametric algorithm using least squares with regularization, probabilistic error functional, and reproducing kernel Hilbert space convergence.
result The algorithm converges optimally and accurately learns interaction kernels.
Neumann eigenmaps improve landmark-based diffusion map embeddings.
problem Landmark-based diffusion map embeddings can be computationally inefficient and unstable.
method NeuMaps use a renormalized Neumann Laplacian for eigendecomposition, incorporating landmarks as a subgraph.
result NeuMaps offer a computationally efficient and stable embedding method.
Uniform heat kernel and diffusion bridge asymptotics for sub-Riemannian geometry.
problem Analyzing sub-Riemannian heat kernels and their derivatives on incomplete manifolds.
method Localized asymptotic analysis, focusing on minimizing geodesics and the non-abnormal cut locus.
result Uniform bounds and expansions for heat kernels and their derivatives on compacts, including the diffusion bridge measure.
In this paper we provide the small-time heat kernel asymptotics at the cut locus in three relevant cases: generic low-dimensional Riemannian manifolds, generic 3D contact sub-Riemannian manifolds (close to the starting point) and generic 4D quasi-contact sub-Riemannian manifolds (close to a generic starting point). As …
Efficient diffusion model for symmetric manifolds reduces training and computation costs.
problem Heat kernel computations for manifold diffusion models are computationally expensive and infeasible.
method Spatially-varying covariance diffusion model, efficient objective derived via Ito's Lemma.
result Our model reduces training time and arithmetic operations by orders of magnitude.
We introduce the concept of Hypoelliptic Diffusion Maps (HDM), a framework generalizing Diffusion Maps in the context of manifold learning and dimensionality reduction. Standard non-linear dimensionality reduction methods (e.g., LLE, ISOMAP, Laplacian Eigenmaps, Diffusion Maps) focus on mining massive data sets using w…
Spectral algorithms on manifolds using diffusion kernels improve convergence rates.
problem The limitations of existing spectral algorithms in RKHSs for data on manifolds.
method Integrating manifold structure into spectral algorithms using heat kernel diffusion spaces.
result Spectral algorithms converge to the target function and its derivatives in a strong sense, with rates dependent on manifold intrinsic dimension.
RNE provides a flexible framework for diffusion models, enabling inference-time control and energy-based training.
problem Insufficient knowledge of marginal densities in diffusion models.
method Introduces Radon-Nikodym Estimator (RNE) to reveal the connection between marginal densities and transition kernels.
result RNE delivers strong results in inference-time control and energy-based diffusion training.
We prove strong existence and uniqueness, and Hölder regularity, of a large class of stochastic Volterra equations, with singular kernels and non-Lipschitz diffusion coefficient. Extending Yamada-Watanabe's theorem, our proof relies on an approximation of the process by a sequence of semimartingales with regularised ke…
Unified kernel for prediction markets reduces belief variance forecast error.
problem Lack of standardized tools for quoting and hedging belief risk in prediction markets.
method Logit jump-diffusion model with risk-neutral drift, calibration pipeline, and coherent derivative layer.
result Model reduces forecast error compared to diffusion-only and probability-space baselines.