Magnetic manifold HMC improves sampling on constrained manifolds.
problem Sampling from distributions restricted to embedded manifolds.
method Introduces magnetic manifold HMC, a generalization of HMC for constrained manifolds.
result Magnetic manifold HMC outperforms canonical manifold-constrained HMC.
Quantum dynamics algorithm learns manifold from data.
problem Learning manifolds from high-dimensional datasets.
method Simulation of quantum dynamics on a graph embedding of data.
result Algorithm reveals connections between data sampling and quantization.
The Riemannian Langevin Algorithm samples from manifolds efficiently.
problem Sampling from distributions on manifolds with log-Sobolev inequality.
method Riemannian Langevin Algorithm, log-Sobolev inequality, self-concordance extension, stochastic smoothness bounding.
result The Riemannian Langevin Algorithm converges rapidly to the target density.
New method shows Hessian estimator from random samples converges to true Hessian on complex manifolds.
problem Uncertainty in Hessian estimator accuracy on complex manifolds with boundaries and nonuniform sampling.
method Locally fitting quadratic polynomials, rigorous theoretical analysis under mild conditions.
result The Hessian estimator asymptotically converges to the true Hessian, even near boundaries.
Develops a method for manifold learning with small sample size datasets.
problem Improving manifold learning performance for multiple tasks with limited samples.
method Uses instance and model transfer to integrate manifold models from similar tasks.
result Successfully estimates manifolds with tiny sample sizes across multiple tasks.
Estimates manifold dimension from random samples.
problem Estimating the dimension of a manifold from random samples.
method Explicit theoretical and heuristic bounds for data set size.
result Data set needs to be sufficiently large for accurate dimension estimation.
MAGT generates data efficiently by aligning to manifold structure.
problem Efficiently generating data near a low-dimensional structure embedded in high-dimensional space.
method MAGT is a flow-like generator that learns a one-shot, manifold-aligned transport from a low-dimensional base distribution to the data space, using a fixed Gaussian smoothing level and self-normalized importance sampling.
result MAGT samples in a single forward pass, concentrates probability near the learned support, and induces an intrinsic density with respect to the manifold volume measure, enabling principled likelihood evaluation for generated samples.
New method samples manifolds efficiently using Dirichlet distribution.
problem Sampling on complex manifolds efficiently.
method Data-driven Dirichlet sampling on manifolds.
result Efficient sampling respects manifold structure with low computational effort.
M-FFF generates data on manifolds with fast sampling.
problem Sampling on arbitrary manifolds is computationally expensive.
method Optimizes a neural network via maximum likelihood on the manifold.
result Consistently matches or outperforms previous methods.
Kernel test detects manifold data differences with high-dimensional noise.
problem Detecting differences between manifold data samples.
method Kernel-based two-sample test statistic related to MMD for manifold data.
result The test power exceeds a threshold depending on manifold dimensionality, Hölder order, and squared divergence.
New summary measures reveal geometric structure in weighted measures on manifolds.
problem Lack of geometric information in standard weight-only summaries.
method Heat-kernel entropy profiles, tracking nonuniformity across scales.
result Geometric effective sample size discounts nearby or duplicate particles.
Riemannian Proximal Sampler improves sampling on manifold data.
problem Sampling from densities on Riemannian manifolds.
method Uses MBI and RHK oracles for high-accuracy sampling.
result Sampling with ε-accuracy requires O(log(1/ε)) iterations in KL divergence.
New method samples from multi-modal distributions on Riemannian manifolds without training.
problem Sampling from multi-modal distributions on Riemannian manifolds is challenging.
method Simulation of a non-equilibrium deterministic dynamics to transport noise toward target distributions.
result Method is entirely training-free and effective on various multi-modal problems.
Algorithm samples constrained stochastic differential equations.
problem Sampling stochastic differential equations with complex constraints.
method Pathspace Metropolis-adjusted manifold sampling.
result Demonstrated effectiveness in various constrained conditions.
Two-sample tests improve on existing methods for microtubule data.
problem Testing differences between two groups of filament data.
method Optimal lifts and manifold stability theorem applied to microtubule data.
result New tests outperform existing methods on simulated and real data.
A new method calculates intrinsic effective sample size for manifold-valued data.
problem Challenges in choosing effective sample size for manifold-valued data.
method Proposes an intrinsic effective sample size based on kernel discrepancy.
result Establishes an exact finite-sample risk interpretation and consistency of the estimator.
Graph Laplace operators uniquely identify metrics and densities on manifolds.
problem Identifying Riemannian metrics and sampling densities from graph Laplace operators.
method Analyzing intrinsic and extrinsic graph Laplace operators on compact Riemannian manifolds.
result Graph Laplace operators uniquely determine metrics and densities under certain conditions.
Spectral methods that are based on eigenvectors and eigenvalues of discrete graph Laplacians, such as Diffusion Maps and Laplacian Eigenmaps are often used for manifold learning and non-linear dimensionality reduction. It was previously shown by Belkin and Niyogi \cite{belkin_niyogi:2007} that the eigenvectors and eige…
SBMs learn manifold-like structures by mixing samples with a non-conservative field.
problem How SBMs learn data distributions on low-dimensional manifolds.
method Investigating linear approximations and subspaces of local feature vectors during diffusion.
result SBMs mix samples by a non-conservative field within the manifold, maintaining manifold-like structure.
OptIMIS method improves SRAM yield estimation efficiency and accuracy.
problem Efficient estimation of SRAM failure probability with shrinking technology nodes.
method Generalized norm minimization method, optimal manifold concept, onion sampling, neural coupling flow.
result OptIMIS method delivers up to 3.5x efficiency and 3x accuracy over state-of-the-art methods.
Proposes tests for comparing high-dimensional manifold samples.
problem Determining if two manifold samples come from the same distribution.
method Integral Probability Metric (IPM) with neural network approximations.
result Tests achieve type-II risk in specific orders of n. This short note aims at (re)proving that the symmetrically normalized graph Laplacian $L=\Id - D^{-1/2}WD^{-1/2}$ (from a graph defined from a Gaussian weighting kernel on a sampled smooth manifold) converges towards the continuous Manifold Laplacian when the sampling become infinitely dense. The convergence rate with …
Boomerang generates nonidentical images similar to input on image manifolds.
problem Generating nonidentical images similar to input on image manifolds.
method Adding noise to input image, moving closer to latent space, and mapping back through partial reverse diffusion.
result Boomerang generates nonidentical images similar to input on image manifolds.
No GANs can learn disconnected manifolds precisely.
problem Learning disconnected manifolds is challenging due to unimodal latent distributions.
method Formalized a no free lunch theorem and derived a rejection sampling method.
result Upper bound on the precision of the targeted disconnected manifold distribution.
New method for sampling on constrained domains using orthogonal-space gradient flow.
problem Sampling on manifolds defined by constraints is challenging.
method Orthogonal-Space Variational Gradient Descent (O-Gradient)
result O-Gradient converges to the target constrained distribution efficiently.
There has been an emerging trend in non-Euclidean statistical analysis of aiming to recover a low dimensional structure, namely a manifold, underlying the high dimensional data. Recovering the manifold requires the noise to be of certain concentration. Existing methods address this problem by constructing an approximat…
Proposes generating virtual data points to overcome the curse of dimensionality.
problem Increased intrinsic dimensionality requires large data sets for local sampling.
method Manifold embedding motivated super sampling (MESS) framework.
result Generates virtual data points that faithfully represent the manifold.
A new method for few-sample FS using manifold learning.
problem Few-sample supervised feature selection in high-dimensional spaces.
method Learn feature associations on manifolds, compute composite kernel, and use spectral analysis for FS score.
result Our method outperforms competitors in feature selection and classification accuracy.
The study examines how shallow neural nets converge to training samples or manifold points during diffusion.
problem Understanding when and how shallow neural nets converge to training samples or manifold points during diffusion.
method Analysis of shallow ReLU neural network denoisers trained with minimal ℓ2 norm, comparing score flow and diffusion flow. result Probability flow converges to training points, sums of training points, or manifold points, depending on the diffusion time scheduler.
Manifold learning based methods have been widely used for non-linear dimensionality reduction (NLDR). However, in many practical settings, the need to process streaming data is a challenge for such methods, owing to the high computational complexity involved. Moreover, most methods operate under the assumption that the…
Improved diffusion models solve inverse problems more accurately by correcting sample paths off the data manifold.
problem Current diffusion models for inverse problems often produce suboptimal results due to sample paths deviating from the data manifold.
method Proposed an additional correction term inspired by manifold constraints to make iterations closer to the data manifold.
result The proposed method boosts performance by a large margin, producing promising results in various applications.
New distributions on manifolds for better sampling.
problem Creating flexible distributions on Riemannian manifolds.
method Area-preserving maps and isometries for constructing distributions.
result Flexibility and straightforward sampling of distributions.
Kernel smoothing on unknown manifolds with bounds and asymptotic normality.
problem Data on unknown manifolds without boundaries.
method Finite sample bounds and asymptotic normality for kernel smoothing and its derivatives.
result Established finite sample bounds and asymptotic normality for kernel smoothing.
PFs and iPFs learn principal manifolds for efficient density estimation.
problem Understanding the geometric structure of normalizing flows.
method Characterize flows using principal manifolds and contours.
result PFs and iPFs can learn principal manifolds and perform density estimation.
Graph diffusion processes approximate manifold heat semigroups using graph transition matrices.
problem Approximating manifold heat semigroups from graph data under low regularity conditions.
method Iterating graph transition matrix P to approximate Qt=etΔ, bounding error in ∞-norm. result Convergence rates O(N−2/(d+6)) for manifold heat semigroup approximation, valid for in-sample and out-of-sample. Solves memorization in diffusion models for manifold data.
problem Memorization effect in diffusion models for manifold data.
method Inertia update at the end of empirical diffusion simulation.
result Approximates true data distribution on a C2 manifold. New algorithms improve MCMC efficiency for complex distributions.
problem High variance and low effective sample size in MCMC samplers.
method Antithetic Riemannian Manifold and Quantum-Inspired Hamiltonian Monte Carlo.
result Improved effective sample size and variance reduction.
New neural networks flatten and reconstruct manifolds from samples.
problem Learning from high-dimensional data embedded in submanifolds.
method Flattening Networks (FlatNet) that linearize and reconstruct embedded submanifolds.
result FlatNet achieves balance of interpretability, feasibility, and generalization.
Sampling random points can reveal submanifold topology.
problem Estimating the topology of submanifolds in Riemannian manifolds.
method Sampling random points in a neighborhood of the submanifold.
result Topology of the submanifold can be recovered with high confidence.
Manifold Learning is a class of algorithms seeking a low-dimensional non-linear representation of high-dimensional data. Thus manifold learning algorithms are, at least in theory, most applicable to high-dimensional data and sample sizes to enable accurate estimation of the manifold. Despite this, most existing manifol…
Modern sample points in many applications no longer comprise real vectors in a real vector space but sample points of much more complex structures, which may be represented as points in a space with a certain underlying geometric structure, namely a manifold. Manifold learning is an emerging field for learning the unde…
A new method for estimating density ratios using geodesics on statistical manifolds.
problem Stability of density ratio estimation when distributions are distant.
method Iterative sampling along generalized geodesics on the Riemannian manifold.
result The proposed method outperforms existing incremental mixture methods.
The paper analyzes sampling and estimation on manifolds using Langevin diffusion.
problem Sampling and estimation on compact Riemannian manifolds.
method Discretization of Langevin diffusion with error bounds derived.
result First-order error bounds for bias and variance in estimators.
We present an algorithm for approximating a function defined over a d-dimensional manifold utilizing only noisy function values at locations sampled from the manifold with noise. To produce the approximation we do not require any knowledge regarding the manifold other than its dimension d. We use the Manifold Movin…
Method samples triangulations of manifolds using biased random walks.
problem Efficiently sample triangulations of manifolds.
method Biased random walk through Pachner graph with Metropolis-Hastings accept/reject probabilities.
result Samples triangulations at random from chosen probability, estimating rare triangulations.
Improves GANs by sampling meaningful points from latent manifold.
problem Lack of semantic information in GANs' prior distribution.
method Local Coordinate Coding (LCC) for sampling and improved generator approximation.
result Improves GANs' performance in generating realistic data.
Adaptive sampling improves graph diffusion models by maintaining uniform information speed.
problem Standard diffusion models overlook non-homogeneous dynamics on complex manifolds.
method Information-geometric framework using Fisher-Rao metric and Drift Variation Score (DVS).
result DVS solver ensures uniform rate of distributional change, improving structural fidelity and efficiency.
This work improves sampling efficiency on complex spaces using determinantal processes.
problem Efficient sampling from large-scale datasets with general spaces.
method Determinantal point processes on general spaces and diffusion geometry.
result Improved sampling rates for determinantal processes on Riemannian manifolds and networks.