Adapts category theory to manifold learning for better understanding and stability.
problem Understanding and improving manifold learning algorithms.
method Develops a functorial perspective on manifold learning, proving bounds and constructing new algorithms.
result Derives new manifold learning algorithms that are competitive with existing methods.
Paper proposes a new method for supervised manifold learning using random forest proximities.
problem Existing supervised manifold learning methods fail to uncover meaningful embeddings due to using class-conditional distances.
method Proposes a data-geometry-preserving variant of random forest proximities as an initialization for manifold learning methods.
result Local and global structure preservation is near universal across manifold learning approaches using diffusion-based algorithms.
Manifold Learning is a class of algorithms seeking a low-dimensional non-linear representation of high-dimensional data. Thus manifold learning algorithms are, at least in theory, most applicable to high-dimensional data and sample sizes to enable accurate estimation of the manifold. Despite this, most existing manifol…
Contagion maps detect network structure in noisy data.
problem Detecting underlying manifold structure in noisy data.
method Using activation times in threshold contagions to map network nodes to high-dimensional space.
result Contagion maps reliably detect manifold structure in noisy data, while Isomap fails.
Most of existing manifold learning methods rely on Mean Squared Error (MSE) or ℓ2 norm. However, for the problem of image quality assessment, these are not promising measure. In this paper, we introduce the concept of an image structure manifold which captures image structure features and discriminates image dist…
Extends manifold learning to non-Euclidean metrics.
problem Applying manifold learning to data in non-Euclidean spaces.
method Generalizes manifold learning to metric spaces and studies conditions for convergence.
result Conditions for the convergence of graph Laplacian in metric spaces.
Paper warns of metric deformation in manifold learning, leading to incorrect answers.
problem Metric deformation in manifold learning.
method Analysis of manifold learning techniques.
result Metric deformation can lead to incorrect answers in manifold learning.
A new method integrates autoencoders with geometry regularization for manifold learning.
problem Extracting simplified low-dimensional representations that capture intrinsic geometry in data.
method Integrates autoencoders with a geometric regularization term based on diffusion potential distances.
result The method preserves intrinsic structure, enables out-of-sample extension, and faithful reconstruction.
Survey on geometric foundations of data reduction methods.
problem High-dimensional data with intrinsic nonlinear structure.
method Spectral manifold learning methods.
result Derivation and convergence analysis of spectral manifold learning.
MMCGAN uses explicit manifold learning to improve GAN performance.
problem GAN mode collapse and unstable training.
method Introduces Minimum Manifold Coding (MMC) as a prior to guide GAN training.
result MMCGAN effectively alleviates mode collapse and stabilizes GAN training.
Develops a method for manifold learning with small sample size datasets.
problem Improving manifold learning performance for multiple tasks with limited samples.
method Uses instance and model transfer to integrate manifold models from similar tasks.
result Successfully estimates manifolds with tiny sample sizes across multiple tasks.
DMT enhances deep neural networks to better preserve data structures.
problem Preserving geometric, topological, and distributional structures of data in NLDR.
method Deep manifold transformation (DMT) using cross-layer LGP constraints.
result DMT networks outperform existing NLDR methods in preserving data structures.
A new method for functional data classification using supervised manifold learning.
problem Improving classification of functional data.
method Supervised manifold learning approach considering label information.
result The proposed method achieves highly competitive performance compared to existing methods.
M-flows learn data manifolds and densities, improving manifold learning and inference.
problem Representing datasets with manifold structure more faithfully.
method Combining normalizing flows, GANs, autoencoders, and energy-based models, with a new training algorithm.
result M-flows learn data manifolds better than standard flows and provide handles for dimensionality reduction.
The paper extends manifold learning to arbitrary norms, improving molecular motion mapping.
problem Improving manifold learning for non-Euclidean norms.
method Determines the limiting differential operator for graph Laplacians using any norm.
result A modified Laplacian eigenmaps algorithm using Earthmover's distance outperforms Euclidean methods in molecular motion mapping.
No-collision maps improve manifold learning for image data.
problem Lack of geometric feature sensitivity in traditional distance measures.
method Developed no-collision transportation maps and distances.
result No-collision distances provide isometry for translations and dilations.
A new method for manifold learning using sparse regularised optimal transport.
problem Detecting latent manifolds in high-dimensional data with noisy observations.
method Proposes a symmetric version of optimal transport with quadratic regularisation to construct a sparse and adaptive affinity matrix.
result The method outperforms competing methods in numerical experiments and demonstrates robustness to heteroskedastic noise.
Optimally estimate distances on surfaces using reconstructed meshes.
problem Estimating intrinsic distances on smooth submanifolds.
method Reconstruction of the surface using a tangential Delaunay complex, and Isomap variant.
result Minimax optimality achieved for distance estimation.
We provide a way to infer about existence of topological circularity in high-dimensional data sets in Rd from its projection in R2 obtained through a fast manifold learning map as a function of the high-dimensional dataset X and a particular choice of a positive real σ known as band…
IsUMap improves data visualization of complex geometries.
problem Accurately representing complex, locally distorted metric spaces.
method Integrates UMAP and Isomap with Vietoris-Rips filtrations.
result Significant improvements in data representation quality.
Active learning improves GP regression on complex, high-dimensional data.
problem Improving Gaussian Process regression in high-dimensional spaces with discontinuous functions.
method Combines manifold learning with active learning to optimize data selection and reduce dimensionality.
result Superior performance over random learning in synthetic data experiments.
Nonlinear embedding manifold learning methods provide invaluable visual insights into the structure of high-dimensional data. However, due to a complicated nonconvex objective function, these methods can easily get stuck in local minima and their embedding quality can be poor. We propose a natural extension to several …
One of the common tasks in unsupervised learning is dimensionality reduction, where the goal is to find meaningful low-dimensional structures hidden in high-dimensional data. Sometimes referred to as manifold learning, this problem is closely related to the problem of localization, which aims at embedding a weighted gr…
Manifold learning now plays a very important role in machine learning and many relevant applications. Although its superior performance in dealing with nonlinear data distribution, data sparsity is always a thorny knot. There are few researches to well handle it in manifold learning. In this paper, we propose Hierarchi…
We propose a fast, simple and robust algorithm for computing shortest paths and distances on Riemannian manifolds learned from data. This amounts to solving a system of ordinary differential equations (ODEs) subject to boundary conditions. Here standard solvers perform poorly because they require well-behaved Jacobians…
LNPE enhances local connections in embeddings using extended neighbor propagation.
problem Improving local connections and interactions in nonlinear dimensionality reduction.
method Inspired by GCN, LNPE extends 1-hop neighbors to n-hop neighbors in LLE.
result LNPE produces more faithful and robust embeddings with better topological and geometrical properties.
A new spline method for manifold learning using Hessian-based curvature penalties.
problem Learning manifolds with curvature penalties in high dimensions.
method Generalizes thin-plate splines to flat manifolds using Hessian matrices, minimizing square error with curvature constraints.
result Existence and uniqueness of the spline solution, expressed as Green's functions and Hessian approximations.
Manifold learning offers nonlinear dimensionality reduction of high-dimensional datasets. In this paper, we bring geometry processing to bear on manifold learning by introducing a new approach based on metric connection for generating a quasi-isometric, low-dimensional mapping from a sparse and irregular sampling of an…
ML reduces high-dimensional data to reveal its underlying structure.
problem Handling large, high-dimensional data sets.
method Non-linear dimension reduction techniques.
result Reveals the geometric shape of high-dimensional data.
A new method for precise user targeting in advertising using hyperbolic manifold learning.
problem Improving user satisfaction in targeted advertising by overcoming skepticism and spam perception.
method Proposes a Multi-Manifold Learning framework to learn hierarchical user and ad representations in the hyperbolic space.
result Demonstrates improved performance in user targeting and prediction accuracy on both public datasets and a large-scale commercial system.
New method models covariates and responses without parametric assumptions using manifold learning.
problem Losing explanatory power for responses in standard factor models applied to covariates alone.
method Anisotropic diffusion maps for learning low-dimensional embeddings.
result Kalman filtering in diffusion-map coordinates improves joint covariate-response prediction.
A new method for unsupervised domain adaptation using manifold learning.
problem Leveraging rich source domain information to target domain without labeled data.
method Discriminative Manifold Embedding and Alignment framework.
result Consistent transferability and discriminability achieved through manifold metric alignment.
Explains SNE, t-SNE, and their variants for manifold learning.
problem Dimensionality reduction and manifold learning.
method Probabilistic approach using Gaussian and Student-t distributions.
result Out-of-sample extension and acceleration methods for t-SNE.
A new method learns submanifolds from high-dimensional data using quadric intersections.
problem Learning submanifolds from high-dimensional data.
method Learn submanifolds from quadric hypersurface intersections.
result Improved outlier detection and similarity metrics.
Discusses new probabilistic morphisms and geometric methods in machine and statistical learning.
problem Addressing challenges in statistical, machine, and manifold learning.
method Introduces category of probabilistic morphisms and geometric methods.
result New insights and applications in various learning fields.
For manifold learning, it is assumed that high-dimensional sample/data points are embedded on a low-dimensional manifold. Usually, distances among samples are computed to capture an underlying data structure. Here we propose a metric according to angular changes along a geodesic line, thereby reflecting the underlying …
Improves LSTM performance by initializing states via manifold learning.
problem Improving LSTM performance through better initialization.
method Learning an intrinsic data manifold to initialize LSTM internal states.
result Improved LSTM performance through consistent initialization.
Revisits Isomap, showing it constructs Euclidean representations of geodesic structure.
problem Nonlinear dimension reduction of manifold data.
method Revisits Isomap's rationale, clarifying its approach to constructing Euclidean representations of geodesic structure.
result Convexity is not required for shortest path distances to converge to Riemannian distances.
Paper proposes methods to learn sub-manifolds and estimate densities in normalizing flows.
problem Normalizing flows struggle with finding sub-manifolds in high-dimensional data.
method Introduces per-pixel penalized log-likelihood and hierarchical training approaches.
result Validated superior performance in manifold learning and density estimation.
Two algorithms estimate Wasserstein distance matrices from few entries for manifold learning.
problem Estimating Wasserstein distance matrices from limited data for manifold learning.
method Proposes two algorithms: matrix completion and Nyström completion for square Wasserstein matrices.
result Nyström completion can outperform matrix completion with a fixed sample budget and improve classification stability.
A new metric-based principal curve method learns 1D manifolds from spatial data.
problem Learning 1D manifolds from spatial data.
method Metric-based Principal Curve (MPC) approach.
result The method effectively learns the shape of 1D manifolds from synthetic and real datasets.
The study examines lower and upper bounds of Wasserstein distances for affine transformations of random vectors.
problem Understanding Wasserstein distances for affine transformations of random vectors.
method Lower and upper bounds for affine transformations of random vectors in Rn are derived using Bures metric and compositions of affine maps. result Concrete lower bounds and upper bounds for affine transformations are derived and applied to various distributions.
Establishes a link between heat diffusion and manifold distances in data.
problem No theoretical link between diffusion-based manifold learning and geodesic distances.
method Formulates heat geodesic embeddings based on Riemannian geometry.
result Method outperforms state-of-the-art in preserving manifold distances and cluster structure.
Proposes a method to cluster multi-aspect data using manifold learning with NMF.
problem Clustering multi-aspect data with diverse features and views.
method Includes inter-manifold learning in NMF framework to handle different data types.
result The method improves clustering accuracy and efficiency on various datasets.
GAMLA learns manifold structures with auto-encoding for global insights.
problem Limited global insight and lack of interpretable analytical descriptions in manifold learning.
method Two-round auto-encoding process to derive character and complementary representations.
result GAMLA provides global and analytical descriptions of smooth manifolds.
New method for analyzing complex data spaces.
problem Dimensionality reduction and learning data representations for continuous spaces.
method Manifold factorization based on spectral graph methods.
result Recovering factors yields meaningful lower-dimensional representations.
Derives PDEs from data using manifold learning and neural networks.
problem Identifying PDEs from unknown variables and dynamics.
method Combines manifold learning (Diffusion Maps) and neural networks.
result Emergent space identification connects with multiscale computation.
The paper examines how nonlinear transformations affect ridge sets in manifold learning.
problem Understanding the impact of nonlinear transformations on ridge sets in manifold learning.
method Examined the effects of nonlinear transformations on ridge sets using mathematical proofs and numerical experiments.
result The inclusion relationship $\cR(f\circ p)\subseteq \cR(p)$ holds for strictly increasing and concave transformations, and the Hausdorff distance between transformed and non-transformed ridge sets is smaller.