LIDL estimates local intrinsic dimension in high dimensions.
problem Estimating local intrinsic dimension in high-dimensional data.
method Approximate likelihood using parametric neural density estimation.
result LIDL scales to thousands of dimensions and yields competitive results.
Many nonparametric regressors were recently shown to converge at rates that depend only on the intrinsic dimension of data. These regressors thus escape the curse of dimension when high-dimensional data has low intrinsic dimension (e.g. a manifold). We show that k-NN regression is also adaptive to intrinsic dimension. …
eDCF estimates intrinsic dimension using local connectivity.
problem Challenges in estimating intrinsic dimension due to scale dependence.
method eDCF: a novel, scalable, and parallelizable method based on Connectivity Factor (CF).
result eDCF consistently matches leading estimators with comparable MAE and higher exact intrinsic dimension match rates.
New method estimates intrinsic dimensionality using angles, not distances.
problem Estimating local intrinsic dimensionality accurately.
method Introduces a new estimator using the distribution of angles between neighbor points.
result New estimator behaves similarly but complementarily to existing measures of intrinsic dimensionality.
Study provides bounds for estimating intrinsic dimension using Gaussian kernels.
problem Estimating intrinsic dimension from data.
method Finite-sample concentration and anti-concentration bounds for Gaussian kernel sums.
result Explicit dependence on sample size, bandwidth, and geometric parameters.
New score matching method estimates local intrinsic dimension efficiently.
problem Quantifying the local intrinsic dimension of complex data.
method Denoising score matching loss and equivalent implicit score matching loss.
result Denoising score matching loss is a highly competitive and scalable LID estimator.
Python package for estimating intrinsic dimensionality of datasets.
problem Estimating intrinsic dimensionality for machine learning applications.
method Implementation of various intrinsic dimension estimators in Python.
result Benchmarking of ID estimation methods on real and synthetic data.
The paper examines Wiener process for LID estimation methods.
problem Estimating local intrinsic dimension in high-dimensional datasets.
method Investigates recent LID estimation methods from a Wiener process perspective.
result Explains how methods behave under non-ideal conditions.
Detects singularities in complex data to improve machine learning models.
problem Real-world data often contains non-manifold structures (singularities) that can mislead machine learning models.
method Develops a topological framework to quantify local intrinsic dimension and Euclidicity score for multiple scales.
result Identifies singularities and captures local geometric complexity in image data.
LDLE embeds manifolds in lower dimensions with low distortion.
problem Embedding manifolds in lower dimensions with low distortion.
method Constructs local views using global eigenvectors of the graph Laplacian, registers them using Procrustes analysis, and tears manifolds apart for intrinsic dimension embedding.
result LDLE preserves distances up to a constant scale with low distortion.
We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension D of the conditioning variable is larger than the sample size n, estimation and inference is feasible as long as the distribution of the conditioning variable has small intrinsic…
In this work we prove that every locally symmetric smooth submanifold gives rise to a naturally defined smooth submanifold of the space of symmetric matrices, called spectral manifold, consisting of all matrices whose ordered vector of eigenvalues belongs to the locally symmetric manifold. We also present an explicit f…
A new method uses diffusion models to efficiently estimate local intrinsic dimensionality of data.
problem Estimating the local intrinsic dimensionality of high-dimensional data.
method Developed a method using the Fokker-Planck equation associated with diffusion models to estimate local intrinsic dimensionality.
result Diffusion models can effectively estimate local intrinsic dimensionality, outperforming existing methods in accuracy and speed.
Conformal Autoencoders infer intrinsic dimensionality and impose invariance.
problem Detecting intrinsic dimensionality and imposing invariance in nonlinear manifold data.
method Imposing orthogonality conditions on latent variables to infer intrinsic dimensionality and build coordinate invariance.
result The method can infer intrinsic dimensionality and build coordinate invariance on submanifolds.
Estimates intrinsic dimension of data sets robustly to noise.
problem Estimating intrinsic dimension of noisy data sets.
method Quantum Cognition Machine Learning for data representation and spectral gap detection.
result Robust estimation of intrinsic dimension in the presence of Gaussian noise.
Improved manifold-adaptive dimension estimator for better data complexity assessment.
problem Estimating intrinsic dimensionality of complex data.
method Revised and improved Farahmand-Szepesvári-Audibert (FSA) estimator, incorporating probability density function and median.
result Median-FSA estimator outperforms existing methods in accuracy and robustness.
Axis-aligned subspace clustering generally entails searching through enormous numbers of subspaces (feature combinations) and evaluation of cluster quality within each subspace. In this paper, we tackle the problem of identifying subsets of features with the most significant contribution to the formation of the local n…
The paper studies maps in the Heisenberg group and their images, called Rickman rugs.
problem Understanding maps and their images in the Heisenberg group.
method Analyzes maps f:WoH, where H is the first Heisenberg group and W is a vertical subgroup. result Rickman rugs in the Heisenberg group admit a corona decomposition by intrinsic bilipschitz graphs.
Estimates intrinsic dimension of data for GANs.
problem Estimating intrinsic dimension of high-dimensional data.
method Uses Wasserstein distances for estimation.
result Provides sample complexity bounds for GANs.
Adaptive framework improves nonparametric dimensionality reduction.
problem Optimal hyper-parameter tuning for nonparametric dimensionality reduction.
method Adaptive framework using intrinsic dimension estimator and optimal local neighbourhood sizes.
result Significant improvements in various learning tasks through better low-dimensional visualizations.
One of the founding paradigms of machine learning is that a small number of variables is often sufficient to describe high-dimensional data. The minimum number of variables required is called the intrinsic dimension (ID) of the data. Contrary to common intuition, there are cases where the ID varies within the same data…
For data living in a manifold M⊆Rm and a point p∈M we consider a statistic Uk,n which estimates the variance of the angle between pairs of vectors Xi−p and Xj−p, for data points Xi, Xj, near p, and evaluate this statistic as a tool for estimation of the intrinsic dimension o…
Study nearest-neighbor radii under dependent sampling, finding they remain informative.
problem Analyzing nearest-neighbor radii under dependent sampling.
method Consider strong mixing dependent observations, establish distribution-free almost sure convergence and sharp non-asymptotic moment bounds.
result Nearest-neighbor geometry remains informative under dependence sampling.
Paper infers intrinsic dimension from quasi-convex measurements.
problem Inferring intrinsic dimension from measurements by quasi-convex functions.
method Developed a method using filtration of Dowker complexes based on discrete data of point orderings.
result Correct intrinsic dimension can be inferred in the limit of large data under generic assumptions.
New proof shows diffusion models implicitly estimate intrinsic dimensionality.
problem Estimating intrinsic dimensionality of data from diffusion models.
method Formal proof of FLIPD under realistic assumptions.
result FLIPD's correctness proven under realistic conditions.
New estimators for intrinsic dimension and Wasserstein distance improve OT accuracy.
problem Intrinsic dimension estimation and Wasserstein distance estimation in large-scale OT.
method Introduces novel estimators for intrinsic dimension and Wasserstein distance.
result Simple, tuning-free estimator of OT and fast intrinsic dimension estimator.
QCML uses quantum geometry to represent data.
problem Data representation and the curse of dimensionality.
method QCML encodes data as Hermitian matrices in Hilbert space.
result Data geometry reveals intrinsic dimension and topological properties.
This survey reviews dimension estimation methods for datasets.
problem Understanding the intrinsic dimension of high-dimensional datasets.
method Categorizes dimension estimation methods by geometric information: tangential, parametric, and topological.
result Many dimension estimation methods may overfit and not generalize well.
Local EGOP learns functions varying along a few directions.
problem Efficient estimation of functions varying along a few directions in high-dimensional space.
method Local EGOP learning, a recursive algorithm using EGOP quadratic form as metric and inverse-covariance.
result Local EGOP learning achieves intrinsic dimensional learning rates under noisy manifold hypothesis.
The paper corrects biases in estimating intrinsic dimension and differential entropy.
problem Systematic bias in estimating intrinsic dimension and differential entropy.
method A bias-corrected estimator for both measures is proposed, highlighting shared steps and useful consequences.
result Simultaneous estimation of differential entropy and intrinsic dimension provides complementary perspectives on underlying manifolds.
Efficient method estimates intrinsic dimension for big data.
problem Estimating intrinsic dimension for large datasets is costly and complex.
method Proposes a matrix-vector product-based approach for efficient intrinsic dimension estimation.
result Demonstrates superior performance compared to state-of-the-art methods.
The paper examines vertical curves and fibers in the Heisenberg group, proving properties and constructing counterexamples.
problem Characterizing and measuring vertical curves and fibers in the Heisenberg group.
method Metric analysis of vertical curves and fibers of maps from the Heisenberg group to the plane.
result Vertical curves in the Heisenberg group can have Hausdorff dimensions strictly larger or smaller than 2, unlike intrinsic Lipschitz graphs.
High-dimensional data are ubiquitous in contemporary science and finding methods to compress them is one of the primary goals of machine learning. Given a dataset lying in a high-dimensional space (in principle hundreds to several thousands of dimensions), it is often useful to project it onto a lower-dimensional manif…
We prove three facts about intrinsic geometry of surfaces in a normed (Minkowski) space. When put together, these facts demonstrate a rather intriguing picture. We show that (1) geodesics on saddle surfaces (in a space of any dimension) behave as they are expected to: they have no conjugate points and thus minimize len…
Introduces intrinsic Riemannian cross-covariance for manifold-valued random objects.
problem Covariance estimation for random objects on Riemannian manifolds.
method Defines covariance and correlation via parallel transport.
result Proposed covariance is independent of coordinate choices.
New research shows that the dimension gap between intrinsic and ambient dimensions affects adversarial vulnerability of machine learning models.
problem The mystery of adversarial attacks on machine learning models.
method Introducing two types of adversarial attacks and proving their relationship to the dimension gap.
result The dimension gap between intrinsic and ambient dimensions makes clean-trained models more vulnerable to off-manifold adversarial perturbations.
Rdimtools simplifies DR and IDE for high-dimensional data analysis.
problem Discovering patterns in complex high-dimensional data.
method Provides an R package with 133 DR and 17 IDE algorithms.
result Facilitates geometric understanding of high-dimensional data.
New geometric conditions ensure compactness of ∂ˉ-Neumann problem.
problem Compactness of ∂ˉ-Neumann operator on specific domains. method Introduced new geometric conditions for a class of domains, proving compactness equivalence to boundary properties.
result Compactness of ∂ˉ-Neumann operator equivalent to boundary lack of analytic varieties. We propose a new method for estimating the intrinsic dimension of a dataset by applying the principle of regularized maximum likelihood to the distances between close neighbors. We propose a regularization scheme which is motivated by divergence minimization principles. We derive the estimator by a Poisson process appr…
Contrastive learning adapts to data intrinsic dimensions, learning low-dimensional representations.
problem Learning high-dimensional representations from multi-modal data.
method Multi-modal contrastive learning with temperature optimization.
result Contrastive learning adapts to intrinsic dimensions of data, not specified dimensions.
New algorithm estimates intrinsic dimension of discrete datasets.
problem Inaccuracies in using continuous methods for discrete datasets.
method Introduced an algorithm to infer intrinsic dimension of discrete spaces.
result Demonstrated accuracy on benchmark datasets and found a small intrinsic dimension in a metagenomic dataset.
Low-dimensional structure in images helps deep learning models generalize better.
problem Understanding the intrinsic dimensionality of images for better model performance.
method Applied dimension estimation tools to popular image datasets and used GANs to manipulate intrinsic dimensionality.
result Natural image datasets have very low intrinsic dimensionality, which aids neural networks in learning and generalizing.
The paper simplifies FLRW photon propagators using geometric embeddings.
problem Understanding Friedmann-Lemaître-Robertson-Walker (FLRW) spaces.
method Differential-geometric methods applied to FLRW spaces as submanifolds in \(\mathbb{R}^{n+2}\).
result New and simplified expressions for the photon propagator in four dimensions.
New method estimates deep neural network's intrinsic dimension for better generalization.
problem Estimating intrinsic dimension of deep neural networks for generalization.
method Topological data analysis (TDA) and persistent homology (PHD).
result Efficient algorithm to estimate PHD in deep neural networks.
The paper is devoted to the local classification of generic control-affine systems on an n-dimensional manifold with scalar input for any n>3 or with two inputs for n=4 and n=5, up to state-feedback transformations, preserving the affine structure. First using the Poincare series of moduli numbers we introduce the intr…
We focus our attention on the notion of intrinsic Lipschitz graphs, inside a special class of metric spaces i.e. the Carnot groups. More precisely, we provide a characterization of locally intrinsic Lipschitz functions in Carnot groups of step 2 in terms of their intrinsic distributional gradients.
The aim of the present paper is to provide an intrinsic investigation of projective changes in Finlser geometry, following the pullback formalism. Various known local results are generalized and other new intrinsic results are obtained. Nontrivial characterizations of projective changes are given. The fundamental proje…
Geometrically, high-likelihood regions in DGMs are unlikely to generate OOD data.
problem The paradox of high-likelihood OOD detection in deep generative models.
method Local intrinsic dimension estimation to identify high-likelihood regions that do not generate OOD data.
result A method pairing likelihoods and LID estimates for reliable OOD detection.