Subspace clustering is the problem of partitioning unlabeled data points into a number of clusters so that data points within one cluster lie approximately on a low-dimensional linear subspace. In many practical scenarios, the dimensionality of data points to be clustered are compressed due to constraints of measuremen…
We prove that for compact, non-contractible, one dimensional geodesic spaces, a version of the marked length spectrum conjecture holds. For a compact one dimensional geodesic space X, we define a subspace Conv(X). When X is non-contractible, we show that X deformation retracts to Conv(X). If two such spaces X, Y have t…
Method estimates multivariate counterfactual distributions efficiently and accurately.
problem Estimating multivariate counterfactual distributions in causal models with correlation structures.
method Proposes a method leveraging a one-dimensional subspace to capture correlation structures and efficiently estimate multivariate counterfactual distributions.
result Demonstrates superior performance over existing methods on synthetic and real-world data.
Paper improves ℓ0-SSC for noisy data by proving SDP and proposing Noisy-DR-ℓ0-SSC.
problem Noisy data and less restrictive subspace affinity in sparse subspace clustering.
method Proposes Noisy-DR-ℓ0-SSC, which projects data onto a lower dimensional space and then applies noisy ℓ0-SSC. result Theoretical guarantee on the correctness of noisy ℓ0-SSC in terms of SDP on noisy data. LineBO tackles high-dimensional Bayesian optimization by solving 1D subproblems.
problem Bayesian optimization struggles in high dimensions due to complex acquisition steps.
method LineBO restricts high-dimensional problems to 1D subproblems iteratively solved efficiently.
result LineBO converges globally and achieves a fast local rate for strongly convex functions.
Diffusion models improve creativity by smoothing the score function, leading to interpolated data.
problem Improving creativity in diffusion models.
method Analyzing the effect of score smoothing on diffusion model dynamics.
result Score smoothing causes diffusion models to generate data that interpolate the training set.
The purpose of this paper is to classify α-para Kenmotsu manifolds M3 such that the projection of the image of concircular curvature tensor L in one-dimensional linear subspace of Tp(M3) generated by ξp is zero.
We propose a conjugate gradient type optimization technique for the computation of the Karcher mean on the set of complex linear subspaces of fixed dimension, modeled by the so-called Grassmannian. The identification of the Grassmannian with Hermitian projection matrices allows an accessible introduction of the geometr…
BOIDS optimizes high-dimensional problems by guiding optimization with one-dimensional lines.
problem Scaling Bayesian Optimization to high-dimensional problems.
method BOIDS uses a sequence of one-dimensional direction lines guided by an adaptive selection technique and incorporates subspace embedding for efficiency.
result BOIDS outperforms state-of-the-art methods on various synthetic and real-world problems.
Proposes an optimization framework for sparse robust subspace estimation.
problem Sparse robust one-dimensional subspace estimation.
method l1-norm regularization, linear relaxation, simple ratios, sorting techniques.
result Achieves global optimality for sparse robust subspace with polynomial time efficiency.
Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data. PCA performs well in the presence of moderate noise and even with missing data, b…
Studying a softmax-attention model, we show that the learned query converges to the latent signal subspace spanned by the informative direction.
problem Understanding the theoretical principles of attention mechanisms in large-scale token collections.
method Deriving a population objective and analyzing the limiting ordinary differential equation of the learning dynamics.
result The learned query asymptotically recovers the latent signal up to the intrinsic sign ambiguity.
New neural networks learn single-index models efficiently.
problem Learning low-dimensional structure in high-dimensional data.
method Shallow neural networks with frozen biases, studied via gradient flow.
result Generalization guarantees match near-optimal sample complexity.
Study of multi-moment maps on specific six-manifolds.
problem Understanding multi-moment maps on nearly Kähler six-manifolds.
method Explicit derivation of multi-moment maps and analysis of fixed-points and orbits.
result Explicit expression and configuration of fixed-points and orbits derived.
A new method slices and sums radial kernels faster.
problem Fast computation of large kernel sums in kernel methods.
method Random projections to 1D subspaces and QMC for selecting projections.
result QMC-slicing outperforms existing methods on test datasets.
Vector representations of words have heralded a transformational approach to classical problems in NLP; the most popular example is word2vec. However, a single vector does not suffice to model the polysemous nature of many (frequent) words, i.e., words with multiple meanings. In this paper, we propose a three-fold appr…
A new method for SVGD reduces variance in high dimensions.
problem High-dimensional variance in SVGD.
method Grassmann Stein Variational Gradient Descent (GSVGD) projects onto arbitrary subspaces and uses coupled Grassmann-valued diffusion.
result GSVGD explores high-dimensional problems with intrinsic low-dimensional structure efficiently.
Non-Gaussian component analysis (NGCA) is a problem in multidimensional data analysis which, since its formulation in 2006, has attracted considerable attention in statistics and machine learning. In this problem, we have a random variable X in n-dimensional Euclidean space. There is an unknown subspace Γ of the …
Meta-learning can perform well on non-convex models even with few samples, contrary to convex models.
problem Understanding the sample complexity of meta-learning for non-convex models.
method Constructing a simple meta-learning instance and analyzing the training dynamics of Reptile and multi-task representation learning.
result Meta-learning can achieve new task sample complexity of O(1) for non-convex models, unlike convex models which require Ω(d) samples. Defines and extends flat pseudo-Riemannian F-Lie algebras.
problem Generating weakly flat Lorentzian non-abelian bi-nilpotent F-Lie algebras.
method Constructs double extensions of flat pseudo-Riemannian F-Lie algebras.
result Provides a framework for generating all weakly flat Lorentzian non-abelian bi-nilpotent F-Lie algebras.
Max-sliced Wasserstein metric reduces high-dimensional data to 1D for better estimation.
problem Curse of dimensionality in optimal transport.
method Introduces max-sliced Wasserstein metric to reduce high-dimensional problems to 1D.
result Uniform ratio bounds of empirical measures on RKHS concentrate uniformly fast at parametric rates.
The paper explores properties of the Radon transform in relation to neural networks and ridges.
problem Understanding the Radon transform and its application to neural networks and ridges.
method Investigates properties of the Radon transform, introduces new subspaces, and characterizes ridges for any distributional profile.
result Clarifies and simplifies results on the optimality of ReLU networks using the Radon transform.
Study one-dimensional topological theories with linear generating functions.
problem Understanding one-dimensional topological theories with defects.
method Construct bases of hom spaces for decorated unoriented one-dimensional cobordisms.
result Gram determinant and linear generating functions constructed.
A new approach simplifies Sliced-Wasserstein distances to improve learning performance.
problem The concentration of measure phenomenon makes random projections uninformative in high dimensions.
method Propose rescaling the 1D Wasserstein distance to make all slices equally informative.
result The classical Sliced-Wasserstein, properly configured, can match or surpass complex variants.
This work improves understanding of projection robust optimal transport distances.
problem Understanding the behavior of minimum Wasserstein estimators in high-dimensional and misspecified models.
method Adopting projection robust (PR) optimal transport, establishing statistical properties, proposing IPRW distance, and providing asymptotic guarantees.
result Established fundamental statistical properties and proposed new distances that outperform Wasserstein distances empirically.
An Engel structure is a maximally non-integrable field of two-planes tangent to a four-manifold. Any two such structures are locally diffeomorphic. We investigate the space of global deformations of canonical Engel structures arising out of contact three-manifolds. The main tool is Cartan's method of prolongation and d…
We found a new simple family of Cantor sets whose projections are one-dimensional.
problem Finding simple Cantor sets with specific projection properties.
method Developed a new series of self-similar Cantor sets in R3. result All projections of these new Cantor sets are connected and one-dimensional.
Study of one-dimensional non-Hausdorff manifolds and their quotient to CW complexes.
problem Understanding and characterizing one-dimensional non-Hausdorff manifolds.
method Analyzing properties of connected non-Hausdorff manifolds and their quotient spaces to CW complexes.
result Existence of a quotient map from a connected non-Hausdorff manifold to an open one-dimensional CW complex.
A new metric-based principal curve method learns 1D manifolds from spatial data.
problem Learning 1D manifolds from spatial data.
method Metric-based Principal Curve (MPC) approach.
result The method effectively learns the shape of 1D manifolds from synthetic and real datasets.
The Brasselet number helps calculate function germs with one-dimensional critical sets.
problem Calculating topological information of function germs with nonisolated singularities.
method Using the Brasselet number, the paper presents formulas for function germs with a one-dimensional critical locus.
result Formulas for function germs with a one-dimensional critical locus.
Reduces function approximation dimensions from high to low with sparse data.
problem Function approximation from sparse data.
method Nonlinear Level Set Learning (NLL) with geometric information.
result Reduces input dimension to theoretical lower bound with minor accuracy loss.
Quantum reservoir computing needs coherence influx for effective information processing.
problem Understanding and optimizing quantum reservoir computing.
method Theoretical and numerical analysis of quantum systems, focusing on coherence influx and spectral radius of Pauli transfer matrix.
result Coherence influx is essential for realizing nonstationary echo state property in quantum reservoir computing.
One-dimensional crystals have convex shapes under certain conditions.
problem Determining if one-dimensional crystals have convex shapes.
method Analyzing the free energy under mass constraints and convexity assumptions.
result In one dimension, crystals have convex shapes under given conditions.
Proves metric measure spaces with certain properties are one-dimensional.
problem Characterizing metric measure spaces as one-dimensional.
method Analyzes properties of metric measure spaces and uses optimal transport maps.
result Metric measure spaces with specified properties are one-dimensional.
Smooth algebra analysis for one-dimensional singular foliations.
problem Analyzing smooth algebras of one-dimensional singular foliations.
method Analyzing natural ideals and using Dixmier-Malliavin theorem.
result Smooth algebras of one-dimensional singular foliations are pairwise nonisomorphic.
Left invariant affine structures in a Lie group G are in one-to-one correspondence with left-symmetric algebras over its Lie algebra g=TeG (``over'' means that the commutator [x,y]=xy−yx coincides with the Lie bracket; left-symmetric algebras can be defined as Lie-admissible algebras such that the mult…
We classify the harmonic morphisms with one-dimensional fibres (1) from real-analytic conformally-flat Riemannian manifolds of dimension at least four, and (2) between conformally-flat Riemannian manifolds of dimensions at least three.
Paper uses random projection to preserve subspace structure for efficient data analysis.
problem Efficiently analyzing data with low-dimensional structure.
method Compressed Subspace Learning (CSL) framework based on Johnson-Lindenstrauss property.
result Random projection preserves the UoS structure of data, enabling efficient analysis.
One-dimensional CNNs improve signal recovery from sparse measurements.
problem Recovering signals from limited data.
method One-dimensional Deep Image Prior (DIP) using CNNs with regularization.
result One-dimensional CNNs outperform traditional methods in signal recovery.
Study local topology of a function-germ deformation with a one-dimensional critical set.
problem Analyze the local topology of a deformation of a function-germ with a one-dimensional critical set.
method Use the Brasselet number to study the local topology of a deformation of a function-germ.
result Present a new proof of the Lê-Iomdin formula for the Brasselet number.
Paper bounds subspace estimator error from noisy projections.
problem Estimating subspaces from noisy data.
method Derives perturbation bound on optimal subspace estimator.
result Fundamental result with implications in matrix completion and clustering.
PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The problem of subspace learning or PCA in the presence of outliers is called robust su…
In subspace clustering, a group of data points belonging to a union of subspaces are assigned membership to their respective subspaces. This paper presents a new approach dubbed Innovation Pursuit (iPursuit) to the problem of subspace clustering using a new geometrical idea whereby subspaces are identified based on the…
Study Sp(n)-orbits in complex and Σ-complex subspaces of Hermitian quaternionic vector spaces.
problem Characterize Sp(n)-orbits in Grassmannians of complex and Σ-complex subspaces. method Decompose subspaces into 4-dimensional complex addends and 2-dimensional totally complex subspace. Use properties of isoclinic subspaces and principal angles.
result Determine full set of invariants for Sp(n)-orbits in GrR(2k,4n). We consider the problem of detecting whether a tensor signal having many missing entities lies within a given low dimensional Kronecker-Structured (KS) subspace. This is a matched subspace detection problem. Tensor matched subspace detection problem is more challenging because of the intertwined signal dimensions. We s…
Paper shows affine constraint is unnecessary for high-dimensional data.
problem The necessity of an affine constraint in affine subspace clustering.
method Theoretical and empirical analysis of conditions for correctness of affine subspace clustering methods.
result Affine constraint has negligible effect on clustering performance for high-dimensional data.
A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The corresponding subspace clustering problem has been extensively studied in the lit…
This paper investigates the generalization of Principal Component Analysis (PCA) to Riemannian manifolds. We first propose a new and general type of family of subspaces in manifolds that we call barycentric subspaces. They are implicitly defined as the locus of points which are weighted means of k+1 reference points.…