arXiv research

Study uses Lie group subgroups to identify special subspaces in calibrations.

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neural networks is challenging due to the high dimensionality of the parameter space. In this paper, we …

Given a parallel calibration $φ\in Ω^p(M)$ on a Riemannian manifold $M$, I prove that the $φ$--critical submanifolds with nonzero critical value are minimal submanifolds. I also show that the $φ$--critical submanifolds are precisely the integral manifolds of a $\mathscr{C}^\infty(M)$--linear subspace $\sP \subset Ω^p(M…

This paper improves Reifenberg's theorem for almost calibrated sets, ensuring rectifiability with volume bounds.

A new framework for PPLS combines noise estimation, optimization, and calibration.

CPCR mitigates bias in PCR for overparameterized models.

Proposes a new algorithm to estimate invariant subspaces across multilayer networks.

This work simplifies Bayesian inference for neural networks by identifying influential parameter directions.

By only using spectral theory of the Laplace operator on spheres, we prove that the unit 3-dimensional sphere of a 2-dimensional complex subspace of $\mathbb{C}^3$ is a $Ω$-stable submanifold with parallel mean curvature, when $Ω$ is the Kähler calibration of rank 4 of $\mathbb{C}^3$.

Ancient solutions and translators identified for Lagrangian flow.

A method corrects bias in estimating a high-dimensional classification rule using auxiliary outcomes.

It is generally accepted that all models are wrong -- the difficulty is determining which are useful. Here, a useful model is considered as one that is capable of combining data and expert knowledge, through an inversion or calibration process, to adequately characterize the uncertainty in predictions of interest. This…

Introduces Lorentzian Cayley form solving geometric puzzle.

Robust fuzzy clustering for EEG driver alertness with outlier detection.

A new method routes EEG covariance matrices across domains using adaptive subspace selection.

We introduce the probabilistic sequential matrix factorization (PSMF) method for factorizing time-varying and non-stationary datasets consisting of high-dimensional time-series. In particular, we consider nonlinear Gaussian state-space models where sequential approximate inference results in the factorization of a data…

Fair representations are a powerful tool for establishing criteria like statistical parity, proxy non-discrimination, and equality of opportunity in learned models. Existing techniques for learning these representations are typically model-agnostic, as they preprocess the original data such that the output satisfies so…

Paper bounds subspace estimator error from noisy projections.

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The problem of subspace learning or PCA in the presence of outliers is called robust su…

Union of Subspaces (UoS) is a popular model to describe the underlying low-dimensional structure of data. The fine details of UoS structure can be described in terms of canonical angles (also known as principal angles) between subspaces, which is a well-known characterization for relative subspace positions. In this pa…

Study $Sp(n)$-orbits in complex and $Σ$-complex subspaces of Hermitian quaternionic vector spaces.

In subspace clustering, a group of data points belonging to a union of subspaces are assigned membership to their respective subspaces. This paper presents a new approach dubbed Innovation Pursuit (iPursuit) to the problem of subspace clustering using a new geometrical idea whereby subspaces are identified based on the…

We consider the problem of detecting whether a tensor signal having many missing entities lies within a given low dimensional Kronecker-Structured (KS) subspace. This is a matched subspace detection problem. Tensor matched subspace detection problem is more challenging because of the intertwined signal dimensions. We s…

Paper shows affine constraint is unnecessary for high-dimensional data.

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The corresponding subspace clustering problem has been extensively studied in the lit…

This paper investigates the generalization of Principal Component Analysis (PCA) to Riemannian manifolds. We first propose a new and general type of family of subspaces in manifolds that we call barycentric subspaces. They are implicitly defined as the locus of points which are weighted means of $k+1$ reference points.…

Flow Matching models help generative models stay within the subspace of real data.

In this letter, we consider two sets of observations defined as subspace signals embedded in noise and we wish to analyze the distance between these two subspaces. The latter entails evaluating the angles between the subspaces, an issue reminiscent of the well-known Procrustes problem. A Bayesian approach is investigat…

Give deterministic necessary and sufficient conditions to guarantee that if a subspace fits certain partially observed data from a union of subspaces, it is because such data really lies in a subspace. Furthermore, Give deterministic necessary and sufficient conditions to guarantee that if a subspace fits certain parti…

In this paper, we exhibit the tradeoffs between the (training) sample, computation and storage complexity for the problem of supervised classification using signal subspace estimation. Our main tool is the use of tensor subspaces, i.e. subspaces with a Kronecker structure, for embedding the data into lower dimensions. …

A new method for faster optimization in high dimensions.

We assume data sampled from a mixture of d-dimensional linear subspaces with spherically symmetric distributions within each subspace and an additional outlier component with spherically symmetric distribution within the ambient space (for simplicity we may assume that all distributions are uniform on their correspondi…

An elliptic theory is constructed for operators acting in subspaces defined via odd pseudodifferential projections. Subspaces of this type arise as Calderon subspaces for first order elliptic differential operators on manifolds with boundary, or as spectral subspaces for self-adjoint elliptic differential operators of …

WPCA improves subspace recovery robustness to outliers.

Transforms data into separable subspaces for clustering.

Stochastic Sparse Subspace Clustering improves subspace clustering by reducing over-segmentation through dropout.

Proposes a method to enforce nestedness in subspace learning methods.

This work presents GROUSE (Grassmanian Rank-One Update Subspace Estimation), an efficient online algorithm for tracking subspaces from highly incomplete observations. GROUSE requires only basic linear algebraic manipulations at each iteration, and each subspace update can be performed in linear time in the dimension of…

Sparse subspace clustering (SSC) is an elegant approach for unsupervised segmentation if the data points of each cluster are located in linear subspaces. This model applies, for instance, in motion segmentation if some restrictions on the camera model hold. SSC requires that problems based on the $l_1$-norm are solved …

This paper considers the problem of robust subspace recovery: given a set of $N$ points in $\mathbb{R}^D$, if many lie in a $d$-dimensional subspace, then can we recover the underlying subspace? We show that Tyler's M-estimator can be used to recover the underlying subspace, if the percentage of the inliers is larger t…

Fast robust subspace tracking in sparse data-dependent noise with near-optimal delay.

Paper recovers multi-subspace matrices from permuted data.

The concept of pure spinor is generalized, giving rise to the notion of pure subspaces, spinorial subspaces associated to isotropic vector subspaces of non-maximal dimension. Several algebraic identities concerning the pure subspaces are proved here, as well as some differential results. Furthermore, the freedom in the…

In this paper we consider the problem of group invariant subspace clustering where the data is assumed to come from a union of group-invariant subspaces of a vector space, i.e. subspaces which are invariant with respect to action of a given group. Algebraically, such group-invariant subspaces are also referred to as su…

We consider the problem of subspace clustering: given points that lie on or near the union of many low-dimensional linear subspaces, recover the subspaces. To this end, one first identifies sets of points close to the same subspace and uses the sets to estimate the subspaces. As the geometric structure of the clusters …

RaSE ensemble framework improves sparse classification accuracy.

High-dimensional data often lie in low-dimensional subspaces corresponding to different classes they belong to. Finding sparse representations of data points in a dictionary built using the collection of data helps to uncover low-dimensional subspaces and address problems such as clustering, classification, subset sele…

Theoretical guarantees for STE, a robust subspace recovery method.