arXiv research

New method estimates sparse canonical vectors efficiently.

This article considers the problem of sparse estimation of canonical vectors in linear discriminant analysis when $p\gg N$. Several methods have been proposed in the literature that estimate one canonical vector in the two-group case. However, $G-1$ canonical vectors can be considered if the number of groups is $G$. In…

Canonical correlation analysis was proposed by Hotelling [6] and it measures linear relationship between two multidimensional variables. In high dimensional setting, the classical canonical correlation analysis breaks down. We propose a sparse canonical correlation analysis by adding l1 constraints on the canonical vec…

New method improves robust sparse association estimation.

Given two data matrices $X$ and $Y$, sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors $u$ and $v$ to maximize the correlation between $Xu$ and $Yv$. However, classical and sparse CCA models consider the contribution of all the samples of data matrices and thus cannot identify an unde…

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple canonical correlation analysis'' (sparse mCCA). All of the current sparse mCCA t…

Efficient algorithms for sparse parameter recovery in mixture models.

Canonical correlation analysis (CCA) is a multivariate statistical technique for finding the linear relationship between two sets of variables. The kernel generalization of CCA named kernel CCA has been proposed to find nonlinear relations between datasets. Despite their wide usage, they have one common limitation that…

Given two sets of variables, derived from a common set of samples, sparse Canonical Correlation Analysis (CCA) seeks linear combinations of a small number of variables in each set, such that the induced canonical variables are maximally correlated. Sparse CCA is NP-hard. We propose a novel combinatorial algorithm for s…

Paper develops IFTRR to solve sparse generalized eigenvalue problems efficiently.

Proposes PSCCA for estimating correlations and canonical correlations in sparse count data.

For a submanifold M in a Euclidean space, the tangential component x^T of the position vector field x of M is the most natural vector field tangent to the Euclidean submanifold, called the canonical vector field of M. In this article, first we prove that the canonical vector field of every Euclidean submanifold is alwa…

Proposes GCCA for detecting latent relations in multiview data with sparse structures.

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

Proposes $\ell_0$-CCA for sparse CCA with improved representation learning.

Bayesian method improves sparse CCA for multi-view data.

The position vector field x is the most elementary and natural geometric object on a Euclidean submanifold $M$. The position vector field plays very important roles in mathematics as well as in physics. Similarly, the tangential component x^T of the position vector field is the most natural vector field tangent to the …

Reducing the number of false discoveries is presently one of the most pressing issues in the life sciences. It is of especially great importance for many applications in neuroimaging and genomics, where datasets are typically high-dimensional, which means that the number of explanatory variables exceeds the sample size…

Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers to perform multiple assays on a single set of patient samples. Recent work has pr…

Holomorphic vector fields and anti-canonical divisors on complex manifolds are studied.

A new approach to the sparse Canonical Correlation Analysis (sCCA)is proposed with the aim of discovering interpretable associations in very high-dimensional multi-view, i.e.observations of multiple sets of variables on the same subjects, problems. Inspired by the sparse PCA approach of Journee et al. (2010), we also s…

Study orders of canonical bundles over graph configuration spaces.

We introduce Block Sparse Canonical Correlation Analysis which estimates multiple pairs of canonical directions (together a "block") at once, resulting in significantly improved orthogonality of the sparse directions which, we demonstrate, translates to more interpretable solutions. Our approach builds on the sparse CC…

We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal representation for the first view while having a dual representation for the second view…

New equivalences found between graded supermanifolds and vector bundles.

Sparse Canonical Correlation Analysis (CCA) has received considerable attention in high-dimensional data analysis to study the relationship between two sets of random variables. However, there has been remarkably little theoretical statistical foundation on sparse CCA in high-dimensional settings despite active methodo…

We give a representation of canonical vector bundles over Grassmannian manifolds as non-compact affine symmetric spaces as well as their Cartan model in the group of the Euclidean motions.

The paper proves a section for Anosov vector fields on compact manifolds.

Geometric equation defines canonical metrics on vector bundle families.

This work discusses the problem of sparse signal recovery when there is correlation among the values of non-zero entries. We examine intra-vector correlation in the context of the block sparse model and inter-vector correlation in the context of the multiple measurement vector model, as well as their combination. Algor…

This paper introduces $\infty$- and $n$-fold vector bundles as special functors from the $\infty$- and $n$-cube categories to the category of smooth manifolds. We study the cores and "n-pullbacks" of $n$-fold vector bundles and we prove that any $n$-fold vector bundle admits a non-canonical isomorphism to a decomposed …

In this paper we study the problem of noisy tensor completion for tensors that admit a canonical polyadic or CANDECOMP/PARAFAC (CP) decomposition with one of the factors being sparse. We present general theoretical error bounds for an estimate obtained by using a complexity-regularized maximum likelihood principle and …

This paper solves a problem in 3D geometry by defining a canonical partition for certain manifolds.

The paper introduces canonical parameters for marginally trapped surfaces in Minkowski space.

Let M be a simply connected Riemannian symmetric space, with at most one flat direction. We show that every Riemannian (or unitary) vector bundle with parallel curvature over M is an associated vector bundle of a canonical principal bundle, with the connection inherited from the principal bundle. The problem of finding…

Paper proposes ASCCA for sparse CCA with trace Lasso regularization.

Is it possible to find the sparsest vector (direction) in a generic subspace $\mathcal{S} \subseteq \mathbb{R}^p$ with $\mathrm{dim}(\mathcal{S})= n < p$? This problem can be considered a homogeneous variant of the sparse recovery problem, and finds connections to sparse dictionary learning, sparse PCA, and many other …

An $L_\infty$-algebra is built on symplectic manifold homology.

New methods integrate nonlinear, sparse, and multi-view aspects for high-dimensional data analysis.

Study on recovering supports of multiple sparse vectors from mixed linear measurements.

Feature hashing and other random projection schemes are commonly used to reduce the dimensionality of feature vectors. The goal is to efficiently project a high-dimensional feature vector living in $\mathbb{R}^n$ into a much lower-dimensional space $\mathbb{R}^m$, while approximately preserving Euclidean norm. These sc…

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction of every order comes at an exponential computational and memory cost (Curse of D…

Study on null hypersurfaces with constant angle in Lorentzian manifolds.

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new formulation of sparse coding is proposed which enables high dimensional tensors dictiona…

Regularised canonical correlation analysis was recently extended to more than two sets of variables by the multiblock method Regularised generalised canonical correlation analysis (RGCCA). Further, Sparse GCCA (SGCCA) was proposed to address the issue of variable selection. However, for technical reasons, the variable …

The study characterizes and analyzes spacelike surfaces with a canonical normal null direction in Minkowski 4-space.

A variety of representation learning approaches have been investigated for reinforcement learning; much less attention, however, has been given to investigating the utility of sparse coding. Outside of reinforcement learning, sparse coding representations have been widely used, with non-convex objectives that result in…

Study improves error bounds for sparse regression with heavy-tailed covariates.