Kernel and MKCCA classify schizophrenia patients from imaging and genetic data.
problem Classifying schizophrenia patients from imaging and genetic data.
method Employed Kernel and Multiple Kernel Canonical Correlation Analysis (CCA) for classification.
result Kernel and Multiple Kernel CCA significantly outperform regularized linear CCA in classification accuracy.
New method detects outliers in genetic and non-genetic data.
problem Identifying outliers in genetic and non-genetic data.
method Influence function of multiple kernel canonical correlation analysis.
result Visualization method effectively detects influential observations.
Paper introduces RMEN-CCA for multi-view unsupervised learning.
problem Combining multiple data views for unsupervised learning.
method Robust matrix elastic net (RMEN) integrated with canonical correlation analysis (CCA).
result RMEN-CCA outperforms state-of-the-art methods on multiple datasets.
RKUM is an R package for robust kernel-based unsupervised methods.
problem Robust analysis under contaminated or noisy data conditions.
method Robust kernel covariance and cross-covariance operators using generalized loss functions.
result RKUM reduces sensitivity to contamination and effectively identifies outliers.
Paper proposes SKCCA for sparse kernel CCA, improving sparsity and reducing overfitting.
problem Lack of sparsity in kernel CCA solutions.
method Introduces SKCCA using ℓ1-regularization to penalize the dual vectors for sparsity. result Demonstrates improved sparsity and reduced overfitting in kernel CCA.
Canonical correlation analysis (CCA) is a valuable method for interpreting cross-covariance across related datasets of different dimensionality. There are many potential applications of CCA to neuroimaging data analysis. For instance, CCA can be used for finding functional similarities across fMRI datasets collected fr…
Robust kernel CCA method detects outliers and improves performance.
problem Kernel CO and CCO sensitivity to contaminated data.
method Proposed robust kernel CO and CCO, derived IF for CCA, robust kernel CCA method.
result Robust kernel CCA method performs better than standard kernel CCA for ideal and contaminated data.
Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers to perform multiple assays on a single set of patient samples. Recent work has pr…
Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep neural network methods. These approaches seek maximally correlated projections …
Robust method detects gene-gene interactions in imaging genetics data.
problem Detecting nonlinear gene-gene interactions in imaging genetics data.
method Robust Kernel Canonical Correlation Analysis (RKCCA) with influence function variance estimation.
result The proposed robust RKCCA method outperforms state-of-the-art methods in detecting gene-gene interactions.
Robust methods for kernel CO and CCO improve unsupervised learning.
problem Sensitivity of kernel CO and CCO to contaminated data.
method Robust kernel CO and CCO based on generalized loss function, influence function, and visualization method.
result Robust kernel CCA shows superior performance over classical methods.
New similarity index avoids limitations of CCA in neural networks.
problem Limitations of existing methods in measuring neural network representation similarity.
method Introducing a similarity index based on centered kernel alignment (CKA) to measure representational similarity matrices.
result CKA reliably identifies correspondences between representations in networks trained from different initializations.
ORCCA improves CCA performance with randomized features.
problem Improving CCA performance with randomized features.
method Proposes a task-specific scoring rule for selecting random features in CCA.
result ORCCA outperforms Kernel CCA in expectation.
A novel graph-regularized CCA approach for datasets with a common source graph.
problem Discovering hidden sources in datasets with common geometry.
method Graph regularizer to encode common sources' geometry in CCA.
result Improved classification performance over competing methods.
DTCCA learns nonlinear transformations of multi-view data for high-order correlation.
problem Learning complex nonlinear transformations of multiple data views.
method Maximizes high-order canonical correlation by jointly learning transformations of each view using a reformulated tensor decomposition.
result DTCCA efficiently handles high-dimensional and large number of views, overcoming scalability issues.
Paper extends CCA for multiview learning, improving performance.
problem Learning representations across multiple data views.
method Extends CCA to a multiview mixture model with heuristics.
result Improves performance on downstream tasks compared to standard CCA.
A new method for identifying significant gene subsets improves disease prediction.
problem Identifying significant subsets of genes for disease prediction.
method Kernel gene shaving using influence function of kernel CCA.
result The proposed method outperformed three popular gene selection methods.
Quantum-inspired CCA improves correlation analysis for high-dimensional data.
problem High-dimensional data limits conventional CCA due to time complexity.
method Developed a quantum-inspired CCA (qiCCA) with logarithmic time complexity.
result qiCCA extracts more correlations than linear CCA and is comparable to deep and kernel CCA.
Paper discovers hidden common variables in nonlinear data.
problem Discover hidden common variables in nonlinear high-dimensional observations.
method Local CCA metric integrated with manifold learning.
result Metric discovers hidden common variables without rigid model assumptions.
Bayesian method improves sparse CCA for multi-view data.
problem Integrative statistical analysis of multi-view high-dimensional data.
method Bayesian infinite factor model with graphical horseshoe prior or diagonal structure to encourage sparsity.
result The proposed Bayesian ScSCCA approach achieves robust estimation of sparse CCA.
Paper proposes Adversarial CCA for multi-view alignment and generation.
problem Aligning multiple views in cross-view data analysis problems.
method Bayesian perspective, adversarial training for consistent latent encodings.
result ACCA model achieves superior performance in multi-view alignment and generation.
Two new methods for analyzing repeated measures data using embeddings into Reproducing Kernel Hilbert Spaces.
problem Analyzing complex data structures with multiple features over time.
method Two generalizations of canonical correlation analysis for repeated measures data using embeddings into Reproducing Kernel Hilbert Spaces.
result Consistency rates for transformation and correlation estimators, relaxing common assumptions.
Kernel methods detect coherent structures in dynamical data.
problem Detecting coherent structures in complex dynamical systems.
method Kernel-based dimensionality reduction techniques and eigendecompositions of RKHS operators.
result Coherent sets of particle trajectories can be computed by kernel CCA.
Canonical correlation analysis (CCA) has been one of the most popular methods for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). Despite its efficiency, a potential problem is that using pre-constructed sine-cosine waves as the required reference signals in…
We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal representation for the first view while having a dual representation for the second view…
Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…
New method finds linear relationships across multiple data blocks using proximal gradient descent with ℓ1 constraint.
problem Finding leading generalized eigenvectors for multi-block CCA.
method Proximal gradient descent with ℓ1 constraint. result Rate-optimal solution under suitable assumptions.
A new method scales CCA parameters by input to learn more correlated representations.
problem Limitation of conventional CCA models in learning highly correlated representations.
method Introduces a dynamic scaling method for training input-dependent canonical correlation models.
result Learned representations are more correlated and retrieval results are preferable.
New insights into nonlinear multiview analysis for better data interpretation.
problem Identify shared latent components across different data views.
method Post-nonlinear model and multiview mixture learning.
result Identifies shared latent components under certain conditions.
Biological neural network mimics CCA for multi-channel data.
problem Implementing CCA in a biologically plausible neural network.
method Derive an online CCA algorithm with local synaptic updates for multi-compartmental neurons.
result The derived neural network architecture and synaptic updates resemble cortical pyramidal neuron behavior.
New sparse CCA method finds interpretable associations in multi-view data.
problem Discovering interpretable associations in high-dimensional multi-view data.
method Inspired by sparse PCA, proposed a convex maximization program equivalent to non-convex sparse CCA formulation, using gradient method to reduce search space.
result Proposed two-step algorithm and new sparse CCA variants (Directed Sparse CCA, Multi-View sCCA) for multi-omic studies.
Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow since it involves implementing QR decomposition or singular value decomposition of h…
Finding relationships between multiple views of data is essential both for exploratory analysis and as pre-processing for predictive tasks. A prominent approach is to apply variants of Canonical Correlation Analysis (CCA), a classical method seeking correlated components between views. The basic CCA is restricted to ma…
New method for accurate permutation inference in CCA.
problem Inaccurate permutation inference in CCA.
method Proposed solutions for permutation inference in CCA, including transforming residuals and stepwise estimation.
result Valid permutation tests for CCA with and without nuisance variables.
This paper studies the problem of learning clusters which are consistently present in different (continuously valued) representations of observed data. Our setup differs slightly from the standard approach of (co-) clustering as we use the fact that some form of `labeling' becomes available in this setup: a cluster is …
Unified CCA methods for large-scale data with fast SGD algorithms.
problem Computational infeasibility of classical CCA methods for large-scale data.
method Unconstrained objective, stochastic gradient descent (SGD) algorithms.
result Significantly faster convergence and higher correlations than previous methods.
Proposes ℓ0-CCA for sparse CCA with improved representation learning.
problem CCA models break with too many variables, and sparsity is beneficial.
method Sparse CCA with stochastic gates and ℓ0-regularization. result Improves representation learning by gating nuisance variables.
Adversarial CCA improves representation learning by allowing more flexible priors.
problem Improving representation learning through more flexible priors.
method Adversarial techniques applied to Deep Variational CCA (VCCA and VCCA-Private).
result Adversarial CCA offers stronger and more flexible priors for representation learning.
Proposes FDR-corrected sparse CCA for neuroimaging and genomics.
problem High-dimensional datasets in neuroimaging and genomics make false discoveries a concern.
method FDR-corrected sparse canonical correlation analysis (CCA) for high-dimensional settings.
result The proposed method controls the FDR of canonical vectors in high-dimensional settings.
End-to-end CCA optimizes both discriminative and latent space projections for multi-view learning.
problem Lack of class label information in CCA for multi-view learning tasks.
method Simultaneously optimizes a CCA-based and a task objective in an end-to-end manner to learn a non-linear CCA projection.
result Significant improvement in cross-view classification, regularization with a second view, and semi-supervised learning.
Unsupervised two-view learning, or detection of dependencies between two paired data sets, is typically done by some variant of canonical correlation analysis (CCA). CCA searches for a linear projection for each view, such that the correlations between the projections are maximized. The solution is invariant to any lin…
For multiple multivariate data sets, we derive conditions under which Generalized Canonical Correlation Analysis (GCCA) improves classification performance of the projected datasets, compared to standard Canonical Correlation Analysis (CCA) using only two data sets. We illustrate our theoretical results with simulation…
Proposes a probabilistic CCA with implicit distributions for multi-view data.
problem Overcoming the deficiency of linear correlation in practical multi-view learning tasks.
method Probabilistic interpretation of CCA based on implicit distributions, using Conditional Mutual Information (CMI) and Adversarial CCA (ACCA).
result Achieves superior alignment of multi-view data with implicit distributions.
DGCCA learns nonlinear transformations for multiple data views.
problem Learning informative nonlinear transformations from multiple data views.
method Deep Generalized Canonical Correlation Analysis (DGCCA) combines deep learning and generalized CCA.
result DGCCA representations outperform existing methods in phonetic transcription and hashtag recommendation.
Paper tackles fairness in CCA by minimizing correlation disparity error.
problem Fairness issues in CCA.
method Framework to minimize correlation disparity error in CCA.
result Reduces correlation disparity error without sacrificing CCA accuracy.
Proposes a deep probabilistic multi-view model for multi-view learning.
problem Learning from multiple related views with shared latent structure.
method Probabilistic Canonical Correlation Analysis (CCA) in latent space, deep generative networks, variational inference.
result Efficient variational inference approximates posterior distributions of latent multi-view layer.
New measures link neural representation geometry to decoding ability.
problem Understanding how neural representations relate to decoding ability.
method Showed that popular similarity measures can be interpreted from a decoding perspective.
result Proved that measures like CKA and CCA quantify alignment between optimal linear readouts.
This paper presents Correlated Nystrom Views (XNV), a fast semi-supervised algorithm for regression and classification. The algorithm draws on two main ideas. First, it generates two views consisting of computationally inexpensive random features. Second, XNV applies multiview regression using Canonical Correlation Ana…