ORCCA improves CCA performance with randomized features.
problem Improving CCA performance with randomized features.
method Proposes a task-specific scoring rule for selecting random features in CCA.
result ORCCA outperforms Kernel CCA in expectation.
Tutorial explains various canonical correlation methods.
problem Analyzing paired sets of variables.
method Regularized, kernel, sparse, and Bayesian CCA.
result Comprehensive overview of canonical correlation methods.
Two new methods for analyzing repeated measures data using embeddings into Reproducing Kernel Hilbert Spaces.
problem Analyzing complex data structures with multiple features over time.
method Two generalizations of canonical correlation analysis for repeated measures data using embeddings into Reproducing Kernel Hilbert Spaces.
result Consistency rates for transformation and correlation estimators, relaxing common assumptions.
Kernel and MKCCA classify schizophrenia patients from imaging and genetic data.
problem Classifying schizophrenia patients from imaging and genetic data.
method Employed Kernel and Multiple Kernel Canonical Correlation Analysis (CCA) for classification.
result Kernel and Multiple Kernel CCA significantly outperform regularized linear CCA in classification accuracy.
Robust kernel CCA method detects outliers and improves performance.
problem Kernel CO and CCO sensitivity to contaminated data.
method Proposed robust kernel CO and CCO, derived IF for CCA, robust kernel CCA method.
result Robust kernel CCA method performs better than standard kernel CCA for ideal and contaminated data.
Paper proposes SKCCA for sparse kernel CCA, improving sparsity and reducing overfitting.
problem Lack of sparsity in kernel CCA solutions.
method Introduces SKCCA using ℓ1-regularization to penalize the dual vectors for sparsity. result Demonstrates improved sparsity and reduced overfitting in kernel CCA.
We study the problem of column selection in large-scale kernel canonical correlation analysis (KCCA) using the Nyström approximation, where one approximates two positive semi-definite kernel matrices using "landmark" points from the training set. When building low-rank kernel approximations in KCCA, previous work mostl…
A faster alternative to ICA methods using randomized features.
problem Efficiently recovering statistically independent signals from observations.
method Randomized Generalized Variance and Randomized Canonical Correlation.
result Optimization of randomized measures yields comparable separation error at a much faster rate.
A novel graph-regularized CCA approach for datasets with a common source graph.
problem Discovering hidden sources in datasets with common geometry.
method Graph regularizer to encode common sources' geometry in CCA.
result Improved classification performance over competing methods.
Imaging genetic research has essentially focused on discovering unique and co-association effects, but typically ignoring to identify outliers or atypical objects in genetic as well as non-genetics variables. Identifying significant outliers is an essential and challenging issue for imaging genetics and multiple source…
In genome-wide interaction studies, to detect gene-gene interactions, most methods are divided into two folds: single nucleotide polymorphisms (SNP) based and gene-based methods. Basically, the methods based on the gene are more effective than the methods based on a single SNP. Recent years, while the kernel canonical …
Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, including kernel and deep neural network methods. These approaches seek maximally correlated projections …
Paper introduces RMEN-CCA for multi-view unsupervised learning.
problem Combining multiple data views for unsupervised learning.
method Robust matrix elastic net (RMEN) integrated with canonical correlation analysis (CCA).
result RMEN-CCA outperforms state-of-the-art methods on multiple datasets.
Quantum-inspired CCA improves correlation analysis for high-dimensional data.
problem High-dimensional data limits conventional CCA due to time complexity.
method Developed a quantum-inspired CCA (qiCCA) with logarithmic time complexity.
result qiCCA extracts more correlations than linear CCA and is comparable to deep and kernel CCA.
DTCCA learns nonlinear transformations of multi-view data for high-order correlation.
problem Learning complex nonlinear transformations of multiple data views.
method Maximizes high-order canonical correlation by jointly learning transformations of each view using a reformulated tensor decomposition.
result DTCCA efficiently handles high-dimensional and large number of views, overcoming scalability issues.
We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal representation for the first view while having a dual representation for the second view…
Sparse CCA improves classical CCA for high-dimensional data.
problem High-dimensional data limits classical CCA's effectiveness.
method Sparse CCA with l1 constraints and ADMM for efficient solution.
result Efficiently solved sparse CCA using ADMM and TFOCS.
Canonical correlation analysis (CCA) is a valuable method for interpreting cross-covariance across related datasets of different dimensionality. There are many potential applications of CCA to neuroimaging data analysis. For instance, CCA can be used for finding functional similarities across fMRI datasets collected fr…
In this paper, we address the problem of hidden common variables discovery from multimodal data sets of nonlinear high-dimensional observations. We present a metric based on local applications of canonical correlation analysis (CCA) and incorporate it in a kernel-based manifold learning technique.We show that this metr…
New similarity index avoids limitations of CCA in neural networks.
problem Limitations of existing methods in measuring neural network representation similarity.
method Introducing a similarity index based on centered kernel alignment (CKA) to measure representational similarity matrices.
result CKA reliably identifies correspondences between representations in networks trained from different initializations.
Graph Canonical Correlation Analysis improves CCA for multiomics datasets.
problem Limited ability of conventional CCA methods to incorporate structured patterns in cross-correlation matrices.
method Graph Canonical Correlation Analysis (gCCA) calculates canonical correlations based on the graph structure of cross-correlation matrices.
result gCCA outperforms competing CCA methods in simulations and multiomics dataset analysis.
Proposes ACCA for better alignment of multiple data perspectives.
problem Unclear alignment between multiple data perspectives.
method Iteratively solves alignment and multi-view embedding.
result Improved alignment and embedding of multiple data perspectives.
For multiple multivariate data sets, we derive conditions under which Generalized Canonical Correlation Analysis (GCCA) improves classification performance of the projected datasets, compared to standard Canonical Correlation Analysis (CCA) using only two data sets. We illustrate our theoretical results with simulation…
A hybrid approach links fMRI data to deep features for visual category decoding.
problem Lack of practical fMRI decoder with CNN structure due to limited brain data.
method Kernel Canonical Correlation Analysis linking fMRI and deep learnt representations.
result Effective in distinguishing semantic visual categories using only brain imaging data.
CorrCA identifies reliable dimensions in multivariate data across repetitions.
problem Finding consistent dimensions in multivariate data across trials, subjects, or raters.
method Maximizes the ratio of between-repetition to within-repetition covariance.
result CorrCA leads to repeat-reliability maximization and is equivalent to Linear Discriminant Analysis for zero-mean signals.
SWCCA identifies specific subsets of samples for better correlation analysis.
problem Identify specific subsets of samples contributing to correlation between two data matrices.
method Proposes SWCCA with weights to regularize different samples, solves using alternating iterative algorithm.
result Demonstrates effectiveness and superiority over related methods on synthetic and real-world data.
New method for analyzing multiple longitudinal data processes.
problem Exploring associations between multiple random processes observed jointly.
method Functional Generalized Canonical Correlation Analysis (FGCCA) based on multiblock Regularized Generalized Canonical Correlation Analysis (RGCCA).
result FGCCA framework is robust to sparsely and irregularly observed data.
Proposes PSCCA for estimating correlations and canonical correlations in sparse count data.
problem Estimating correlations and canonical correlations in sparse count data from next-generation sequencing.
method Probabilistic approach for sparse count data sets (PSCCA).
result PSCCA outperforms other methods in estimating true correlations and canonical correlations at the natural parameter level.
A new method estimates conditional canonical correlations using random forests.
problem Estimating relationships between two sets of variables given covariates.
method Random Forest with Canonical Correlation Analysis (RFCCA)
result RFCCA provides accurate canonical correlation estimations and well-controlled Type-1 error.
A new method for real-time CCA on streaming data.
problem Finding correlated features in online data streams.
method Sliding Window Informative Canonical Correlation Analysis (SWICCA) using streaming PCA.
result SWICCA provides real-time CCA components in high dimensions with theoretical guarantees.
Bayesian model merges multi-view latent models and kernel methods.
problem Handling high-dimensionality and non-linear issues in multi-view data.
method Combines probabilistic factor analysis with kernelized observations.
result Compact solutions for kernelized observations and feature selection.
RKUM is an R package for robust kernel-based unsupervised methods.
problem Robust analysis under contaminated or noisy data conditions.
method Robust kernel covariance and cross-covariance operators using generalized loss functions.
result RKUM reduces sensitivity to contamination and effectively identifies outliers.
D2PCCA integrates deep learning and probabilistic modeling for nonlinear dynamical systems.
problem Analyzing nonlinear dynamical systems with probabilistic understanding.
method Combines deep learning and probabilistic modeling, using KL annealing and normalizing flows.
result Captures latent dynamics in sequential datasets with improved convergence and flexibility.
Deep LSTMs learn correlated representations of time-series data.
problem Learning nonlinear transformations and correlated embeddings of variable-length sequences.
method Use LSTMs to transform multi-view time-series data, then correlate outputs to find a fixed-dimensional representation.
result Deep LSTMs can effectively learn and project correlated representations of time-series data.
We introduce the blind subspace deconvolution (BSSD) problem, which is the extension of both the blind source deconvolution (BSD) and the independent subspace analysis (ISA) tasks. We examine the case of the undercomplete BSSD (uBSSD). Applying temporal concatenation we reduce this problem to ISA. The associated `high …
New measures link neural representation geometry to decoding ability.
problem Understanding how neural representations relate to decoding ability.
method Showed that popular similarity measures can be interpreted from a decoding perspective.
result Proved that measures like CKA and CCA quantify alignment between optimal linear readouts.
Canonical Correlation Analysis (CCA) is a classical tool for finding correlations among the components of two random vectors. In recent years, CCA has been widely applied to the analysis of genomic data, where it is common for researchers to perform multiple assays on a single set of patient samples. Recent work has pr…
Proposes ℓ0-CCA for sparse CCA with improved representation learning.
problem CCA models break with too many variables, and sparsity is beneficial.
method Sparse CCA with stochastic gates and ℓ0-regularization. result Improves representation learning by gating nuisance variables.
Algorithm improves online canonical correlation analysis.
problem Online canonical correlation analysis.
method Stochastic Scaled-Gradient Descent (SSGD) for minimizing expectation over Riemannian manifolds.
result Achieved optimal one-time-scale algorithm with explicit rate of local asymptotic convergence.
A new method scales CCA parameters by input to learn more correlated representations.
problem Limitation of conventional CCA models in learning highly correlated representations.
method Introduces a dynamic scaling method for training input-dependent canonical correlation models.
result Learned representations are more correlated and retrieval results are preferable.
Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…
New algorithms improve CCA with stochastic approximation.
problem Efficiently compute canonical correlation analysis.
method Inexact MSG and MEG algorithms for CCA.
result Achieves ε-suboptimality in poly(1/ε) iterations.
A new model for multiview data analysis using graph autoencoders.
problem Nonlinear multiview canonical correlation analysis for large datasets.
method Variational approach with graph convolutional neural networks.
result Competitive performance on classification, clustering, and recommendation tasks.
CCA features from medical codes predict future surgeries.
problem Predicting future surgeries based on medical codes.
method Canonical correlation analysis applied to sequences of medical codes.
result CCA embeddings capture meaningful relationships among medical codes.
Paper proposes ICCN to learn correlations between text, audio, and video for multimodal sentiment analysis.
problem Improving multimodal sentiment analysis by learning hidden correlations between text and audio/video features.
method Interaction Canonical Correlation Network (ICCN) using deep canonical correlation analysis (DCCA).
result Empirical results confirm the effectiveness of ICCN in capturing useful information from all three views.
MPPCCA extracts multiple causal relationships from multivariate time series.
problem Extracting multiple causal relationships from multivariate time series data.
method Mixture of probabilistic partial canonical correlation analysis (MPPCCA) combined with an expectation-maximization (EM) algorithm.
result MPPCCA accurately estimates multiple partial canonical correlations in synthetic and real datasets.
This paper provides an overview of CCA-based multi-view learning approaches.
problem Fusing data from different sources or subsets.
method Canonical correlation analysis (CCA) for mapping data onto a common space with maximum correlation.
result Overview of many representative CCA-based multi-view learning approaches.
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
problem Handling higher-order structures in multi-block data analysis.
method Tensor Generalized Canonical Correlation Analysis (TGCCA) with orthogonal rank-R CP decomposition.
result TGCCA outperforms state-of-the-art methods on simulated and real data.