Explains various PCA and SPCA methods with theory and applications.
problem No specific problem stated; focuses on explaining methods.
method Explains PCA, SPCA, kernel PCA, and kernel SPCA methods with theory and applications.
result Comprehensive coverage of PCA and SPCA methods with theory and applications.
The paper compares PCA and PP for scRNA sequencing data.
problem Limitations of PCA in scRNA sequencing data.
method Applied PCA and PP (using negative Shannon's entropy) on scRNA sequencing data.
result PP outperforms PCA in scRNA sequencing data.
Principal component analysis (PCA) is an unsupervised method for learning low-dimensional features with orthogonal projections. Multilinear PCA methods extend PCA to deal with multidimensional data (tensors) directly via tensor-to-tensor projection or tensor-to-vector projection (TVP). However, under the TVP setting, i…
PCA minor projection is most sensitive to distributional changes in bivariate data.
problem Detecting sparse distributional changes in high-dimensional data.
method Proved that the minor projection of PCA-rotated data is most sensitive to distributional changes defined by Hellinger distance.
result The minor projection is the most sensitive to sparse distributional changes in high-dimensional data.
One technique to visualize the training of neural networks is to perform PCA on the parameters over the course of training and to project to the subspace spanned by the first few PCA components. In this paper we compare this technique to the PCA of a high dimensional random walk. We compute the eigenvalues and eigenvec…
PCA outperforms random projections in retaining second order signals from latent groups.
problem Preserving second order structure in latent groups under unsupervised linear projections.
method Theoretical framework and quasi-exhaustive enumeration of projections.
result PCA outperforms random projections in retaining second order signals across a broad range of data-generating parameters.
A new method detects sparse changes in high-dimensional data streams using tailored PCA projections.
problem Detecting sparse changes in high-dimensional data streams.
method Tailored PCA projections for online change detection.
result High efficiency in detecting even very sparse changes in mean, variance, and correlation.
EB-PCA reduces noise in high-dimensional PCA by estimating a joint prior distribution.
problem High-dimensional PCA noise in samples comparable to or larger than data.
method Empirical Bayes PCA using Kiefer-Wolfowitz MLE, random matrix theory, and AMP algorithm.
result EB-PCA achieves Bayes-optimal accuracy in spiked models and significantly improves over PCA in simulations and real data.
Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first K principal components minimizes the sum of squared errors between the original …
Principal component analysis (PCA) for binary data, known as logistic PCA, has become a popular alternative to dimensionality reduction of binary data. It is motivated as an extension of ordinary PCA by means of a matrix factorization, akin to the singular value decomposition, that maximizes the Bernoulli log-likelihoo…
KAN-PCA improves asset return analysis by capturing more variance than classical PCA during market crises.
problem Inefficient classical PCA during market crises when correlations between assets change dramatically.
method KAN-PCA uses KAN (Kolmogorov-Arnold Networks) with B-spline functions to learn nonlinear projections.
result KAN-PCA achieves a higher reconstruction R^2 (66.57%) compared to classical PCA (62.99%) on 20 S&P 500 stocks.
We develop efficient algorithms for robust PCA that handle outliers.
problem Finding principal components in datasets with outliers.
method Nearly-linear time and streaming algorithms for robust PCA.
result Near-optimal error guarantees for robust PCA with nearly-linear time and memory usage.
Principal Component Analysis (PCA) has wide applications in machine learning, text mining and computer vision. Classical PCA based on a Gaussian noise model is fragile to noise of large magnitude. Laplace noise assumption based PCA methods cannot deal with dense noise effectively. In this paper, we propose Cauchy Princ…
A fast method for sparse PCA reduces computation time.
problem Time-consuming implementation of SPCA on high-dimensional data.
method Subspace projections using Household QR factorization for efficient deflation.
result Developed SPCA-SP method maintains good tradeoffs between various criteria.
Principal component analysis (PCA) is a popular method for projecting data onto uncorrelated components in lower dimension, although the optimal number of components is not specified. Likewise, multiple signal classification (MUSIC) algorithm is a popular PCA-based method for estimating directions of arrival (DOAs) of …
It is well known that Principal Component Analysis (PCA) is strongly affected by outliers and a lot of effort has been put into robustification of PCA. In this paper we present a new algorithm for robust PCA minimizing the trimmed reconstruction error. By directly minimizing over the Stiefel manifold, we avoid deflatio…
Develops PRPCA for smooth image recovery combining low-rank and smoothness.
problem Image matrix recovery under low-rank and smoothness assumptions.
method Projected Robust PCA (PRPCA) framework combining low-rank and smoothness.
result Explicit statistical guarantees for PRPCA, reducing matrix dimensionality.
Paper studies statistical manifolds with logarithmic divergences.
problem Understanding statistical manifolds induced by logarithmic divergences.
method Constructs dual foliation of the statistical manifold.
result Extends dual foliation of a dually flat manifold.
Paper proposes estimators for sparse PCA with oracle property.
problem Estimating sparse principal subspace in high-dimensional settings.
method Semidefinite relaxation with novel regularizations.
result One estimator achieves exact support recovery and statistical rate.
PCA++ improves robustness to background noise in contrastive learning.
problem Recovering shared signal subspaces from positive pairs in high-dimensional data with structured background noise.
method PCA++ uses hard uniformity-constrained contrastive learning to enforce identity covariance on projected features.
result PCA++ outperforms standard PCA and alignment-only PCA+ in simulations and real-world datasets.
New method SP-PPCA reduces outlier impact in PCA.
problem Outliers make standard PCA and PPCA less robust.
method Integrates self-paced learning into PPCA, using iterative optimization.
result SP-PPCA effectively reduces or eliminates outlier impact.
New fair PCA method using streaming algorithms with statistical guarantees.
problem Perform PCA while ensuring fair projected distributions.
method Formulated new notion PAFO learnability, proposed fair noisy power method (FNPM) for memory efficiency.
result First statistical guarantee for fair PCA in streaming setting.
New statistical methods for analyzing distributions using Wasserstein metric.
problem Statistical analysis of probability distributions on the real line.
method Projected methods exploiting Wasserstein metric and Riemannian structure.
result Projected PCA and regression methods are faster and more flexible.
SDSPCAAN combines supervised and local data structures for better dimensionality reduction.
problem Preserving both global and local data structures for noisy high-dimensional data.
method Supervised discriminative sparse PCA with adaptive neighbors (SDSPCAAN).
result SDSPCAAN improves classification accuracy on high-dimensional datasets.
PCA-based dimensionality reduction improves robustness in overparameterized linear models.
problem Improving robustness in overparameterized linear models.
method PCA-based dimensionality reduction (PCA-OLS)
result PCA-OLS can achieve better generalization than ordinary least squares (OLS) in the overparameterized regime.
Performance of nuclear threat detection systems based on gamma-ray spectrometry often strongly depends on the ability to identify the part of measured signal that can be attributed to background radiation. We have successfully applied a method based on Principal Component Analysis (PCA) to obtain a compact null-space m…
Proposes MPCA for robust PCA using mode estimation.
problem Outliers sensitivity in PCA.
method Modal Principal Component Analysis (MPCA) based on mode estimation.
result MPCA shows advantages over conventional methods.
New method for decomposing high-dimensional parametric domains using PCA and inverse projection.
problem Decomposing high-dimensional parametric domains efficiently.
method Iterative Principal Component Analysis (PCA) and inverse projection methods.
result The proposed method effectively reconstructs the original domain from lower-dimensional data.
RieCUR improves Robust PCA by combining Riemannian optimization and CUR decompositions.
problem Robust Principal Component Analysis (PCA) to recover low-rank and sparse matrices from their sum.
method Riemannian CUR (RieCUR) algorithm that combines Riemannian optimization and robust CUR decompositions.
result RieCUR achieves state-of-the-art performance in Robust PCA with improved robustness to outliers and comparable computational complexity.
Following widely used in visual recognition concept of relative attributes, the article establishes definition of the relative PCA attributes for a class of objects defined by vectors of their parameters. A new rating model (RELARM) is built using relative PCA attribute ranking functions for rating object description a…
Efficient algorithm for sparse PCA reduces data complexity.
problem Sparse PCA for high-dimensional data with non-convex optimization issues.
method Convex FPS formulation, gradient-based optimization, online learning extension.
result Explicit bounds on optimization error and statistical accuracy.
This work improves PCA for robustness against adversarial perturbations.
problem Vulnerability of machine learning systems to small perturbations.
method Formulated and optimized a robust variant of PCA.
result Polynomial time algorithm that is competitive in worst-case robustness.
We propose a new method for robust PCA -- the task of recovering a low-rank matrix from sparse corruptions that are of unknown value and support. Our method involves alternating between projecting appropriate residuals onto the set of low-rank matrices, and the set of sparse matrices; each projection is {\em non-convex…
We show how to efficiently project a vector onto the top principal components of a matrix, without explicitly computing these components. Specifically, we introduce an iterative algorithm that provably computes the projection using few calls to any black-box routine for ridge regression. By avoiding explicit principal …
Algorithm reduces high-dimensional SLB regret by exploiting hidden low-rank structure.
problem High-dimensional stochastic linear bandits with hidden low-rank structure.
method Projective Stochastic Linear Bandit (PSLB) using PCA projection.
result PSLB achieves tighter regret bound and faster convergence.
A new PMA method combines PCA and PLS for better classification.
problem Improving classification performance in data analysis.
method Combines PCA and PLS through multiple sub-PLS models and PCA on the joint coefficient matrix.
result The proposed PMA method achieves better classification performance and stability.
Auto-Associative models cover a large class of methods used in data analysis. In this paper, we describe the generals properties of these models when the projection component is linear and we propose and test an easy to implement Probabilistic Semi-Linear Auto- Associative model in a Gaussian setting. We show it is a g…
Proposes a new PCA method that balances Euclidean and angle distances.
problem PCA's loss minimization often uses Euclidean distance, but angle distance is more critical in some fields.
method Introduces a method with constraints to unify Euclidean and angle distances, solving the nonconvex optimization problem with an alternating linearized minimization approach.
result Demonstrates the effectiveness and advantages of the new method over state-of-the-art clustering methods on synthetic and real-world datasets.
In this paper we analyze approximate methods for undertaking a principal components analysis (PCA) on large data sets. PCA is a classical dimension reduction method that involves the projection of the data onto the subspace spanned by the leading eigenvectors of the covariance matrix. This projection can be used either…
Many modern datasets can be represented as graphs and hence spectral decompositions such as graph principal component analysis (PCA) can be useful. Distinct from previous graph decomposition approaches based on subspace projection of a single topological feature, e.g., the Fiedler vector of centered graph adjacency mat…
Fast algorithm recovers principal eigenvector from noisy matrices.
problem Recovering the first principal eigenvector from noisy positive semidefinite matrices.
method Cone projected power iteration algorithm.
result Achieves polynomial time complexity and small error for certain convex cones.
PCA adapted for curved spaces improves data analysis.
problem PCA's limitations in curved spaces.
method Space Form PCA (SFPCA) for Riemannian manifolds.
result SFPCA provides faster and more accurate subspaces estimation.
New implicit Krasulina's k-PCA update avoids QR-decomposition and improves convergence.
problem Online k-PCA problem with orthonormality constraint.
method Derived an implicit form of Krasulina's update that bypasses orthonormality constraint.
result The new update avoids costly QR-decomposition and yields superior convergence.
Uncertainty-aware PCA preserves data uncertainty during dimensionality reduction.
problem Uncertainty in data affects traditional PCA methods, leading to inaccurate results.
method Generalizes PCA for multivariate probability distributions, respecting uncertainty.
result Uncertainty-aware PCA maintains data characteristics after projection.
Improved PCA accuracy using maximum entropy method.
problem Accuracy issues in classical PCA.
method Model uncertainty with random variables, apply Maximum Entropy Method.
result Improved estimates of distances between data items.
The presence of a sparse "truth" has been a constant assumption in the theoretical analysis of sparse PCA and is often implicit in its methodological development. This naturally raises questions about the properties of sparse PCA methods and how they depend on the assumption of sparsity. Under what conditions can the r…
For many years, a combination of principal component analysis (PCA) and independent component analysis (ICA) has been used for blind source separation (BSS). However, it remains unclear why these linear methods work well with real-world data that involve nonlinear source mixtures. This work theoretically validates that…
Adaptive probabilistic PCA adapts complexity with varying subspaces.
problem Adaptive probabilistic PCA models varying complexity in data.
method Relaxed linear Gaussian model with discrete latent variables, Bayesian nonparametric approach.
result Proposes locally adaptive probabilistic PCA (A-PPCA) for varying subspaces.