arXiv research

Looped transformers with LN converge to power method for principal component prediction.

New method optimizes PCA for better prediction and variance.

Improves model predictability by mixing forecasts and orthogonalizing models.

The literature provides strong evidence that stock prices can be predicted from past price data. Principal component analysis (PCA) is a widely used mathematical technique for dimensionality reduction and analysis of data by identifying a small number of principal components to explain the variation found in a data set…

CPCR mitigates bias in PCR for overparameterized models.

The paper uses PCA and HMM to forecast stock returns outperforming buy-and-hold.

Principal Components Regression (PCR) is a traditional tool for dimension reduction in linear regression that has been both criticized and defended. One concern about PCR is that obtaining the leading principal components tends to be computationally demanding for large data sets. While random projections do not possess…

We identify and validate a model for PCR in high dimensions, improving prediction guarantees.

VC-PCR improves prediction by clustering correlated variables.

We propose a new two stage algorithm LING for large scale regression problems. LING has the same risk as the well known Ridge Regression under the fixed design setting and can be computed much faster. Our experiments have shown that LING performs well in terms of both prediction accuracy and computational efficiency co…

With the development of high-throughput technologies, principal component analysis (PCA) in the high-dimensional regime is of great interest. Most of the existing theoretical and methodological results for high-dimensional PCA are based on the spiked population model in which all the population eigenvalues are equal ex…

New simulations advise caution in choosing principal components for multivariate functional data.

Principal component regression (PCR) is a two-stage procedure that selects some principal components and then constructs a regression model regarding them as new explanatory variables. Note that the principal components are obtained from only explanatory variables and not considered with the response variable. To addre…

Meta-learning improves support recovery in high-dimensional PCA.

Stochastic principal component analysis (SPCA) has become a popular dimensionality reduction strategy for large, high-dimensional datasets. We derive a simplified algorithm, called Lazy SPCA, which has reduced computational complexity and is better suited for large-scale distributed computation. We prove that SPCA and …

The paper introduces a method for interpretable principal component analysis of high-dimensional time series.

PCHAL and PCHAR use principal components to speed up HAL and HAR methods.

Efficient private matrix analysis algorithms for recent variants.

SPPCSO addresses multicollinearity in high-dimensional data, improving model stability and predictive accuracy.

Conventional principal component analysis (PCA) finds a principal vector that maximizes the sum of second powers of principal components. We consider a generalized PCA that aims at maximizing the sum of an arbitrary convex function of principal components. We present a gradient ascent algorithm to solve the problem. Fo…

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first $K$ principal components minimizes the sum of squared errors between the original …

We show how to efficiently project a vector onto the top principal components of a matrix, without explicitly computing these components. Specifically, we introduce an iterative algorithm that provably computes the projection using few calls to any black-box routine for ridge regression. By avoiding explicit principal …

A new PCR method using SVD with sparse regularization.

A new method improves target selection for manipulating complex systems like the brain.

Essential principal components simplify spectral analysis with minimal training data.

Study on reducing dimensionality in high-dimensional regression with kernel methods and stability analysis.

New algorithm balances spatial data approximation and prediction accuracy.

Enhances functional classifier performance with new tree-based methods and unbiased feature importance assessment.

Improved fMRI analysis models enhance classification performance and select relevant brain regions.

Principal component regression (PCR) is a widely used two-stage procedure: principal component analysis (PCA), followed by regression in which the selected principal components are regarded as new explanatory variables in the model. Note that PCA is based only on the explanatory variables, so the principal components a…

QAPCA uses quantum annealing for robust PCA.

Gradient descent recovers principal components of overparametrized asymmetric matrices without explicit regularization.

We study least squares linear regression over $N$ uncorrelated Gaussian features that are selected in order of decreasing variance. When the number of selected features $p$ is at most the sample size $n$, the estimator under consideration coincides with the principal component regression estimator; when $p>n$, the esti…

New supervised and unsupervised NFLTs for elliptical distributions.

This study analyzes prediction risk for PCR method in latent factor regression models.

Two new PCA variants improve financial data analysis.

This paper analyses the Chinese Sovereign bond yield to find out the principal factors affecting the term structure of interest rate changes. We apply Principal Component Analysis (PCA) on our data consisting of the Chinese Sovereign bond from January 2002 till May 2018 with the different yield to maturity. Then we wil…

This paper analyzes how errors accumulate in PCA's deflation method.

Paper presents a faster classical algorithm for principal component regression.

We study sparse principal component analysis for high dimensional vector autoregressive time series under a doubly asymptotic framework, which allows the dimension $d$ to scale with the series length $T$. We treat the transition matrix of time series as a nuisance parameter and directly apply sparse principal component…

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian samples and/or outliers often makes it unreliable in practice. To this end, a robust…

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem ${\mathcal{NP}}$-hard. In this work, we prove that, if the matrix is positive semidefinite and its …

The dynamic nature of air quality chemistry and transport makes it difficult to identify the mixture of air pollutants for a region. In this study of air quality in the Houston metropolitan area we apply dynamic principal component analysis (DPCA) to a normalized multivariate time series of daily concentration measurem…

We employ unsupervised machine learning techniques to learn latent parameters which best describe states of the two-dimensional Ising model and the three-dimensional XY model. These methods range from principal component analysis to artificial neural network based variational autoencoders. The states are sampled using …

In the multiple linear regression setting, we propose a general framework, termed weighted orthogonal components regression (WOCR), which encompasses many known methods as special cases, including ridge regression and principal components regression. WOCR makes use of the monotonicity inherent in orthogonal components …

In this dissertation, the main goal is visualisation of financial time series. We expect that visualisation of financial time series will be a useful auxiliary for technical analysis. Firstly, we review the technical analysis methods and test our trading rules, which are built by the essential concepts of technical ana…

A method predicts posterior PCs for faster uncertainty quantification in imaging.

Study explores K-means clustering of variables and its relation to PCA.