QAPCA uses quantum annealing for robust PCA.
problem Outliers in data skew L2-norm principal components.
method Quantum annealing for L1-norm optimization.
result QAPCA's reconstruction error is comparable to L1-BF.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Optimal Components”
Multi-Rank Sparse and Functional PCA: Manifold Optimization and Iterative Deflation Techniquesstat.ML
Improved estimation of multiple principal components using manifold optimization and iterative deflation techniques.
problem Estimating multiple principal components efficiently and orthogonally.
method Extended SFPCA using manifold optimization and iterative deflation techniques.
result Alternative deflation schemes improve signal extraction and component estimation.
The paper improves RPCA for separating sparse and manifold components on noisy data.
problem Separating sparse and manifold components from noisy data.
method Nonlinear Robust Principal Component Analysis (RPCA) framework.
result The method successfully separates sparse and manifold components under noisy data.
Optimizes chip component placement with self-alignment for SMT technology.
problem Achieving precise component placement on PCB during SMT process.
method Proposed machine learning algorithms (SVR and RFR) to predict component positions and developed non-linear optimization model.
result RFR model outperforms in predicting component positions before reflow.
Differentiable pipeline replaces non-differentiable CAE components for shape optimization.
problem Gradient-based optimization is limited by non-differentiable components in CAE workflows.
method Surrogate models replace non-differentiable pipeline components, enabling gradient-based optimization.
result Gradient-based shape optimization possible without differentiable solvers.
Reinforcement learning is widely used for dialogue policy optimization where the reward function often consists of more than one component, e.g., the dialogue success and the dialogue length. In this work, we propose a structured method for finding a good balance between these components by searching for the optimal re…
Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model identifiability. Linear non-Gaussian component analysis (LNGCA) generalizes the ICA model t…
We consider in this paper a class of composite optimization problems whose objective function is given by the summation of a general smooth and nonsmooth component, together with a relatively simple nonsmooth term. We present a new class of first-order methods, namely the gradient sliding algorithms, which can skip the…
Paper optimizes prediction in semi-functional linear models using kernel methods.
problem Optimizing prediction in semi-functional linear models with functional and nonparametric components.
method Double-penalized least squares method in reproducing kernel Hilbert spaces, with regularization parameter selection via generalized cross validation.
result Achieves minimax optimal rates of convergence for both functional and nonparametric components.
A new algorithm screens negligible components to efficiently approximate optimal transport distances.
problem Efficiently approximating the Sinkhorn distance between discrete measures.
method Screening of negligible components in the dual solution of the regularized Sinkhorn problem.
result Screenkhorn algorithm provides provable guarantees with smaller computational complexity.
Model-free RL solves financial portfolio optimization without knowing component dynamics.
problem Optimizing financial portfolios without knowing specific component dynamics.
method Reformulate portfolio optimization as a MDP and solve using model-free RL.
result Model-free RL can solve portfolio optimization problems.
A memory-based method to select the number of relevant components in Principal Component Analysisq-fin.ST
A new method selects PCA components based on residual memory, outperforming existing techniques.
problem Selecting the optimal number of components in PCA for data with long memory effects.
method Sequentially removes components, stopping when maximum memory accounted for.
result Our method outperforms existing techniques in computational efficiency and accuracy.
Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theoretical interests. Despite its rich applications, theoretical convergence analysis remains largely ope…
UBVI improves variational inference by preventing degeneracy and improving scalability.
problem Degeneracy and scalability issues in variational inference.
method Exploits Hellinger metric geometry to prevent degeneracy, simplifies weight optimization, and uses scalable exponential family mixture components.
result Output of UBVI converges to best possible approximation in any mixture family, even when misspecified.
We apply both distance-based (Jin and Matteson, 2017) and kernel-based (Pfister et al., 2016) mutual dependence measures to independent component analysis (ICA), and generalize dCovICA (Matteson and Tsay, 2017) to MDMICA, minimizing empirical dependence measures as an objective function in both deflation and parallel m…
Paper optimizes tensor deflation for non-orthogonal signals.
problem Recovering low-rank signals from noisy tensors with correlated components.
method Developed an asymptotic analysis and optimized deflation procedure using random tensor theory.
result Proposed an efficient tensor deflation algorithm that optimizes a parameter introduced in the deflation mechanism.
We perform a finite sample analysis of the detection levels for sparse principal components of a high-dimensional covariance matrix. Our minimax optimal test is based on a sparse eigenvalue statistic. Alas, computing this test is known to be NP-complete in general, and we describe a computationally efficient alternativ…
OT-ICA uses optimal transport to find independent components, outperforming traditional methods.
problem Finding independent components from linear mixtures of signals.
method OT-ICA uses the squared Wasserstein distance to maximize non-Gaussianity, optimizing projections via gradient descent.
result OT-ICA outperforms traditional proxy-based methods in various applications.
We propose a fair principal component analysis method that balances reconstruction error and subgroup fairness.
problem Fairness and robustness in principal component analysis for consequential domains.
method Distributionally robust optimization over the Stiefel manifold with a Riemannian subgradient descent.
result The proposed method achieves better performance on real-world datasets compared to state-of-the-art baselines.
Optimal SGD rates achieved with shuffling, covering non-convex and convex cases.
problem Optimizing finite-sum optimization problems with shuffling strategies.
method RandomShuffle and SingleShuffle algorithms for SGD, analyzing convergence rates.
result Minimax optimal convergence rates established, generalizing to non-convex costs.
This study improves estimation of the first principal component in multivariate functional data.
problem Estimating the first principal component of multivariate random processes.
method Defined covariance functions and operators, introduced LASSO optimization, and established minimax lower bounds.
result The method provides an optimal variance in the minimax sense for estimating eigenelements.
Regularized LAEs learn principal components efficiently.
problem Learning optimal linear representations with LAEs.
method Proper regularization schemes (non-uniform ℓ2 and nested dropout).
result Convergence to optimal representation is slow due to ill-conditioning.
Optimal transport is #P-hard when components are independent, even with approximate solutions.
problem Computational complexity of optimal transport with independent marginals.
method Proved #P-hardness and developed a pseudo-polynomial time approximation algorithm.
result Optimal transport is #P-hard even with independent components and approximate solutions.
Generalizes PCA to maximize any convex function of components.
problem Finding a principal vector that maximizes a convex function of components.
method Gradient ascent algorithm for solving the generalized PCA problem; fixed points of neural networks for kernel version.
result Solutions can be obtained as fixed points of simple neural networks.
Principal component regression (PCR) is a two-stage procedure that selects some principal components and then constructs a regression model regarding them as new explanatory variables. Note that the principal components are obtained from only explanatory variables and not considered with the response variable. To addre…
Federated learning improves SPCA for sparse components.
problem Data privacy and sharing constraints in machine learning.
method Federated learning framework applied to SPCA with L1 regularization and smoothing.
result Federated SPCA achieves sparse component loadings with improved interpretability.
FPCA optimizes fairness in target vectors' span.
problem Fairness in principal component analysis for multiple target vectors.
method Non-concave maximization of worst projected target norm using sub-gradient descent.
result Optimization landscape is benign with globally optimal local minima.
Study reveals structure of local minima in GMMs, identifying key cluster centers.
problem Identifying optimal cluster centers in non-convex GMM landscapes.
method Analyzing the negative log-likelihood function of GMMs in the population limit.
result Local minima share a common structure that partially identifies true cluster centers.
We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can be computed one by one, repeatedly solving the single-component problem and def…
Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms meant to do so such as an online method be Warmuth and Kuzmin, Matrix Stochastic Gr…
We consider the mixed regression problem with two components, under adversarial and stochastic noise. We give a convex optimization formulation that provably recovers the true solution, and provide upper bounds on the recovery errors for both arbitrary noise and stochastic noise settings. We also give matching minimax …
This paper derives a portfolio decomposition formula when the agent maximizes utility of her wealth at some finite planning horizon. The financial market is complete and consists of multiple risky assets (stocks) plus a risk free asset. The stocks are modelled as exponential Brownian motions with drift and volatility b…
Smooth finite-sum optimization has been widely studied in both convex and nonconvex settings. However, existing lower bounds for finite-sum optimization are mostly limited to the setting where each component function is (strongly) convex, while the lower bounds for nonconvex finite-sum optimization remain largely unsol…
New lower bounds for gradient methods in strongly convex finite-sum optimization.
problem Developing tight lower bounds for randomized gradient methods in finite-sum optimization.
method Deriving tight lower complexity bounds for SAG, SAGA, SVRG, SARAH, and related methods.
result Tight matches between lower bounds and upper bounds for various methods under specific conditions.
This work addresses two main issues of the standard Kernel Entropy Component Analysis (KECA) algorithm: the optimization of the kernel decomposition and the optimization of the Gaussian kernel parameter. KECA roughly reduces to a sorting of the importance of kernel eigenvectors by entropy instead of by variance as in K…
An EM Gradient Algorithm for Mixture Models with Components Derived from the Manly Transformationstat.ML
A new EM gradient algorithm for mixture models with skewed components.
problem Fitting mixture models with skewed components derived from the Manly transformation.
method Proposes an alternative EM gradient algorithm using Newton's method for better parameter updates.
result Shows improved convergence and parameter estimation compared to the Nelder-Mead optimization.
factor analysismath.OC
New method for factor analysis using nuclear and norms.
problem Finding a low-rank plus sparse decomposition from noisy covariance matrix.
method Formulated an optimization problem with nuclear norm, norm, and KL divergence. Used alternating minimization algorithm.
result Algorithm effectively decomposes covariance matrices in synthetic and real datasets.
Study on optimal partitions and nodal solutions for the Yamabe equation.
problem Existence and structure of optimal partitions for the Yamabe equation.
method Analysis of a weakly coupled elliptic system related to the Yamabe equation.
result Existence of least energy sign-changing solutions with precisely two nodal domains.
Novel PCA method for high-dimensional inverse problems.
problem Optimizing large-scale random fields with gradient information.
method Gradient-Sensitive Principal Component Analysis (Gradient-SPCA) that modifies PCA using objective function gradients.
result Improvements in encoding quality for objective function minimization and field distribution.
Method quantifies error from pipeline components in image classification.
problem Understanding error sources in complex machine learning pipelines.
method Computes error contribution and propagation from computational steps, algorithms, and hyperparameters.
result Random search method accurately quantifies error contribution and propagation.
Linear Transformer Block combines MLP and linear attention for near-optimal ICL in linear regression.
problem Achieving near-optimal in-context learning (ICL) risk for linear regression with a Gaussian prior.
method Combines linear attention and MLP components in a Linear Transformer Block (LTB). Establishes correspondence with one-step gradient descent estimators ().
result LTB achieves nearly Bayes optimal ICL risk for linear regression with a Gaussian prior.
Paper develops efficient AltMin algorithm for SRPCP robust matrix recovery.
problem SRPCP model robust matrix recovery with universal penalty parameter.
method Tuning-free alternating minimization (AltMin) algorithm with closed-form subproblems.
result Efficient AltMin algorithm confirms robustness and efficiency.
New method SP-PPCA reduces outlier impact in PCA.
problem Outliers make standard PCA and PPCA less robust.
method Integrates self-paced learning into PPCA, using iterative optimization.
result SP-PPCA effectively reduces or eliminates outlier impact.
New method solves sparse PCA for multiple components efficiently.
problem Sparse PCA for multiple orthogonal components.
method Reformulates orthogonality as rank constraints, uses semidefinite relaxations and bounds.
result Exact solutions with near-optimal variance explained and orthogonality.
Paper develops a dual formulation for PCA in Hilbert spaces.
problem Characterizing probabilistic PCA in Hilbert spaces.
method Dual formulation for probabilistic PCA in Hilbert spaces.
result Generative framework for kernel methods developed.
We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a tree-structured graphical model. Treating the problem as a semiparametric statistical prob…
New bounds on clasp number for 3-component links.
problem Measuring how close a 3-component link is to being a boundary link.
method Using C-complexes and minimizing the area of word curves.
result Constructs links achieving new lower bounds for clasp number.
MFVI mode collapse explained; RoVI proposed to mitigate.
problem Mode collapse in MFVI for mixture distributions.
method Introducing ε-separateness, deriving bounds, proposing RoVI.
result MFVI optimizers collapse to a single component when components are ε-separated.