New group-sparse SVD models improve biclustering of gene expression data.
problem Identifying block patterns with similar expressions in high-dimensional gene expression data.
method Proposed GL1-SVD, GL0-SVD, OGL1-SVD, and OGL0-SVD models with group Lasso and L0-norm penalties, using alternating iterative strategies and ADMM.
result Effective in identifying biologically interpretable gene modules with gene prior group knowledge.
Ranky solves SVD for large sparse matrices in distributed systems.
problem Rank problem in large sparse matrices for SVD.
method Distributed approach to solve rank problem.
result Recovers SVD with negligible error for large sparse matrices.
STAT-SVD method reduces high-dimensional data sparsity, achieving optimal estimation.
problem Sparse tensor singular value decomposition for high-dimensional data.
method STAT-SVD method with double projection & thresholding scheme.
result STAT-SVD provides sharp thresholding criterion and minimax rate-optimal estimation.
New K-SVD framework speeds up image denoising with active set algorithm.
problem Efficiently denoise images with high noise levels.
method Proposes K-SVDP using Primal-dual active set (PDAS) algorithm. result Demonstrates comparable performance to state-of-the-art methods.
Improved SVD-based NMF initialization reduces initial error and is faster.
problem Improving NMF initialization to reduce convergence error and computational cost.
method Nonnegative SVD with low-rank correction (NNSVD-LRC) that considers discarded SVD factors.
result Significantly reduces initial error with negligible additional computational cost.
Unified framework for structured principal subspace estimation with bounds and rates.
problem Structured principal subspace estimation problems.
method Unified framework, minimax lower and upper bounds, information-geometric complexity.
result Minimax rates of convergence for specific settings, including optimal rates for non-negative PCA/SVD.
Learning the "blocking" structure is a central challenge for high dimensional data (e.g., gene expression data). Recently, a sparse singular value decomposition (SVD) has been used as a biclustering tool to achieve this goal. However, this model ignores the structural information between variables (e.g., gene interacti…
Paper develops a new test for high-dimensional matrix-valued data.
problem Hypothesis testing for mean of matrix-valued data in high-dimensional settings.
method Proposes a new test statistic for high-dimensional matrix rank testing.
result Develops a novel approach for sparse singular value decomposition (SVD) estimation.
Paper tackles tensor completion from sparse corrupted data using convex optimization.
problem Estimating multidimensional arrays from a subset of corrupted entries.
method Solves a convex program that minimizes a weighted combination of tubal nuclear norm and ℓ1-norm. result Exact recovery of incoherent tensors with overwhelming probability.
In this paper we consider the dictionary learning problem for sparse representation. We first show that this problem is NP-hard by polynomial time reduction of the densest cut problem. Then, using successive convex approximation strategies, we propose efficient dictionary learning schemes to solve several practical for…
SOFARI improves inference on multi-task learning latent factors.
problem Challenges in precise inference on multi-task learning latent factor matrices.
method High-dimensional manifold-based Neyman near-orthogonality inference on Stiefel manifold structure.
result Easy-to-use bias-corrected estimators for latent factor vectors and singular values with asymptotic normal distributions.
A fast randomized PCA for sparse data, up to 9.1X faster.
problem Processing large sparse data efficiently for dimension reduction.
method Fast randomized PCA algorithm optimized for sparse data.
result Up to 9.1X faster than basic rPCA algorithm without accuracy loss.
Faster matrix completion through randomized SVD algorithms.
problem Efficiently completing large sparse matrices for applications like image inpainting and recommender systems.
method Proposed two fast randomized algorithms (rSVD-PI and rSVD-BKI) and a new subspace recycling technique to accelerate singular value thresholding (SVT) method.
result The proposed algorithms achieve up to 15X faster computation time for image inpainting and movie rating estimation problems.
Dictionary learning and component analysis are part of one of the most well-studied and active research fields, at the intersection of signal and image processing, computer vision, and statistical machine learning. In dictionary learning, the current methods of choice are arguably K-SVD and its variants, which learn a …
New algorithms improve RPCA for large matrices with upper rank bounds.
problem Efficiently decompose large matrices into low-rank and sparse parts.
method Combine regularization and matrix multiplication approaches with upper rank bounds.
result Proposed algorithms are faster and more robust than existing methods.
Method interpolates option prices and volatilities without arbitrage.
problem Interpolating option prices and volatilities without arbitrage.
method Sparse modeling approach based on integral equations and SVD.
result Flexible and efficient framework for arbitrage-free interpolation.
New sparse penalty improves biclustering for gene expression data.
problem Identifying significant clusters in gene expression data.
method Prenet penalty applied to SSVD for biclustering.
result Mixed Prenet penalty effectively clusters non-overlapped data.
A neural network, IHT-Net, improves DOA estimation with sparse arrays.
problem Single-snapshot DOA estimation with sparse arrays in dynamic settings.
method IHT-inspired neural network with recurrent neural network and autoencoders.
result IHT-Net achieves faster convergence and higher accuracy in DOA estimation.
Paper proposes a new method for exact recovery in robust tensor principal component analysis.
problem Exact recovery of low-rank and sparse components in tensors.
method Proposes a new method based on tensor-tensor product and t-SVD to solve a convex optimization problem.
result Exact recovery achieved in a deterministic fashion without randomness assumptions.
Efficient CF approach using fast adaptive PCA for recommender systems.
problem Matrix completion problem in recommender systems.
method Fast adaptive randomized singular value decomposition (SVD) and termination mechanism for latent factors.
result The approach achieves near optimal prediction accuracy with high runtime efficiency.
A new model Weighted-SVD improves recommendation accuracy by adjusting latent factor weights.
problem Current Matrix Factorization models assume equal weights for all latent factors, which may not be accurate.
method Integrates linear regression with SVD to allow different weights for latent factors.
result The Weighted-SVD model outperforms other models in RMSE metrics on multiple datasets.
RKCA combines sparse dictionary learning and robust component analysis for robust low-rank modeling.
problem Learning robust low-rank representations from noisy data.
method Kronecker-decomposable component analysis (RKCA) with efficient learning algorithm.
result RKCA achieves robustness to gross corruption and low-rank modeling.
New algorithm reduces matrix multiplication time for sparse matrices.
problem Efficiently multiply large sparse matrices with limited space.
method Exploits sparsity to reduce QR decompositions and time complexity.
result Time complexity reduced to $\widetilde{O}\left((
nz(X)+
nz(Y))\ell+n\ell^2
ight)$ in expectation.
Randomized SVD shows phase transitions in noisy data.
problem Noise sensitivity of randomized SVD in large rank matrices.
method Analyzed R-SVD under low-rank signal plus noise model.
result R-SVD exhibits BBP-like phase transition with outliers above detectability threshold.
New insights into choosing between two data integration methods based on SVD.
problem Choosing between two data integration methods (Stack-SVD and SVD-Stack) for shared latent structure across multiple datasets.
method Derive exact expressions for the asymptotic performance and phase transitions of Stack-SVD and SVD-Stack, and develop optimal weighting schemes.
result Optimally weighted Stack-SVD outperforms optimally weighted SVD-Stack in the asymptotic regime.
Efficient SVD algorithm robust to outliers.
problem Outliers in data matrix affect SVD accuracy and speed.
method Spherically Normalized SVD (SpherSVD) algorithm.
result Significantly faster and more robust than existing methods.
A new algorithm speeds up sparse regression for discovering equations from data.
problem Learning governing equations from vast data with unsatisfying descriptions.
method SPRINT: a fast algorithm using bisection and analytic bounds to identify optimal rank-1 modifications.
result A calculation that would take millions of years can be done in a day.
Paper presents RSVD for better recommender system performance.
problem Improving recommender system performance.
method Regularized SVD (RSVD) with efficient algorithm and theoretical analysis.
result RSVD outperforms SVD in recommender systems.
Sketched SVD improves SVD runtime for large datasets.
problem Efficiently applying SVD to large datasets.
method Randomized sketching to approximate SVD.
result Sketched SVD provides accurate leverage score ordering.
We analyzed SVD and variants for eigenpair computation, comparing their time and space complexities.
problem Comparing time and space complexities of SVD and variants for eigenpair computation.
method Comparison of SVD, truncated SVD, Krylov method, and Randomized PCA in terms of time and space complexity.
result Krylov method and Randomized PCA perform well only when k << n.
Networks are a unifying framework for modeling complex systems and network inference problems are frequently encountered in many fields. Here, I develop and apply a generative approach to network inference (RCweb) for the case when the network is sparse and the latent (not observed) variables affect the observed ones. …
This paper improves SVD for recommender systems using block-based matrix factorization.
problem Scalability and performance issues in recommender systems.
method Block-based Singular Value Decomposition (BMF) for matrix factorization.
result BMF paired with SVD enhances performance and scalability.
A new PCR method using SVD with sparse regularization.
problem Lack of response variable information in traditional PCR.
method One-stage SVD approach with two loss functions and sparse regularization.
result Obtains principal component loadings with response variable information.
This paper improves K-SVD for image denoising using deep learning.
problem Improving the performance of the K-SVD denoising algorithm.
method Designing a deep architecture inspired by K-SVD, trained end-to-end for denoising.
result The proposed deep architecture outperforms classical K-SVD significantly.
We present a solution to scale spectral algorithms for learning sequence functions. We are interested in the case where these functions are sparse (that is, for most sequences they return 0). Spectral algorithms reduce the learning problem to the task of computing an SVD decomposition over a special type of matrix call…
A new method for self-attention models that improves uncertainty estimation.
problem Overconfident predictions and lack of calibrated uncertainty in Transformers.
method Kernel-Eigen Pair Sparse Variational Gaussian Processes (KEP-SVGP) with Kernel SVD (KSVD) to handle asymmetry of attention kernels.
result Reduction in time complexity and improved performance on various benchmarks.
SVD training reduces DNN rank and computation load without SVD per step.
problem High memory and computational load in deep neural networks.
method Explicitly achieves low-rank DNNs during training without SVD per step, using orthogonality regularization and sparsity-inducing regularizers.
result Significantly reduces DNN rank and computation load compared to existing methods.
New method uses SVD entropy to price artworks.
problem Lack of fine measurements in traditional art pricing models.
method SVD entropy of painting images for content measurement.
result SVD entropy positively affects sales price at 1% significance level.
Paper develops a method to robustly cluster tensors with outliers.
problem Clustering tensors contaminated by outliers or sample-specific corruptions.
method Transformed Tensor Low-Rank Representation (OR-TLRR) method.
result Provably recovers row space of clean data and detects outliers.
Study of logarithms in SVD-closed subgroups of unitary group.
problem Understanding logarithms in SVD-closed subgroups of unitary groups.
method Analysis of generalized principal logarithms and minimizing geodesics.
result Set of generalized principal logarithms is a disjoint union of diffeomorphic subsets.
Formula for complex SVD backpropagation developed.
problem No specific problem stated; focuses on complex SVD.
method Back propagation formula for complex SVD developed.
result Back propagation formula for complex SVD created.
Paper shows faster core identification in matching markets.
problem Core Identification Problem in one-sided matching markets.
method Randomized SVD on preference-derived Markov matrix.
result CIP solved in O(Ln) time, matching lower bound.
Improved SVD for shifted matrices without explicit matrix construction.
problem Efficiently estimating SVD of shifted matrices.
method Shifted Randomized SVD algorithm.
result More efficient matrix factorization and low-rank approximation.
Physics-inspired methods optimize SVD compression of LLMs.
problem Efficiently compressing large language models (LLMs) using SVD.
method FermiGrad for globally optimal rank selection and PivGa for lossless compression.
result Global optimization of SVD ranks and lossless compression of low-rank factors.
Optimal transport aligns rotated linear regression models across domains.
problem Aligning rotated linear regression models across domains with differing statistical properties.
method Combines K-means clustering, OT, and SVD to estimate rotation angle and adapt regression model.
result Optimal transport map recovers underlying rotation in R2. Generalizes randomized SVD for better matrix approximations using Gaussian vectors.
problem Computing accurate rank-k approximations of matrices with limited data.
method Extends randomized SVD to multivariate Gaussian vectors, incorporating prior knowledge and using Gaussian processes.
result Demonstrates improved accuracy in approximating matrices and Hilbert-Schmidt operators.
This paper examines the impact of centering in PCA and SVD.
problem The influence of centering in PCA and SVD.
method Detailed exploration of centering in PCA and SVD.
result Two PCA embeddings derived from SVD with and without centering can be aligned under certain conditions.
Unified SVD compression fails in practical tasks, highlighting the importance of per layer activation reconstruction.
problem The failure of a unified SVD compression method in practical tasks like perplexity and accuracy.
method Unified optimization problem for SVD based compression methods, focusing on cross-layer coupling.
result Downstream metrics like perplexity and accuracy degrade severely compared to standard per layer SVD LLM.