IKD uses eigen-decomposition for nonlinear dimensionality reduction.
problem Lack of sophisticated and nonlinear dimensionality reduction methods.
method Inverse Kernel Decomposition (IKD) based on eigen-decomposition of sample covariance matrix.
result IKD achieves comparable performance to optimization-based methods with faster running speeds.
EFiGP uses Fourier and eigen-decomposition for efficient ODE parameter estimation.
problem Parameter estimation and trajectory reconstruction for noisy, sparse, nonlinear ODE systems.
method EFiGP integrates Fourier transformation and eigen-decomposition into a physics-informed Gaussian Process framework.
result EFiGP efficiently estimates ODE parameters and recovers trajectories from noisy data.
Efficient spectral clustering using autoencoders and landmarks.
problem High computational complexity of spectral clustering.
method Build adjacency matrix using landmarks, define efficient Laplacian matrix, perform eigen decomposition using autoencoder.
result Overall complexity of O(np), where n is data points and p is landmarks. A new kernel test reduces noise in MMD by focusing on leading eigen-directions.
problem Noise in trailing directional components degrades power of standard kernel two-sample tests.
method Truncate MMD spectral decomposition, retaining only leading eigen-directions.
result Our method achieves superior power and robustness, especially in high-dimensional and unbalanced settings.
2L-FUSE enhances feature sparsity through kernel learning.
problem Sparsity and feature selection in regression tasks.
method 2-Layered kernel machines for learning a shape matrix and feature direction identification.
result Minimal yet informative feature sets are identified without losing predictive performance.
Method detects phase transitions in financial markets using eigenvalue decomposition.
problem Detecting tipping points and fluctuation patterns in financial markets.
method Eigenvalue decomposition and eigen-entropy from cross-correlation matrix.
result Market events undergo phase separation and order-disorder transitions.
Paper analyzes spectral clustering for large graphs using random signals.
problem Complex eigen decomposition for large graphs.
method Graph filtering of random signals for approximate spectral embedding.
result Consistency of spectral clustering in stochastic block model.
Paper tackles small eigen-gap estimation and inference for noisy symmetric matrices.
problem Estimating eigenvectors with small eigen-gap and fine-grained statistical reasoning.
method Eigen-decomposition of asymmetric data matrix, distribution-free procedures, adaptive to heteroscedastic noise.
result Minimax optimal under Gaussian noise, confidence intervals for eigenvalues, small eigen-gap handling.
Gen-RKM framework generates multi-view data with uncorrelated features.
problem Joint multi-view generation and disentangled feature learning.
method Joint multi-view generation using shared representation; primal and dual formulations; novel training procedure for neural networks.
result Joint multi-view generation and uncorrelated feature learning achieved.
This paper speeds up K-FAC for deep learning by focusing on only a few eigen-modes.
problem Time-consuming computation of Kronecker factors in K-FAC for large layers.
method Theoretical analysis and randomized numerical linear algebra to approximate eigen-spectrum decay.
result Reduces time complexity from cubic to quadratic in layer width, improving efficiency.
We study the stochastic Riemannian gradient algorithm for matrix eigen-decomposition. The state-of-the-art stochastic Riemannian algorithm requires the learning rate to decay to zero and thus suffers from slow convergence and sub-optimal solutions. In this paper, we address this issue by deploying the variance reductio…
This paper finds an exact solution for low-rank DMD, improving model complexity and accuracy.
problem Approximating high-dimensional dynamical systems with tractable models.
method Formulates a low-rank constrained optimisation problem and finds an exact closed-form solution.
result Shows a polynomial-time algorithm for computing the optimal low-rank approximation.
MOSAIC detects change points in dynamic networks with low-rank and sparse changes.
problem Detecting change points in dynamic networks with specific structural properties.
method Eigen-decomposition-based test with screened signals and residual-based adjustment.
result MOSAIC achieves minimax-optimal detection and testing rates.
Explains eigenvalue and generalized eigenvalue problems with examples.
problem Eigenvalue and generalized eigenvalue problems.
method Introduction and examples from machine learning.
result Solutions to eigenvalue and generalized eigenvalue problems.
Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression relationships. We extend such models by imposing an eigen-decomposition on the multivariate …
Directly approximates functions on unknown data manifolds without complex computations.
problem Function approximation on unknown data-defined manifolds with conservative results from traditional methods.
method Direct approach using graph Laplacian and local approximation techniques without eigen-decomposition or atlas.
result Universal estimates for smooth functions without prior knowledge of the target function.
Paper proposes an anchor-free topic mining framework for better robustness.
problem Identifying topics without anchor words is challenging.
method Second-order moments, anchor-free approach, one eigen-decomposition, small linear programs.
result Guaranteed topic identification under milder conditions.
The paper introduces eigen-portfolios using PCA to improve portfolio construction in finance.
problem Overfitting and poor generalization in selecting a single eigen-portfolio.
method Principal Component Analysis (PCA) to derive eigen-portfolios from asset return correlation matrices.
result An ensemble strategy combining multiple top-performing eigen-portfolios significantly improves out-of-sample performance.
Paper proposes KIIM to infer causal relationships from data.
problem Inferring causal relationships from data is challenging.
method KIIM captures higher order statistics of conditional distributions.
result KIIM outperforms existing methods in causal inference.
The paper analyzes high-dimensional kernel regression, showing different risk curves based on data and regularization.
problem Characterizing generalization properties of high-dimensional kernel ridge regression.
method Bias-variance decomposition of the expected excess risk, considering different regularization schemes and data eigen-profiles.
result The risk curve of kernel regression can be double-descent-like, bell-shaped, or monotonic, depending on n, d, and regularization level.
Eigen-decomposition simplifies quadratic programming with equality constraints.
problem Optimizing solutions under linear equality constraints in quadratic programming.
method Eigenvalue decomposition of the quadratic term matrix to project optimal solutions.
result Established a linear mapping between EQP formulations with and without diagonalized Q. In this work we show that, using the eigen-decomposition of the adjacency matrix, we can consistently estimate latent positions for random dot product graphs provided the latent positions are i.i.d. from some distribution. If class labels are observed for a number of vertices tending to infinity, then we show that the …
Eigen-GNN enhances GNNs by preserving graph structures.
problem Existing shallow GNNs fail to effectively preserve graph structures.
method Integrates eigenspace of graph structures into GNNs as a dimensionality reduction module.
result Eigen-GNN boosts GNNs' ability to preserve graph structures without increasing depth.
The study characterizes harmonic spaces and their radial eigen-functions and vector fields.
problem Characterizing harmonic spaces and their geometric properties.
method Examining radial eigen-spaces of Laplacians and using duality.
result Results extend to spaces harmonic with respect to a single point.
Eigenvalue and eigenvector estimation improves with asymmetric data.
problem Estimating eigenvalues and eigenvectors from asymmetrically perturbed symmetric matrices.
method Eigenvalue and eigenvector analyses of asymmetrically perturbed low-rank matrices.
result The leading eigenvalue of the data matrix can be significantly more accurate than its singular value.
Eigen-stratified models reduce model size and improve performance.
problem Large model size in Laplacian-regularized stratified models.
method Formulate eigen-stratified models with linear combinations of bottom eigenvectors of the graph Laplacian.
result Significant reduction in model size with eigen-stratified models.
Neural networks solve eigen-problems in differential equations.
problem Finding eigenpairs of self-adjoint operators.
method Using neural networks to approximate eigenfunctions and eigenvalues.
result Demonstrates potential of neural networks in solving complex eigen-problems.
Explains various PCA and SPCA methods with theory and applications.
problem No specific problem stated; focuses on explaining methods.
method Explains PCA, SPCA, kernel PCA, and kernel SPCA methods with theory and applications.
result Comprehensive coverage of PCA and SPCA methods with theory and applications.
Paper proves positivity of energy function on Riemannian manifolds.
problem Investigating positivity of energy function on Riemannian manifolds.
method Using energy function to prove positivity of initial energy.
result Simple method to obtain growth of eigen-solutions.
SpGAT learns graph representations using spectral attention for efficiency.
problem Efficiently capturing global graph patterns with minimal parameters.
method Introduces Spectral Graph Attention Network (SpGAT) using spectral domain attention mechanisms and a fast Chebychev approximation.
result SpGAT achieves better global pattern recognition with fewer parameters compared to GAT.
We prove polynomial and exponential decay at infinity of eigen-vectors of partial differential operators related to radiation problems for time-harmonic generalized Maxwell systems in an exterior domain with non-smooth inhomogeneous, anisotropic coefficients converging near infinity with a certain rate towards the iden…
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
The paper studies eigen-solutions on Riemannian manifolds and their growth as distance increases.
problem Analyzing the growth of eigen-solutions on Riemannian manifolds.
method Developed Kato's methods on manifolds to study the asymptotic behaviors of eigen-solutions.
result Established the growth of eigen-solutions as distance increases.
RKHSMetaMod estimates complex models' Hoeffding decomposition for sensitivity analysis.
problem Estimating the Hoeffding decomposition of complex models for sensitivity analysis.
method Penalized empirical least-squares minimization with RKHS ridge group sparse optimization.
result Estimates non-zero Sobol indices for sensitivity analysis.
Eigen component analysis combines quantum mechanics with machine learning for efficient data analysis.
problem Efficiently extracting linearly separable components from complex data.
method Eigen component analysis (ECA) incorporates quantum mechanics principles into linear learning models.
result ECA outperforms classical linear models and can be integrated with deep neural networks.
New method preserves privacy while detecting communities in distributed networks.
problem Privacy-preserving community detection in locally distributed multi-layer networks.
method Privacy-preserving Distributed Spectral Clustering (ppDSC) using randomized response mechanism.
result Developed a novel algorithm that maintains community structure while protecting privacy.
This study compares two portfolio optimization methods on Indian stocks.
problem Designing an optimal portfolio considering stock returns and risks.
method Hierarchical Risk Parity and Eigen Portfolio approaches on NIFTY 50 sectors.
result Hierarchical Risk Parity portfolio outperforms Eigen portfolio in most sectors tested.
This paper compares three portfolio designs for Indian stocks.
problem Designing an optimum portfolio that balances return and risk.
method Three approaches: minimum risk, optimum risk, and Eigen portfolios.
result Optimum risk portfolios and Eigen portfolios identified for each sector.
We present local discriminative Gaussian (LDG) dimensionality reduction, a supervised dimensionality reduction technique for classification. The LDG objective function is an approximation to the leave-one-out training error of a local quadratic discriminant analysis classifier, and thus acts locally to each training po…
Paper addresses eigenvector perturbation in small eigen-gap scenarios.
problem Fine-grained behavior of eigenvectors in the presence of small eigen-gaps.
method Develops de-biased estimators for linear functions of an unknown eigenvector.
result Achieves minimax lower bounds for a family of scenarios, even with small eigen-gaps.
In this work we show that, using the eigen-decomposition of the adjacency matrix, we can consistently estimate feature maps for latent position graphs with positive definite link function κ, provided that the latent positions are i.i.d. from some distribution F. We then consider the exploitation task of vertex classi…
New algorithms extract Koopman invariant subspaces from large-scale data.
problem Difficulty in discerning the Koopman invariant subspace from many Koopman eigenmodes.
method Multi-task feature learning and pruning procedure to remove spurious modes.
result Effective in approximating Koopman operator for complex flows.
New method solves stochastic optimization problems with random models.
problem Optimizing stochastic objectives with deterministic constraints.
method Trust-Region Sequential Quadratic Programming with random model.
result Global convergence guarantees for first- and second-order stationary points.
This paper has been withdrawn by the author and it is published in AGAG
New framework for low-rank tensor analysis on graphs.
problem Low-rank tensor analysis on non-Euclidean domains.
method Graph-based low-rank decomposition and convex optimization.
result Significant speed-up and performance enhancement at low SNR.
ParPIC clusters directed graphs using random walks and diffusion operators.
problem Challenges in vertex-level clustering for directed graphs due to edge directionality.
method Parametrized Power-Iteration Clustering (ParPIC) based on reversible random walks and diffusion operators.
result ParPIC achieves competitive clustering accuracy with improved scalability compared to spectral and teleportation-based methods.
We investigate various structures associated with the hyperbolic Markov and homological spectra of a pseudoAnosov map φ on a surface. Each unstable eigenvalue of the action of φ on first cohomolgy yields an eigen-cocycle that is transverse and holonomy invariant to the stable foliation Fs of φ. Each …
CP-factorization for high-dimensional tensor time series and double projection iterations
problem Identifying and estimating factor loadings in CP decomposition for high-dimensional tensor time series
method One-pass estimation procedure using standard eigen-analysis for matrix constructed based on serial dependence
result Asymptotic properties established under general settings, adapt to sparsity, accommodates weak factors