We prove that semialgebraic sets of rectangular matrices of a fixed rank, of skew-symmetric matrices of a fixed rank and of real symmetric matrices whose eigenvalues have prescribed multiplicities are minimal submanifolds of the space of real matrices of a given size.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
42 results for “fixed-rank”
Several important applications, such as streaming PCA and semidefinite programming, involve a large-scale positive-semidefinite (psd) matrix that is presented as a sequence of linear updates. Because of storage limitations, it may only be possible to retain a sketch of the psd matrix. This paper develops a new algorith…
Improved Fixed-Rank Nyström Approximation via QR Decomposition: Practical and Theoretical Aspectsstat.ML
The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high quality approximations, the number of landmark points is chosen to be greater than the target rank. Ho…
This research solves Hermite interpolation on manifolds using retractions.
problem Interpolating data on non-Euclidean spaces with matching derivatives.
method Proposes a novel procedure using retractions for Hermite interpolation on various manifolds.
result Establishes the well-posedness of the method and extends Hermite interpolation results to manifolds.
An associated bundle approach to the Bures--Wasserstein geometry of fixed rank covariance matricesmath.DG
Paper explores geometry of covariance matrices using associated bundles.
problem Geometry of fixed-rank covariance matrices.
method Associated bundle approach to Bures--Wasserstein geometry.
result Established a one-to-one correspondence between geodesics.
New method reduces computational cost for nonnegative low rank matrix approximation.
problem Efficiently compute nonnegative low rank matrix approximation for nonnegative matrices.
method Alternating projections onto tangent spaces of fixed rank matrices manifold and nonnegative matrix manifold.
result Sequence converges linearly to optimal solutions, showing better performance in terms of computational time and accuracy.
No hyperbolic group can have an infinite chain of free subgroups of fixed rank.
problem Infinite ascending chains of free subgroups in hyperbolic groups.
method Proof by contradiction and properties of hyperbolic groups.
result Hyperbolic groups do not contain strictly ascending chains of free quasiconvex subgroups of constant rank.
Estimates covariance matrices for matrix-variate data via core covariance geometry.
problem Estimating covariance matrices for matrix-variate data with partial isotropy.
method Fixed-rank core covariance geometry, partial-isotropy rank-r core shrinkage estimator.
result The geometry of the space of rank-r cores is a smooth manifold.
A new Riemannian framework optimizes LoRA for faster convergence and better performance.
problem Optimizing low-rank adapters in neural networks to improve convergence and performance.
method Integrates Riemannion optimizer, LoRA initialization, and efficient implementation for geometrically treating low-rank adapters.
result Consistent and noticeable improvements in convergence speed and final task performance over standard LoRA and its modifications.
New geometric framework for positive semidefinite matrices of fixed rank.
problem Statistical analysis of positive semidefinite matrices of fixed rank.
method Introducing a manifold with Riemannian geometry and Lie group structure.
result Analytical closed forms for geodesics and Fréchet means.
KReTTaH uses tensor trains and Hadamard overparameterization for fast, interpretable multi-way data imputation.
problem Multi-way data imputation for high-dimensional functional MRI and dynamic graph recovery.
method Reformulates imputation as RKHS regression with TT-constrained coefficients and Hadamard overparameterization. Optimizes TT coefficients and kernel matrices on Riemannian manifolds.
result Consistently outperforms state-of-the-art methods in modeling accuracy.
KReTTaH uses tensor trains and Hadamard overparameterization for fast, interpretable multi-way data imputation.
problem Multi-way data imputation in high-dimensional spaces.
method Reformulates imputation as RKHS regression with TT-constrained coefficients, optimized on manifold frameworks.
result Consistently outperforms state-of-the-art methods in accuracy.
AdaRL improves robust RL by adaptively adjusting policy complexity.
problem Handling epistemic uncertainty in environment dynamics.
method Bi-level optimization framework with adaptive rank adjustment.
result AdaRL outperforms existing methods on MuJoCo benchmarks.
Geometrically, tensors of fixed rank form a minimal submanifold.
problem Understanding the geometric properties of tensors of fixed rank.
method Geometric analysis of tensors in Euclidean space.
result Real tensors of fixed multilinear rank form a minimal submanifold.
We study the deformation theory of pre-symplectic structures, i.e. closed two-forms of fixed rank. The main result is a parametrization of nearby deformations of a given pre-symplectic structure in terms of an -algebra, which we call Koszul -algebra. This -algebra is a cousin of the Koszul…
Matroid bundles, introduced by MacPherson, are combinatorial analogues of real vector bundles. This paper sets up the foundations of matroid bundles, and defines a natural transformation from isomorphism classes of real vector bundles to isomorphism classes of matroid bundles, as well as a transformation from matroid b…
Factorization machines (FM) are a popular model class to learn pairwise interactions by a low-rank approximation. Different from existing FM-based approaches which use a fixed rank for all features, this paper proposes a Rank-Aware FM (RaFM) model which adopts pairwise interactions from embeddings with different ranks.…
A compact topological surface S, possibly non-orientable and with non-empty boundary, always admits a Klein surface structure (an atlas whose transition maps are dianalytic). Its complex cover is, by definition, a compact Riemann surface M endowed with an anti-holomorphic involution which determines topologically the o…
The main goal of this paper is to extend the so-called Dirac-Frenkel Variational Principle in the framework of tensor Banach spaces. To this end we observe that a tensor product of normed spaces can be described as a union of disjoint connected components. Then we show that each of these connected components, composed …
Structured sparsity is an important modeling tool that expands the applicability of convex formulations for data analysis, however it also creates significant challenges for efficient algorithm design. In this paper we investigate the generalized conditional gradient (GCG) algorithm for solving structured sparse optimi…
Clarifies the structure of quantum states using algebraic methods.
problem Unclear stratification of quantum states in physics literature.
method Analyzes the state space S(A) of a finite-dimensional C*-algebra A, focusing on unitary orbits and their properties.
result Identifies a natural Whitney stratification of the state space into matrices of fixed rank, providing a pseudo-manifold structure.
We consider two Riemannian geometries for the manifold of all matrices of rank . The geometries are induced on by viewing it as the base manifold of the submersion , selecting an adequate Riemannian metric on the total space, and …
Riemannian gradient descent escapes some spurious critical points on low-rank matrix manifold.
problem Spurious critical points on the boundary of low-rank matrix manifold.
method Riemannian gradient descent with dynamical low-rank approximation and rescaled gradient flow.
result Riemannian gradient descent escapes some spurious critical points on the boundary of the manifold.
We consider numerical integrators of ODEs on homogeneous spaces (spheres, affine spaces, hyperbolic spaces). Homogeneous spaces are equipped with a built-in symmetry. A numerical integrator respects this symmetry if it is equivariant. One obtains homogeneous space integrators by combining a Lie group integrator with an…
Moduli spaces of semi-stable real and quaternionic vector bundles of a fixed topological type admit a presentation as Lagrangian quotients, and can be embedded into the symplectic quotient corresponding to the moduli variety of semi-stable holomorphic vector bundles of fixed rank and degree on a smooth complex projecti…
The paper presents two schemes for sampling matrices from specific distributions on a manifold.
problem Sampling matrices from Gibbs distributions on the manifold of positive semi-definite matrices with fixed rank.
method Two explicit schemes based on Euler-Maruyama discretization of the Riemannian Langevin equation with Brownian motion on the manifold.
result Numerical validation of the schemes using specific energy functions and metrics.
The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over the Riemannian manifold of fixed-rank matrices. The algorithm is an adaptation of…
Paper proposes a new algorithm for graph learning with covariance constraints.
problem Graphical models and factor analysis not jointly leveraged in graph learning processes.
method Penalized maximum likelihood estimation of an elliptical distribution with Riemannian optimization.
result Effectiveness of the proposed approach demonstrated on real-world data sets.
Recent advances in neuroscience and in the technology of functional magnetic resonance imaging (fMRI) and electro-encephalography (EEG) have propelled a growing interest in brain-network clustering via time-series analysis. Notwithstanding, most of the brain-network clustering methods revolve around state clustering an…
Recently, Factorization Machines (FM) has become more and more popular for recommendation systems, due to its effectiveness in finding informative interactions between features. Usually, the weights for the interactions is learnt as a low rank weight matrix, which is formulated as an inner product of two low rank matri…
Global geometric expressions derived for manifold embeddings.
problem Expressing geometric quantities globally on manifolds.
method Global formulas using operator-valued expressions and affine projection.
result Explicit cross-curvature results for specific metrics.
Operator-valued formulas for Riemannian Gradient and Hessian and families of tractable metricsmath.OC
New formulas for Riemannian gradient and Hessian on manifold metrics.
problem Evaluate Riemannian gradient and Hessian for various metrics on manifolds.
method Explicit formulas derived from Levi-Civita connection and projection.
result Derives new metrics and optimization frameworks on manifolds.
New algorithm reduces rank constrained optimization problems.
problem Rank constrained optimization problems in machine learning and statistics.
method Recursive Importance Sketching (RISRO) algorithm.
result RISRO offers clear advantages over existing algorithms and converges efficiently.
In higher dimensions, Schottky spaces have unique topological properties.
problem Characterize the topology of Schottky spaces in higher dimensions.
method Analyzing the fundamental group and homotopy properties of Schottky spaces in the borderline dimension.
result In the borderline dimension, the space is simply connected but has a dense open part with fundamental group a product of cyclic groups of order two.
Improved spatial prediction for massive datasets using SME model.
problem Efficiently estimating parameters in massive spatial datasets.
method Spatial Mixed Effects (SME) model with AECM algorithm for flexibility.
result Improved estimation without sacrificing prediction accuracy.
Study of correlated Wigner matrices with BBP transitions.
problem Understanding spectral transitions in correlated Wigner matrices.
method Analyzes a Wigner-type matrix with row/column correlations, decomposes into bulk and outliers, and uses integral operators to model transitions.
result Correlated Wigner matrices exhibit multiple BBP transitions at critical points.
The problem of learning a correspondence relationship between nodes of two networks has drawn much attention of the computer science community and recently that of statisticians. The unseeded version of this problem, in which we do not know any part of the true correspondence, is a long-standing challenge. For low-rank…
This paper studies geodesics between covariance matrices of different ranks using the Bures-Wasserstein metric.
problem Geodesics between covariance matrices of varying ranks.
method Analyzes the Bures-Wasserstein distance on covariance matrices, completing previous work on geodesics and providing explicit formulas.
result The set of all minimizing geodesics between two covariance matrices is parametrized by a closed unit ball in .
The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine learning becomes increasingly attractive for performing training and inference directl…
This thesis enhances ML reliability by selectively abstaining from predictions when uncertain.
problem Improving reliability in machine learning systems, especially in high-stakes domains.
method Exploiting uncertainty signals from training trajectories to develop lightweight, post-hoc abstention methods compatible with differential privacy.
result A robust trajectory-based approach to selective prediction that maintains high accuracy under privacy noise.
Develops new approach to recover CR structures from their Levi foliations.
problem Recovering CR structures from their Levi foliations for nonregular symbols.
method Reduction to dynamical Legendrian contact structure on leaf space.
result New geometric interpretation of CR prolongation conditions.
In this paper, we introduce a new geometric description of the manifolds of matrices of fixed rank. The starting point is a geometric description of the Grassmann manifold of linear subspaces of dimension in which avoids the use of equivalence classes. The set $\mathbb{…