Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

56112167223 · Jun 202019922001200920172026
48 results for rank reduction

Efficiently reduces rank of non-negative matrices with quadratic time complexity.

problem Efficiently reducing the rank of non-negative matrices.
method Formulated rank reduction as a mean-field approximation using a log-linear model.
result Optimal solution for minimizing KL divergence can be computed in closed form.

T. Kobayashi conjectured in the 36th Geometry Symposium in Japan (1989) that a homogeneous space G/H of reductive type does not admit a compact Clifford-Klein form if rank G - rank K < rank H - rank K_H. We solve this conjecture affirmatively. We apply a cohomological obstruction to the existence of compact Clifford-Kl…

2017-05-18abs ↗pdf ↗

Proposes a faster Isomap algorithm by reducing eigenvalue decomposition complexity.

problem High computational complexity of Isomap, especially in eigenvalue decomposition stage.
method Introduces a projection operator to reduce the complexity of the eigenvalue decomposition stage to linear order.
result Reduces Isomap's computational complexity to linear order while preserving structural information.

Supervised linear feature extraction can be achieved by fitting a reduced rank multivariate model. This paper studies rank penalized and rank constrained vector generalized linear models. From the perspective of thresholding rules, we build a framework for fitting singular value penalized models and use it for feature …

2010-07-19abs ↗pdf ↗

Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as symmetric generalized eigendecomposition problems. In this paper we outline how t…

2012-11-07abs ↗pdf ↗

The paper extends a theorem to number fields without infinite places.

problem Finiteness properties of arithmetic approximate lattices.
method Geometric and homological finiteness properties for countable approximate groups.
result The finiteness length is finite and can be computed explicitly.

PSMM method optimizes matrix sufficient dimension reduction.

problem Feature matrices with row- and column-wise interpretations require efficient dimension reduction.
method PSMM method converts matrix problem into classification problems using rank-1 normal matrix.
result PSMM outperforms existing methods and provides strong interpretability.

Study evaluates feature ranking methods' faithfulness in ML models, improving with dimensionality reduction.

problem Quantifying and improving the faithfulness of feature ranking methods in ML models.
method Evaluation of multiple feature ranking methods, including SHAP, LIME, ALE variance, and LR coefficients, using permutation importance as a baseline.
result Dimensionality reduction improves the faithfulness of feature ranking methods, making permutation importance the most faithful method.

Paper presents a reduction-based framework for conservative bandits and RL with improved lower and upper bounds.

problem Conservative bandits and reinforcement learning problems.
method Reduction technique to calculate necessary and sufficient budget from baseline policy.
result Improved lower and upper bounds for various conservative settings.

A trisymplectic structure on a complex 2n-manifold is a triple of holomorphic symplectic forms such that any linear combination of these forms has constant rank 2n, n or 0, and degenerate forms in ΩΩ belong to a non-degenerate quadric hypersurface. We show that a trisymplectic manifold is equipped with a holomorphic 3…

2011-03-23abs ↗pdf ↗

IRCUR accelerates RPCA by using CUR decomposition for efficient low rank estimation.

problem Dimension reduction in robust principal component analysis.
method IRCUR employs CUR decomposition to update the low rank component efficiently.
result IRCUR achieves significant computational efficiency compared to existing algorithms.

New method finds efficient low-rank neural networks during training.

problem High memory and computational demands of neural networks.
method Restricts weight matrices to a low-rank manifold and updates low-rank factors.
result Significantly reduced time and memory resources required for training and evaluation.

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the objective is to find a low-rank approximation that meets rank and convex constraints, w…

2016-06-06abs ↗pdf ↗

We present Matrix Krasulina, an algorithm for online k-PCA, by generalizing the classic Krasulina's method (Krasulina, 1969) from vector to matrix case. We show, both theoretically and empirically, that the algorithm naturally adapts to data low-rankness and converges exponentially fast to the ground-truth principal su…

2019-04-03abs ↗pdf ↗

We show that polar actions of cohomogeneity two on simple compact Lie groups of higher rank, endowed with a biinvariant Riemannian metric, are hyperpolar. Combining this with a recent result of the second-named author, we are able to prove that polar actions induced by reductive algebraic subgroups in the isometry grou…

2011-08-16abs ↗pdf ↗

We consider locally conformal Kaehler geometry as an equivariant (homothetic) Kaehler geometry: a locally conformal Kaehler manifold is, up to equivalence, a pair (K,Γ) where K is a Kaehler manifold and Γa discrete Lie group of biholomorphic homotheties acting freely and properly discontinuously. We define a new invari…

2005-02-28abs ↗pdf ↗

A neural network approach for feature selection using mutual information.

problem Feature ranking and selection leading to sub-optimal solutions for class separability.
method Stochastic mutual information gradient estimation for dimensionality reduction.
result The network projects features onto an output space maximizing mutual information with class labels.

SVD training reduces DNN rank and computation load without SVD per step.

problem High memory and computational load in deep neural networks.
method Explicitly achieves low-rank DNNs during training without SVD per step, using orthogonality regularization and sparsity-inducing regularizers.
result Significantly reduces DNN rank and computation load compared to existing methods.

Develops precise expressions for random projections for better machine learning tasks.

problem Improving the accuracy of dimensionality reduction in machine learning tasks.
method Exploits recent developments in spectral analysis of random matrices to derive accurate expressions for random projection matrices.
result Provides precise expressions that reflect the practical performance of sketching methods, including Gaussian and Rademacher sketches.

The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In this paper we develop an approach for dimension reduction that exploits the assumpt…

2015-04-13abs ↗pdf ↗

Consider an effective Hamiltonian torus action T×MMT\times M \to M on a topologically twisted,generalized complex manifold MM of dimension 2n2n. We prove that the rank(T)n2rank(T) \leq n-2 and that the topological twisting survives Hamiltonian reduction. We then construct a large new class of such actions satisfying $rank(T) =…

2009-04-07abs ↗pdf ↗

Low-rank approximations of data matrices are an important dimensionality reduction tool in machine learning and regression analysis. We consider the case of categorical variables, where it can be formulated as the problem of finding low-rank approximations to Boolean matrices. In this paper we give what is to the best …

2018-03-13abs ↗pdf ↗

The study proposes a method for risk reduction without relying on risk measurement.

problem Theoretical utopia of risk minimization vs. practical risk reduction.
method Generalization of matrix rank and condition number for identifying riskiest scenarios.
result Risk reduction achieved without risk measurement, validated by real data.

Whereas most dimensionality reduction techniques (e.g. PCA, ICA, NMF) for multivariate data essentially rely on linear algebra to a certain extent, summarizing ranking data, viewed as realizations of a random permutation ΣΣ on a set of items indexed by i{1,,  n}i\in \{1,\ldots,\; n\}, is a great statistical challenge, due to…

2018-10-15abs ↗pdf ↗

SRCA reduces high-dimensional data to lower dimensions while preserving geometric structures.

problem High-dimensional datasets with underlying geometric structures.
method Spherical Rotation Component Analysis (SRCA) incorporating geometric loss functions.
result SRCA provides a low-rank spherical representation of data with general theoretic guarantees.

During the last decades, we have witnessed a surge of interests of learning a low-dimensional space with discriminative information from one single view. Even though most of them can achieve satisfactory performance in some certain situations, they fail to fully consider the information from multiple views which are hi…

2019-05-20abs ↗pdf ↗

We study isometric actions on Riemannian symmetric spaces of noncompact type which are induced by reductive algebraic subgroups of the isometry group. We show that for such an action there exists a corresponding isometric action on a dual compact symmetric space, which reflects many properties of the original action. F…

2011-01-09abs ↗pdf ↗

The paper explores how to reduce classification tasks to optimization problems in Euclidean space.

problem Understanding the minimum dimension needed for reducing classification tasks to optimization problems.
method Developed a generalization of the Borsuk-Ulam Theorem to analyze the expressivity of reductions.
result The minimum Euclidean dimension required can be exponentially larger than the VC dimension, even for slightly non-trivial reductions.

IMPACT optimizes LLM compression by focusing on activation importance, reducing model size up to 55.4%.

problem Resource constraints in deploying large language models (LLMs).
method IMPACT integrates activation importance into low-rank compression, optimizing for both size and accuracy.
result IMPACT achieves up to 55.4% greater model size reduction while maintaining comparable or better accuracy.

High-dimensional representations often have a lower dimensional underlying structure. This is particularly the case in many decision making settings. For example, when the representation of actions is generated from a deep neural network, it is reasonable to expect a low-rank structure whereas conventional structures l…

2019-01-28abs ↗pdf ↗