Decomposing tensors into orthogonal factors is a well-known task in statistics, machine learning, and signal processing. We study orthogonal outer product decompositions where the factors in the summands in the decomposition are required to be orthogonal across summands, by relating this orthogonal decomposition to the…
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Proposes FOAGP for efficient orthogonal effect decomposition of black-box computer experiments.
The paper explores geometric decompositions for Ricci tensors and their applications.
We construct a decomposition of the identity operator on a Riemannian manifold as a sum of smooth orthogonal projections subordinate to an open cover of . This extends a decomposition of the real line by smooth orthogonal projection due to Coifman, Meyer and Auscher, Weiss, Wickerhauser, and a similar decomposit…
Existing feature selection methods fail to properly account for interactions between features when evaluating feature subsets. In this paper, we attempt to remedy this issue by using orthogonal variance decomposition to evaluate features. The orthogonality of the decomposition allows us to directly calculate the total …
PROD method improves high-dimensional regression by handling strong correlations.
The paper extends orthogonal decomposition results to hermitian Higgs bundles.
TreeHFD algorithm explains tree ensemble models through hierarchical orthogonality.
The paper shows how gradient flow on over-parametrized tensor decomposition behaves like deflation.
Optimizing over the set of orthogonal matrices is a central component in problems like sparse-PCA or tensor decomposition. Unfortunately, such optimization is hard since simple operations on orthogonal matrices easily break orthogonality, and correcting orthogonality usually costs a large amount of computation. Here we…
We present an algorithm for the decomposition of periodic financial return data into orthogonal factors of expected return and "systemic", "productive", and "nonproductive" risk. Generally, when the number of funds does not exceed the number of periods, the expected return of a portfolio is an affine function of its pr…
New algorithms improve tensor CP decomposition under mild conditions.
New scalable GP approximation using Fourier series decomposition.
Study optimizes estimation of orthogonal and rotation matrices from noisy data.
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
In this paper, we study the nonnegative tensor data and propose an orthogonal nonnegative Tucker decomposition (ONTD). We discuss some properties of ONTD and develop a convex relaxation algorithm of the augmented Lagrangian function to solve the optimization problem. The convergence of the algorithm is given. We employ…
Paper uses sparse learning to estimate quasi-potential and drift components in stochastic systems.
We present an algebraic investigation of generalized and equiaffine curvature tensors in a given pseudo-Euclidean vector space and study different orthogonal, irreducible decompositions in analogy to the known decomposition of algebraic curvature tensors. We apply the decomposition results to characterize geometric pro…
We orthogonalize the NSS model to condition and diagnose its ill-conditioned parameters.
We provide a unified view of additive explanations for dependent inputs.
Enhances Gaussian processes with spherical features for better scalability and flexibility.
It is well known that the curvature tensor of a pseudo-Riemannian manifold can be decomposed with respect to the pseudo-orthogonal group into the sum of the Weyl conformal curvature tensor, the traceless part of the Ricci tensor and of the scalar curvature. A similar decomposition with respect to the pseudo-unitary gro…
Revisits CP tensor decomposition for noisy, non-orthogonal data.
We analyze stochastic gradient descent for optimizing non-convex functions. In many cases for non-convex functions the goal is to find a reasonable local minimum, and the main concern is that gradient updates are trapped in saddle points. In this paper we identify strict saddle property for non-convex problem that allo…
Inverted file and asymmetric distance computation (IVFADC) have been successfully applied to approximate nearest neighbor search and subsequently maximum inner product search. In such a framework, vector quantization is used for coarse partitioning while product quantization is used for quantizing residuals. In the ori…
Tensor CANDECOMP/PARAFAC (CP) decomposition is an important tool that solves a wide class of machine learning problems. Existing popular approaches recover components one by one, not necessarily in the order of larger components first. Recently developed simultaneous power method obtains only a high probability recover…
The Temperley-Lieb algebra is a fundamental component of SU(2) topological quantum field theories. We construct chain complexes corresponding to minimal idempotents in the Temperley-Lieb algebra. Our results apply to the framework which determines Khovanov homology. Consequences of our work include semi-orthogonal deco…
Many modern big data applications feature large scale in both numbers of responses and predictors. Better statistical efficiency and scientific insights can be enabled by understanding the large-scale response-predictor association network structures via layers of sparse latent factors ranked by importance. Yet sparsit…
The paper proposes and discusses semiorthogonal decompositions for moduli spaces of vector bundles.
The paper decomposes spacelike hypersurface properties for general relativistic vacuum equations.
New algorithms solve tensor problems with random components using SDP.
Corrected whitening restores orthogonality in high-dimensional spherical Gaussian mixtures.
The paper characterizes harmonic maps and studies their properties on Riemannian manifolds.
We study algebraic structures ( and -algebras) introduced by Gaiotto, Moore and Witten in their recent work devoted to certain supersymmetric 2-dimensional massive field theories. We show that such structures can be systematically produced in any number of dimensions by using the geometry of seconda…
The main result is the identification of the orthogonal complement of the subalgebra of conformal vector field inside the algebra of all vector fields of a compact flat 2-manifold. As a fundamental tool, the complete Hodge decomposition for manifold with boundary is used. The identification allows the derivation of gov…
A recent strategy to circumvent the exploding and vanishing gradient problem in RNNs, and to allow the stable propagation of signals over long time scales, is to constrain recurrent connectivity matrices to be orthogonal or unitary. This ensures eigenvalues with unit norm and thus stable dynamics and training. However …
Non-orthogonal joint diagonalization (NJD) free of prewhitening has been widely studied in the context of blind source separation (BSS) and array signal processing, etc. However, NJD is used to retrieve the jointly diagonalizable structure for a single set of target matrices which are mostly formulized with a single da…
Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.
This work is devoted to elaboration on the idea to use block term decomposition for group data analysis and to raise the possibility of modelling group activity with (Lr, 1) and Tucker blocks. A new generalization of block tensor decomposition was considered in application to group data analysis. Suggested approach was…
Manifold submetries of the round sphere are a class of partitions of the round sphere that generalizes both singular Riemannian foliations, and the orbit decompositions by the orthogonal representations of compact groups. We exhibit a one-to-one correspondence between such manifold submetries and maximal Laplacian alge…
Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness theorem to decompose symmetric, nearly orthogonally decomposable tensors. Unlik…
AuON is a linear-time optimizer that improves upon Muon's performance without approximate orthogonal matrices.
Proposes MVGPR for spatiotemporal data modal analysis.
The paper introduces polarizations in symplectic and orthogonal settings.
New method preserves topology in Hodge decomposition for scalar and vector fields.
Spectral method for joint community detection and group synchronization.
Improved Gaussian process models for interpretable predictions.
Proposes a new method for analyzing multimodal neuroimaging data.