arXiv research

Isometry pursuit identifies orthonormal submatrices from wide matrices.

The ability to decompose a signal in an orthonormal basis (a set of orthogonal components, each normalized to have unit length) using a fast numerical procedure rests at the heart of many signal processing methods and applications. The classic examples are the Fourier and wavelet transforms that enjoy numerically effic…

BOOOM optimizes orthonormal matrices without needing gradients.

Graph clustering method uses templates to match vertices and outperforms classical methods.

Strictly enforcing orthonormality constraints on parameter matrices has been shown advantageous in deep learning. This amounts to Riemannian optimization on the Stiefel manifold, which, however, is computationally expensive. To address this challenge, we present two main contributions: (1) A new efficient retraction ma…

This paper deals with two related problems, namely distance-preserving binary embeddings and quantization for compressed sensing . First, we propose fast methods to replace points from a subset $\mathcal{X} \subset \mathbb{R}^n$, associated with the Euclidean metric, with points in the cube $\{\pm 1\}^m$ and we associa…

Simplified optimization for structured matrices in deep learning.

New algorithm improves deep learning models' robustness without sacrificing accuracy.

Given a real matrix A with n columns, the problem is to approximate the Gram product AA^T by c << n weighted outer products of columns of A. Necessary and sufficient conditions for the exact computation of AA^T (in exact arithmetic) from c >= rank(A) columns depend on the right singular vector matrix of A. For a Monte-…

ManifoldFlow relaxes fixed-spectrum Stiefel layers to learn a positive spectrum.

Finsler space is differentiable manifold for which Minkowski space is the fiber of the tangent bundle. To understand structure of the reference frame in Finsler space, we need to understand the structure of orthonormal basis in Minkowski space. In this paper, we considered the definition of orthonormal basis in Minkows…

Finsler space is differentiable manifold for which Minkowski space is the fiber of the tangent bundle. To understand structure of the reference frame in Finsler space, we need to understand the structure of orthonormal basis in Minkowski space. In this paper, I considered the definition of orthonormal basis in Minkowsk…

This research solves Hermite interpolation on manifolds using retractions.

Proposes a new graph representation method using tensor products.

We study the linear subspace fitting problem in the overparameterized setting, where the estimated subspace can perfectly interpolate the training examples. Our scope includes the least-squares solutions to subspace fitting tasks with varying levels of supervision in the training data (i.e., the proportion of input-out…

We develop Fourier methods to expand translation-invariant kernels.

We show that every unimodular Lie algebra, of dimension at most 4, equipped with an inner product, possesses an orthonormal basis comprised of geodesic elements. On the other hand, we give an example of a solvable unimodular Lie algebra of dimension 5 that has no orthonormal geodesic basis, for any inner product.

Dictionary learning is the task of determining a data-dependent transform that yields a sparse representation of some observed data. The dictionary learning problem is non-convex, and usually solved via computationally complex iterative algorithms. Furthermore, the resulting transforms obtained generally lack structure…

The paper deals with the Weyl equation which is the massless Dirac equation. We study the Weyl equation in the stationary setting, i.e. when the spinor field oscillates harmonically in time. We suggest a new geometric interpretation of the stationary Weyl equation, one which does not require the use of spinors, Pauli m…

Let ${\mathcal S}_m$ be the set of all $m\times m$ density matrices (Hermitian positively semi-definite matrices of unit trace). Consider a problem of estimation of an unknown density matrix $ρ\in {\mathcal S}_m$ based on outcomes of $n$ measurements of observables $X_1,\dots, X_n\in {\mathbb H}_m$ (${\mathbb H}_m$ bei…

The paper deals with the Weyl equation which is the massless Dirac equation. We study the Weyl equation in the stationary setting, i.e. when the the spinor field oscillates harmonically in time. We suggest a new geometric interpretation of the stationary Weyl equation, one which does not require the use of spinors, Pau…

New curvature tensor and matrices for connection graphs derived from Bakry-Émery curvature.

Multi-view clustering is an important and fundamental problem. Many multi-view subspace clustering methods have been proposed, and most of them assume that all views share a same coefficient matrix. However, the underlying information of multi-view data are not fully exploited under this assumption, since the coefficie…

We generalize the orthonormal basis for the Gaussian RKHS described in \cite{MinhGaussian2010} to an infinite, continuously parametrized, family of orthonormal bases, along with some implications. The proofs are direct generalizations of those in \cite{MinhGaussian2010}.

Generalisation of a deep neural network (DNN) is one major concern when employing the deep learning approach for solving practical problems. In this paper we propose a new technique, named approximated orthonormal normalisation (AON), to improve the generalisation capacity of a DNN model. Considering a weight matrix W …

The main result of the paper is a new representation for the Weyl Lagrangian (massless Dirac Lagrangian). As the dynamical variable we use the coframe, i.e. an orthonormal tetrad of covector fields. We write down a simple Lagrangian - wedge product of axial torsion with a lightlike element of the coframe - and show tha…

The main result of the paper is a new representation for the Weyl Lagrangian (massless Dirac Lagrangian). As the dynamical variable we use the coframe, i.e. an orthonormal tetrad of covector fields. We write down a simple Lagrangian - wedge product of axial torsion with a lightlike element of the coframe - and show tha…

The main result of the paper is a new representation of the Weyl Lagrangian (massless Dirac Lagrangian). As the dynamical variable we use the coframe, i.e. an orthonormal tetrad of covector fields. We write down a simple Lagrangian - wedge product of axial torsion with a lightlike element of the coframe - and show that…

We suggest an alternative mathematical model for the electron in which the dynamical variables are a coframe (field of orthonormal bases) and a density. The electron mass and external electromagnetic field are incorporated into our model by means of a Kaluza-Klein extension. Our Lagrangian density is proportional to ax…

We show the existence of uniformly bounded sequences of increasing numbers of orthonormal sections of powers $L^k$ of a positive holomorphic line bundle $L$ on a compact Kähler manifold $M$. In particular, we construct for each positive integer $k$, orthonormal sections $s^k_1,\dots,s^k_{n_k}$ in $H^0(M,L^k)$, $n_k\geβ…

New method uses almost orthonormal bases to prove low-degree lower bounds in complex statistical models.

PolyILR: A Tree-Structured Orthonormal Decomposition of Compositional Data

We prove that the Ricci flow equation for left invariant metrics on Lie groups reduces to a first order ordinary differential equation for a map $Q : (-a,a) \to UT$, where $UT$ is the group of upper triangular matrices. We decompose the matrix $R_{ij}$ of Ricci tensor coordinates with respect to an orthonormal frame fi…

Two regularization techniques improve GCNN explainability and preference from chemists.

Study shows properties of Gromov-Hausdorff limit of frame bundles for non-collapsed manifolds.

We study the holomorphic unitary representations of the Jacobi group based on Siegel-Jacobi domains. Explicit polynomial orthonormal bases of the Fock spaces based on the Siegel-Jacobi disk are obtained. The scalar holomorphic discrete series of the Jacobi group for the Siegel-Jacobi disk is constructed and polynomial …

Batch normalization has become ubiquitous in many state-of-the-art nets. It accelerates training and yields good performance results. However, there are various other alternatives to normalization, e.g. orthonormalization. The objective of this paper is to explore the possible alternatives to channel normalization with…

Entropy formula derived for deep linear networks using geometric analysis.

In the present work we construct a lift of a metric $g$ on a 2-dimensional oriented Riemannian manifold $M$ to a metric $\hat{g}$ on the total space $P$ of the orthonormal frame bundle of $M$. We call this lift the \textit {Wagner lift}. Viktor Vladimirovich Wagner (1908 -1981) proposed a technique to extend a metric d…

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with reproducing kernel Hilbert $C^*$-module (RKHM), which is another generalization of…

The Frenet frame is generally known an orthonormal vector frame for curves. But, it does not always meet the needs of curve characterizations. In this study, with the help of associated curves of any spatial curve we obtained a new orthonormal frame which has the property that the second vector makes a constant angle w…

Higher-dimensional Milnor frames are characterized and contrasted with 3D Heisenberg and 4D nilpotent Lie algebras.

Quasi-orthonormal encoding reduces high dimensionality for categorical data.

We discuss conditions for the integrability of an almost complex structure defined on the total space of an induced Hopf S^3-bundle over a Sasakian manifold . As an application, we obtain an uncountable family of inequivalent complex structures on the Stiefel manifolds of orthonormal 2-frames in C^{n+1}, non compatible…

For any compact Riemannian manifold $(M,g)$ and its heat kernel embedding map $psi_t$ from M into $l^2$ constructed in [BBG], we study the higher derivatives of $psi_t$ with respect to an orthonormal basis at $x$ on $M$. As the heat flow time $t$ goes to 0, it turns out the limiting angles between these derivative vect…

An almost-Riemannian structure on a surface is a generalized Riemannian structure whose local orthonormal frames are given by Lie bracket generating pairs of vector fields that can become collinear. The distribution generated locally by orthonormal frames has maximal rank at almost every point of the surface, but in ge…

We shed new insights on the two commonly used updates for the online $k$-PCA problem, namely, Krasulina's and Oja's updates. We show that Krasulina's update corresponds to a projected gradient descent step on the Stiefel manifold of the orthonormal $k$-frames, while Oja's update amounts to a gradient descent step using…

The paper studies horizontal semimartingales on Riemannian manifolds and their connections to Euclidean spaces.