Octagon map accelerates diagonal changes algorithm.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New diagonal move simplifies knots and links efficiently.
We define a second-order neural network stochastic gradient training algorithm whose block-diagonal structure effectively amounts to normalizing the unit activations. Investigating why this algorithm lacks in robustness then reveals two interesting insights. The first insight suggests a new way to scale the stepsizes, …
In this paper we show that the matrix of chromatic joins and the Gram matrix of the Temperley-Lieb algebra are similar (after rescaling), with the change of basis given by diagonal matrices.
Noise in linear networks minimizes sharpness and leads to shrinkage-thresholding.
Proposes a method to predict responses from covariates over time.
Existing MAP inference algorithms for determinantal point processes (DPPs) need to calculate determinants or conduct eigenvalue decomposition generally at the scale of the full kernel, which presents a great challenge for real-world applications. In this paper, we introduce a class of DPPs, called BwDPPs, that are char…
Variational Bayesian neural networks combine the flexibility of deep learning with Bayesian uncertainty estimation. However, inference procedures for flexible variational posteriors are computationally expensive. A recently proposed method, noisy natural gradient, is a surprisingly simple method to fit expressive poste…
This paper solves matrix blind joint block diagonalization with noise.
Diagonalizes metrics of 3D Lorentzian manifolds.
Study Ricci vector fields on 2D space with diagonal metrics.
Develops a novel stochastic algorithm for diagonal estimation of large matrices.
Study finds symmetries in a special 3D space with a diagonal metric.
New diagonal knots found with non-torus structure.
We use mathematical induction to prove that the horizontal composition in the class of coherently diagonal complexes is indeed a binary operation. That is to say, the embedding of two coherently diagonal complexes in an alternating planar diagram produces a coherently diagonal complex.
Most known four-dimensional cohomogeneity-one Einstein metrics are diagonal in the basis defined by the left-invariant one-forms, though some essentially non-diagonal ones are known. We consider the problem of explicitly seeking non-diagonal Einstein metrics, and we find solutions which in some cases exhaust the possib…
Given an -gon, the poset of all collections of pairwise non-crossing diagonals is isomorphic to the face poset of some convex polytope called \textit{associahedron}. We replace in this setting the -gon (viewed as a disc with marked points on the boundary) with an arbitrary oriented surface with a number of la…
Equal diagonal energies proven on Liouville surfaces.
Diagonal linear networks converge to lasso regularization path during training.
We show that a basis of a semisimple Lie algebra of compact type, for which any diagonal left-invariant metric has a diagonal Ricci tensor, is characterized by the Lie algebraic condition of being "nice". Namely, the bracket of any two basis elements is a multiple of another basis element. This extends the work of Laur…
We obtain the natural diagonal almost product and locally product structures on the total space of the cotangent bundle of a Riemannian manifold. We find the Riemannian almost product (locally product) and the (almost) para-Hermitian cotangent bundles of natural diagonal lift type. We prove the characterization theorem…
Detects exotic surfaces without smooth invariants, providing first example of knotted RP².
Study grid homology of diagonal knots, finding key terms related to prime factors and decompositions.
Study on stability of non-diagonal Einstein metrics on specific homogeneous spaces.
The author connects Poincaré embeddings to Reidemeister traces and diagonal maps.
Conditions for flat 3-manifolds with diagonal metrics are identified.
Let G be a simply connected, simple, complex Lie group of rank 2. We give explicit Fock-Goncharov coordinates for configurations of triples and quadruples of affine flags in G. We show that the action on triples by orientation preserving permutations corresponds to explicit quiver mutations, and that the same holds for…
Develops efficient quasi-Newton methods for training deep neural networks.
Constructs coordinates to diagonalize Toda flow on matrices with simple spectrum.
Adaptive gradient approaches that automatically adjust the learning rate on a per-feature basis have been very popular for training deep networks. This rich class of algorithms includes Adagrad, RMSprop, Adam, and recent extensions. All these algorithms have adopted diagonal matrix adaptation, due to the prohibitive co…
Paper proposes ABDR for convex subspace clustering with adaptive block diagonal representation.
This paper optimizes diagonal preconditioning to improve matrix condition numbers.
The approximate joint diagonalization of a set of matrices consists in finding a basis in which these matrices are as diagonal as possible. This problem naturally appears in several statistical learning tasks such as blind signal separation. We consider the diagonalization criterion studied in a seminal paper by Pham (…
We prove a number of convexity results for strata of the diagonal pants graph of a surface, in analogy with the extrinsic geometric properties of strata in the Weil-Petersson completion. As a consequence, we exhibit convex flat subgraphs of every possible rank inside the diagonal pants graph.
Classify projective subvarieties in Bogomolov-Guan manifolds using quasi-diagonals.
In this paper, we study deep diagonal circulant neural networks, that is deep neural networks in which weight matrices are the product of diagonal and circulant ones. Besides making a theoretical analysis of their expressivity, we introduced principled techniques for training these models: we devise an initialization s…
The main purpose of this note is to prove that any basis of a nilpotent Lie algebra for which all diagonal left-invariant metrics have diagonal Ricci tensor necessarily produce quite a simple set of structural constants; namely, the bracket of any pair of elements of the basis must be a multiple of some of them and onl…
The main goal of this paper is a calculation of the integral (co)homology of the group of symmetric automorphisms of a free product. We proceed by giving a geometric interpretation of symmetric automorphisms via a moduli space of certain diagrams, which we name cactus products. To describe this moduli space a theory of…
We make a minimal, but very effective alteration to the VAE model. This is about a drop-in replacement for the (sample-dependent) approximate posterior to change it from the standard white Gaussian with diagonal covariance to the first-order autoregressive Gaussian. We argue that this is a more reasonable choice to ado…
We prove a new off-diagonal asymptotic of the Bergman kernels associated to tensor powers of a positive line bundle on a compact Kähler manifold. We show that if the Kähler potential is real analytic, then the Bergman kernel accepts a complete asymptotic expansion in a neighborhood of the diagonal of shrinking size $k^…
We introduce the Kronecker factored online Laplace approximation for overcoming catastrophic forgetting in neural networks. The method is grounded in a Bayesian online learning framework, where we recursively approximate the posterior after every task with a Gaussian, leading to a quadratic penalty on changes to the we…
Study of symmetries in a 2D space with specific metric properties.
Defines tensor products for A-infinity structures using diagonals.
In this paper we show that the non-alternating torus knots are homologically thick, i.e. that their Khovanov homology occupies at least three diagonals. Furthermore, we show that we can reduce the number of full twists of the torus knot without changing certain part of its homology, and consequently, we show that there…
New method improves deep learning model robustness and accuracy for long sequences.
New theory allows simultaneous block-diagonalization of commuting operator fields.
We give a quadratic lower bound on the dimension of the space of conjugacy classes of subgroups of SL(n,R) that are limits under conjugacy of the diagonal subgroup. We give the first explicit examples of abelian n-1 dimensional subgroups of SL(n,R) which are not such a limit, however all such abelian groups are limits …
Diagonal metrics solve Hermitian-Einstein equations for decomposed Higgs bundles.