arXiv research

This work proves the asymptotic freeness of layerwise Jacobians in MLPs with Haar orthogonal matrices.

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically define the graph convolution by the orthonormal basis for the graph Laplacian, they suffer from hig…

This paper proposes a new methodology to compute Value at Risk (VaR) for quantifying losses in credit portfolios. We approximate the cumulative distribution of the loss function by a finite combination of Haar wavelets basis functions and calculate the coefficients of the approximation by inverting its Laplace transfor…

The paper proves a distribution claim for neural network Jacobians.

Novel Haar-Laplacian for directed graphs enhances spectral graph applications.

We define what it means for a proper continuous morphism between groupoids to be Haar system preserving, and show that such a morphism induces (via pullback) a *-morphism between the corresponding convolution algebras. We proceed to provide a plethora of examples of Haar system preserving morphisms and discuss connecti…

Deep Graph Neural Networks (GNNs) are useful models for graph classification and graph-based regression tasks. In these tasks, graph pooling is a critical ingredient by which GNNs adapt to input graphs of varying size and structure. We propose a new graph pooling operation based on compressive Haar transforms -- HaarPo…

Hyperbolic groups' infinite orbits spread evenly in spaces.

Quantum neural networks converge to Gaussian processes as they grow.

Quantum walks blend patterns into splines when averaged.

In this article we propose building general-purpose function approximators on top of Haar Scattering Networks. We advocate that this architecture enables a better comprehension of feature extraction, in addition to its implementation simplicity and low computational costs. We show its approximation and feature extracti…

We compute the Riemannian volume on the moduli space of flat connections on a nonorientable 2-manifold, for a natural class of metrics. We also show that Witten's volume formula for these moduli spaces may be derived using Haar measure, and we give a new proof of Witten's volume formula for the moduli space of flat con…

QCNNs avoid barren plateaus, making them trainable.

The aim of this paper is to discuss the use of Haar scattering networks, which is a very simple architecture that naturally supports a large number of stacked layers, yet with very few parameters, in a relatively broad set of pattern recognition problems, including regression and classification tasks. This architecture…

In this letter we exhibit the relation between the isometries of a Riemannian contraction of a sub-Riemannian manifold and those of the sub-Riemannian metric, for to use this relation with two goals: establishing a result about the existence of fixed points of isometries groups; and the other, defining a Multiresolutio…

A well-conditioned Jacobian spectrum has a vital role in preventing exploding or vanishing gradients and speeding up learning of deep neural networks. Free probability theory helps us to understand and handle the Jacobian spectrum. We rigorously show almost sure asymptotic freeness of layer-wise Jacobians of deep neura…

Study proves existence of regions minimizing perimeter in specific geometric structures.

Develops new e-processes and confidence sequences for Gaussian means with unknown variance.

This paper presents a basic property of region dividing of ReLU (rectified linear unit) deep learning when new layers are successively added, by which two new perspectives of interpreting deep learning are given. The first is related to decision trees and forests; we construct a deep learning structure equivalent to a …

Expected centre of mass for random embeddings is constant.

One-bit clustering method for two-component sub-Gaussian mixture models

Automatic continuity of polynomial maps and cocycles proved.

The abstract theorem extends a Lie group result to Lie groupoids.

In this paper we discuss general properties of geodesic surfaces that are locally biLipschitz homogeneous. In particular, we prove that they are locally doubling and that there exists a special doubling measure analogous to the Haar measure for locally compact groups.

Random representations of surface groups approach asymptotic freeness in large $n$ limit.

Paper introduces Laplace-HDC for better binary hyperdimensional computing.

MathNet uses wavelets for graph representation and learning.

Improved bounds on moments of word measures on unitary groups.

We show that for any positive integer $n$, the maps $x \in \mathbb{C}^n \mapsto \{\left|\langle x, z_i \rangle \right|^2\}_{i=1}^{4n} \in \mathbb{R}^{4n}$, where $z_i$ are the columns of four $n\times n$ unitary matrices, are generically injective modulo multiplication by a global phase factor, yielding a family of emb…

The paper reformulates U-Nets as wavelet-based models and applies this to hierarchical VAEs.

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random projections. Our analysis bridges invariant feature learning with kernel methods, as …

Pairs of elements in quaternionic hyperbolic space have zero measure of being strongly doubly reversible.

Introduces new algebraic structures for relational groupoids and proves a reduction theorem.

Leighton's graph covering theorem states that a pair of finite graphs with isomorphic universal covers have a common finite cover. We provide a new proof of Leighton's theorem that allows generalizations; we prove the corresponding result for graphs with fins. As a corollary we obtain pattern rigidity for free groups w…

We introduce the concept of Roe C*-algebra for a locally compact groupoid whose unit space is in general not compact, and that is equipped with an appropriate coarse structure and Haar system. Using Connes' tangent groupoid method, we introduce an analytic index for an elliptic differential operator on a Lie groupoid e…

The purpose of this paper is to study the action of the mapping class group on the moduli space of representations of the fundamental group of a non-orientable surface into SU(2). The action is shown to be ergodic with respect to a natural measure. This measure is defined using the push-forward measure associated to a …

We present a powerful new loss function and training scheme for learning binary hash functions. In particular, we demonstrate our method by creating for the first time a neural network that outperforms state-of-the-art Haar wavelets and color layout descriptors at the task of automated scene matching. By accurately rel…

We compute higher moments of the Siegel--Veech transform over quotients of $SL(2,\mathbb{R})$ by the Hecke triangle groups. After fixing a normalization of the Haar measure on $SL(2,\mathbb{R})$ we use geometric results and linear algebra to create explicit integration formulas which give information about densities of…

Simplifies and optimizes learning from untrusted batches with structure.

We perform wavelet decomposition of high frequency financial time series into large and small time scale components. Taking the FTSE100 index as a case study, and working with the Haar basis, it turns out that the small scale component defined by most ($\simeq$ 99.6%) of the wavelet coefficients can be neglected for th…

Let G be a real compact connected simple Lie group, and g its Lie algebra. We study the problem of determining, from root data, when a sum of adjoint orbits in g, or a product of conjugacy classes in G, contains an open set. Our general methods allow us to determine exactly which sums of adjoint orbits in su(m) and pro…

The paper improves on existing algorithms for minimizing different types of regret in online learning.

One way to interpret smoothness of a measure in infinite dimensions is quasi-invariance of the measure under a class of transformations. Usually such settings lack a reference measure such as the Lebesgue or Haar measure, and therefore we can not use smoothness of a density with respect to such a measure. We describe h…

A method based on wavelet transform and genetic programming is proposed for characterizing and modeling variations at multiple scales in non-stationary time series. The cyclic variations, extracted by wavelets and smoothened by cubic splines, are well captured by genetic programming in the form of dynamical equations. …

The paper proves a unique conformal measure for Anosov groups and shows local mixing.

The amount of data available in the world is growing faster than our ability to deal with it. However, if we take advantage of the internal \emph{structure}, data may become much smaller for machine learning purposes. In this paper we focus on one of the fundamental machine learning tasks, empirical risk minimization (…

Orthogonal random features approximate a Bessel kernel, offering sharper bounds than random Fourier features.

Study convolution of invariant valuations on Lie groups.