HaarPooling compresses graphs by Haar transforms, improving graph classification and regression.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically define the graph convolution by the orthonormal basis for the graph Laplacian, they suffer from hig…
Novel Haar-Laplacian for directed graphs enhances spectral graph applications.
This paper proposes a new methodology to compute Value at Risk (VaR) for quantifying losses in credit portfolios. We approximate the cumulative distribution of the loss function by a finite combination of Haar wavelets basis functions and calculate the coefficients of the approximation by inverting its Laplace transfor…
We compute higher moments of the Siegel--Veech transform over quotients of by the Hecke triangle groups. After fixing a normalization of the Haar measure on we use geometric results and linear algebra to create explicit integration formulas which give information about densities of…
We define what it means for a proper continuous morphism between groupoids to be Haar system preserving, and show that such a morphism induces (via pullback) a *-morphism between the corresponding convolution algebras. We proceed to provide a plethora of examples of Haar system preserving morphisms and discuss connecti…
This work proves the asymptotic freeness of layerwise Jacobians in MLPs with Haar orthogonal matrices.
Hyperbolic groups' infinite orbits spread evenly in spaces.
MathNet uses wavelets for graph representation and learning.
Quantum walks blend patterns into splines when averaged.
In this article we propose building general-purpose function approximators on top of Haar Scattering Networks. We advocate that this architecture enables a better comprehension of feature extraction, in addition to its implementation simplicity and low computational costs. We show its approximation and feature extracti…
We compute the Riemannian volume on the moduli space of flat connections on a nonorientable 2-manifold, for a natural class of metrics. We also show that Witten's volume formula for these moduli spaces may be derived using Haar measure, and we give a new proof of Witten's volume formula for the moduli space of flat con…
The aim of this paper is to discuss the use of Haar scattering networks, which is a very simple architecture that naturally supports a large number of stacked layers, yet with very few parameters, in a relatively broad set of pattern recognition problems, including regression and classification tasks. This architecture…
In this letter we exhibit the relation between the isometries of a Riemannian contraction of a sub-Riemannian manifold and those of the sub-Riemannian metric, for to use this relation with two goals: establishing a result about the existence of fixed points of isometries groups; and the other, defining a Multiresolutio…
One way to interpret smoothness of a measure in infinite dimensions is quasi-invariance of the measure under a class of transformations. Usually such settings lack a reference measure such as the Lebesgue or Haar measure, and therefore we can not use smoothness of a density with respect to such a measure. We describe h…
A method based on wavelet transform and genetic programming is proposed for characterizing and modeling variations at multiple scales in non-stationary time series. The cyclic variations, extracted by wavelets and smoothened by cubic splines, are well captured by genetic programming in the form of dynamical equations. …
Quantum neural networks converge to Gaussian processes as they grow.
This paper presents a basic property of region dividing of ReLU (rectified linear unit) deep learning when new layers are successively added, by which two new perspectives of interpreting deep learning are given. The first is related to decision trees and forests; we construct a deep learning structure equivalent to a …
Expected centre of mass for random embeddings is constant.
The amount of data available in the world is growing faster than our ability to deal with it. However, if we take advantage of the internal \emph{structure}, data may become much smaller for machine learning purposes. In this paper we focus on one of the fundamental machine learning tasks, empirical risk minimization (…
The paper proves a distribution claim for neural network Jacobians.
Automatic continuity of polynomial maps and cocycles proved.
The abstract theorem extends a Lie group result to Lie groupoids.
In this paper we discuss general properties of geodesic surfaces that are locally biLipschitz homogeneous. In particular, we prove that they are locally doubling and that there exists a special doubling measure analogous to the Haar measure for locally compact groups.
We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random projections. Our analysis bridges invariant feature learning with kernel methods, as …
Random representations of surface groups approach asymptotic freeness in large limit.
Paper introduces Laplace-HDC for better binary hyperdimensional computing.
We propose a new outline for adaptive dictionary learning methods for sparse encoding based on a hierarchical clustering of the training data. Through recursive application of a clustering method, the data is organized into a binary partition tree representing a multiscale structure. The dictionary atoms are defined ad…
QCNNs avoid barren plateaus, making them trainable.
Improved bounds on moments of word measures on unitary groups.
The paper reformulates U-Nets as wavelet-based models and applies this to hierarchical VAEs.
A well-conditioned Jacobian spectrum has a vital role in preventing exploding or vanishing gradients and speeding up learning of deep neural networks. Free probability theory helps us to understand and handle the Jacobian spectrum. We rigorously show almost sure asymptotic freeness of layer-wise Jacobians of deep neura…
One-bit clustering method for two-component sub-Gaussian mixture models
Pairs of elements in quaternionic hyperbolic space have zero measure of being strongly doubly reversible.
Introduces new algebraic structures for relational groupoids and proves a reduction theorem.
Leighton's graph covering theorem states that a pair of finite graphs with isomorphic universal covers have a common finite cover. We provide a new proof of Leighton's theorem that allows generalizations; we prove the corresponding result for graphs with fins. As a corollary we obtain pattern rigidity for free groups w…
We introduce the concept of Roe C*-algebra for a locally compact groupoid whose unit space is in general not compact, and that is equipped with an appropriate coarse structure and Haar system. Using Connes' tangent groupoid method, we introduce an analytic index for an elliptic differential operator on a Lie groupoid e…
Study proves existence of regions minimizing perimeter in specific geometric structures.
Develops new e-processes and confidence sequences for Gaussian means with unknown variance.
The purpose of this paper is to study the action of the mapping class group on the moduli space of representations of the fundamental group of a non-orientable surface into SU(2). The action is shown to be ergodic with respect to a natural measure. This measure is defined using the push-forward measure associated to a …
New MHSNs extract multiscale features from complex data for robust classification.
We present a powerful new loss function and training scheme for learning binary hash functions. In particular, we demonstrate our method by creating for the first time a neural network that outperforms state-of-the-art Haar wavelets and color layout descriptors at the task of automated scene matching. By accurately rel…
We perform wavelet decomposition of high frequency financial time series into large and small time scale components. Taking the FTSE100 index as a case study, and working with the Haar basis, it turns out that the small scale component defined by most ( 99.6%) of the wavelet coefficients can be neglected for th…
Random Gaussian fields on 4D Riemannian manifolds with conformal invariance.
Let G be a real compact connected simple Lie group, and g its Lie algebra. We study the problem of determining, from root data, when a sum of adjoint orbits in g, or a product of conjugacy classes in G, contains an open set. Our general methods allow us to determine exactly which sums of adjoint orbits in su(m) and pro…
HD algorithm simulates dynamics on random matrix ensembles without generating full matrices.
The paper improves on existing algorithms for minimizing different types of regret in online learning.
The paper proves a unique conformal measure for Anosov groups and shows local mixing.