arXiv research

Paper improves SDR estimation speed and conditions.

SMAVE optimizes SDR by projecting onto a low-dimensional subspace on a Riemannian manifold.

Outer automorphisms of free products are represented by CTs.

AGOP mechanism explains deep neural collapse in neural networks.

In this work, we contribute a new multi-layer neural network architecture named ONCF to perform collaborative filtering. The idea is to use an outer product to explicitly model the pairwise correlations between the dimensions of the embedding space. In contrast to existing neural recommender models that combine user em…

Recursive Feature Machines show grokking in modular arithmetic without neural networks.

This paper aims at achieving a "good" estimator for the gradient of a function on a high-dimensional space. Often such functions are not sensitive in all coordinates and the gradient of the function is almost sparse. We propose a method for gradient estimation that combines ideas from Spall's Simultaneous Perturbation …

Study uses outer metrics for PDE-constrained shape optimization over diffeomorphism group.

We show that the horoboundary of outer space for the Lipschitz metric is a quotient of Culler and Morgan's classical boundary, two trees being identified whenever their translation length functions are homothetic in restriction to the set of primitive elements of $F_N$. We identify the set of Busemann points with the s…

Outer billiards defined on geodesics surfaces in 3D space forms.

The paper shows symmetries of a geometric space for Coxeter groups.

Using the Guirardel-Levitt outer space of a free product, we prove that the outer automorphism group of the outer automorphism group of the universal Coxeter group of rank $n \geq 5$ is trivial, and that it is a cyclic group of order 2 if $n=4$. In addition we prove that the outer automorphism group of the automorphism…

Study embeddings of free group products into automorphism groups.

We consider the problem of minimizing the composition of a smooth (nonconvex) function and a smooth vector mapping, where the inner mapping is in the form of an expectation over some random variable or a finite sum. We propose a stochastic composite gradient method that employs an incremental variance-reduced estimator…

Outer billiards studied in complex hyperbolic plane, proving smooth and symplectic properties.

Outer automorphism group of hyperbolic groups is HHG under certain conditions.

Proves planar Lipschitz critical points of area functional are smooth.

Paper identifies how neural networks learn features.

New insights into optimizing Local SGD's outer optimizer for faster convergence.

In this paper we develop the metric theory for the outer space of a free product of groups. This generalizes the theory of the outer space of a free group, and includes its relative versions. The outer space of a free product is made of $G$-trees with possibly non-trivial vertex stabilisers. The strategies are the same…

Improves MARS for nonparametric multivariate regression with dimension reduction.

The paper studies Einstein-type structures in warped product manifolds.

This paper deals with sparse feature selection and grouping for classification and regression. The classification or regression problems under consideration consists in minimizing a convex empirical risk function subject to an $\ell^1$ constraint, a pairwise $\ell^\infty$ constraint, or a pairwise $\ell^1$ constraint. …

The paper shows that for Coxeter groups, the commensurator of outer automorphisms is rigid.

In this paper, we show that feedforward and recurrent neural networks exhibit an outer product derivative structure but that convolutional neural networks do not. This structure makes it possible to use higher-order information without needing approximations or infeasibly large amounts of memory, and it may also provid…

The study examines how automorphism growth rates of a group can be deduced from its simpler decompositions.

TrIM improves gradient-based dimension reduction and regression.

AGOP from KRR recovers central subspace in fewer samples than needed for prediction.

We prove central limit theorems for the random walks on either the mapping class group of a closed, connected, orientable, hyperbolic surface, or on $\text{Out}(F_N)$, each time under a finite second moment condition on the measure (either with respect to the Teichmüller metric, or with respect to the Lipschitz metric …

We generalise the Karrass-Pietrowski-Solitar and the Nielsen realisation theorems from the setting of free groups to that of free products. As a result, we obtain a fixed point theorem for finite groups of outer automorphisms acting on the relative free splitting complex of Handel--Mosher and on the outer space of a fr…

Let $G=G_1\ast\dots\ast G_k\ast F$ be a countable group which splits as a free product, where all groups $G_i$ are freely indecomposable and not isomorphic to $\mathbb{Z}$, and $F$ is a finitely generated free group. If for all $i\in\{1,\dots,k\}$, both $G_i$ and its outer automorphism group $\text{Out}(G_i)$ satisfy t…

We investigate the combinatorial and geometric properties of automorphism groups of universal right-angled Coxeter groups, which are the automorphism groups of free products of copies of Z_2. It is currently an open question as to whether or not these automorphism groups have non-positive curvature. Analogous to Outer …

The stochastic variance-reduced gradient method (SVRG) and its accelerated variant (Katyusha) have attracted enormous attention in the machine learning community in the last few years due to their superior theoretical properties and empirical behaviour on training supervised machine learning models via the empirical ri…

New method tackles bilevel optimization with polyhedral constraints.

Given a real matrix A with n columns, the problem is to approximate the Gram product AA^T by c << n weighted outer products of columns of A. Necessary and sufficient conditions for the exact computation of AA^T (in exact arithmetic) from c >= rank(A) columns depend on the right singular vector matrix of A. For a Monte-…

Revisits the connection between neural networks and the Kolmogorov-Arnold theorem.

The paper explores how gradient descent trains associative memories, revealing oscillations and convergence issues.

We associate a contractible ``outer space'' to any free product of groups G=G_1*...*G_q. It equals Culler-Vogtmann space when G is free, McCullough-Miller space when no G_i is Z. Our proof of contractibility (given when G is not free) is based on Skora's idea of deforming morphisms between trees. Using the action of Ou…

Optimal preconditioning improves Langevin sampling efficiency.

In this paper we study obstructions to presentability by products for finitely generated groups. Along the way we develop both the concept of acentral subgroups, and the relations between presentability by products on the one hand, and certain geometric and measure or orbit equivalence invariants of groups on the other…

New method tackles nonconvex-nonconcave problems with local KL condition.

We define cusp-decomposable manifolds and prove smooth rigidity within this class of manifolds. These manifolds generally do not admit a nonpositively curved metric but can be decomposed into pieces that are diffeomorphic to finite volume, locally symmetric, negatively curved manifolds with cusps. We prove that the gro…

Let $\mathrm{Out}(F_n)$ be the outer automorphism group of the free group $F_n$. It acts properly on the outer space $X_n$ of marked metric graphs, which is a finite-dimensional infinite simplicial complex with some simplicial faces missing. In this paper, we construct complete geodesic metrics and complete piecewise s…

We study aspherical manifolds that do not support Anosov diffeomorphisms. Weakening conditions of Gogolev and Lafont, we show that the product of an infranilmanifold with finitely many aspherical manifolds whose fundamental groups have trivial center and finite outer automorphism group does not support Anosov diffeomor…

SUSTAIN algorithm tackles stochastic bilevel optimization with near-optimal complexity.

Gradient estimates for a parabolic PDE under Ricci-Bourguignon flow on warped product manifolds.

Let $G$ be a countable group that splits as a free product of groups of the form $G=G_1\ast\dots\ast G_k\ast F_N$, where $F_N$ is a finitely generated free group. We identify the closure of the outer space $P\mathcal{O}(G,\{G_1,\dots,G_k\})$ for the axes topology with the space of projective minimal, \emph{very small} …

We consider a class of a nested optimization problems involving inner and outer objectives. We observe that by taking into explicit account the optimization dynamics for the inner objective it is possible to derive a general framework that unifies gradient-based hyperparameter optimization and meta-learning (or learnin…