The paper examines how the angle between inputs in ReLU networks decreases with depth, impacting training.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Theorems and techniques to form different types of transformationally invariant processing and to produce the same output quantitatively based on either transformationally invariant operators or symmetric operations have recently been introduced by the authors. In this study, we further propose to compose a geared rota…
Deep learning algorithms have increasingly been shown to lack robustness to simple adversarial examples (AdvX). An equally troubling observation is that these adversarial examples transfer between different architectures trained on different datasets. We investigate the transferability of adversarial examples between m…
In this paper we study the right-angled Coxeter groups that acts geometrically on the Salvetti complex of a certain right-angled Artin group, which we refer to as Croke-Kleiner spaces. We prove that any right-angled Coxeter group that acts geometrically on the Croke-Kleiner spaces acts with angles between reflect…
In this paper, we propose a method for image-set classification based on convex cone models, focusing on the effectiveness of convolutional neural network (CNN) features as inputs. CNN features have non-negative values when using the rectified linear unit as an activation function. This naturally leads us to model a se…
Surveying connections between graph combinatorics and algebraic right-angled Artin groups.
The paper explores connections between perimeter, area, and visual angle of convex sets.
We give a new notion of angle in general metric spaces; more precisely, given a triple a points in a metric space , we introduce the notion of angle cone as being an interval , where the quantities are defined in terms o…
This paper explores historical and philosophical aspects of angles and solid angles, inspired by Euler's work.
We obtain the following version of Lidskii theorem. Let L, M, N be p-dimensional subspaces in R^n. Let ψ_j be the angles between L and M, let φ_j be the angles between M and N, and let θ_j be the angles between L and N. Consider the orbit of the vector ψwith respect to permutations of coordinates and inversions of axis…
Model-free reinforcement learning has recently been shown to successfully learn navigation policies from raw sensor data. In this work, we address the problem of learning driving policies for an autonomous agent in a high-fidelity simulator. Building upon recent research that applies deep reinforcement learning to navi…
We first define a complex angle between two oriented spacelike planes in 4-dimensional Minkowski space, and then study the constant angle surfaces in that space, i.e. the oriented spacelike surfaces whose tangent planes form a constant complex angle with respect to a fixed spacelike plane. This notion is the natural Lo…
Most modern neural machine translation (NMT) systems rely on presegmented inputs. Segmentation granularity importantly determines the input and output sequence lengths, hence the modeling depth, and source and target vocabularies, which in turn determine model size, computational costs of softmax normalization, and han…
Smooth approximations bound dihedral angles of convex polytopes.
On a compact Riemannian manifold with boundary, the absolute and relative cohomology groups appear as certain subspaces of harmonic forms. DeTurck and Gluck showed that these concrete realizations of the cohomology groups decompose into orthogonal subspaces corresponding to cohomology coming from the interior and bound…
For a hyperbolic surface S of finite type we consider the set A(S) of angles between closed geodesics on S. Our main result is that there are only finitely many rational multiples of πin A(S).
The paper studies prescribed angle surfaces in Riemannian manifolds with torse-forming vector fields.
We survey the role of right-angled Artin groups in the theory of diffeomorphism groups of low dimensional manifolds. We first describe some of the subgroup structure of right-angled Artin groups. We then discuss the interplay between algebraic structure, compactness, and regularity for group actions on one--dimensional…
The goal of the paper is to study the angle between two curves in the framework of metric (and metric measure) spaces. More precisely, we give a new notion of angle between two curves in a metric space. Such a notion has a natural interplay with optimal transportation and is particularly well suited for metric measure …
We establish the short-time existence of the Ricci flow on surfaces with a finite number of conic points, all with cone angle between 0 and , where the cone angles remain fixed or change in some smooth prescribed way. For the angle-preserving flow we prove long-time existence and convergence. When the Troyanov angl…
We provide geometric conditions on a pair of hyperplanes of a CAT(0) cube complex that imply divergence bounds for the cube complex. As an application, we classify all right-angled Coxeter groups with quadratic divergence and show right-angled Coxeter groups cannot exhibit a divergence function between quadratic and cu…
The study introduces hyperbolic angles in Lorentzian spaces and characterizes curvature bounds.
The paper defines and proves the existence of curves in Riemannian manifolds with prescribed angles to torse-forming vector fields.
Study calibrates high-dimensional binary classifiers using angle between estimator and true weights.
Several dihedral angles prediction methods were developed for protein structure prediction and their other applications. However, distribution of predicted angles would not be similar to that of real angles. To address this we employed generative adversarial networks (GAN). Generative adversarial networks are composed …
We discuss the existence of the angle between two curves in Teichmüller spaces and show that, in any infinite dimensional Teichmüller space, there exist infinitely many geodesic triangles each of which has the same three vertices and satisfies the property that its three sides have the same and arbitrarily given length…
Union of Subspaces (UoS) is a popular model to describe the underlying low-dimensional structure of data. The fine details of UoS structure can be described in terms of canonical angles (also known as principal angles) between subspaces, which is a well-known characterization for relative subspace positions. In this pa…
For a convex domain that is enclosed by the hypersurface of bounded normal curvature, we prove an angle comparison theorem for angles between and geodesic rays starting from some fixed point in , and the corresponding angles for hypersurfaces of constant normal curvature. Also, we obtai…
We prove the existence of a minimal diffeomorphism isotopic to the identity between two hyperbolic cone surfaces and when the cone angles of and are different and smaller than . When the cone angles of are strictly smaller than the ones of , this minimal diffeomorphism is u…
We develop an analogy between right-angled Artin groups and mapping class groups through the geometry of their actions on the extension graph and the curve graph respectively. The central result in this paper is the fact that each right-angled Artin group acts acylindrically on its extension graph. From this result we …
Subspace models play an important role in a wide range of signal processing tasks, and this paper explores how the pairwise geometry of subspaces influences the probability of misclassification. When the mismatch between the signal and the model is vanishingly small, the probability of misclassification is determined b…
Generalizes warped product submersion to conformal case.
A framework visualizes embedding spaces of neural survival analysis models using anchor directions.
We establish a connection between capillary floating in neutral equilibrium and the billiard ball problem. This allows us to reduce the question of floating in neutral equilibrium at any orientation with a prescribed contact angle for infinite homogeneous cylinders to a question about billiard caustics for their orthog…
Quantifying similarity between data objects is an important part of modern data science. Deciding what similarity measure to use is very application dependent. In this paper, we combine insights from systems theory and machine learning, and investigate the weighted cepstral distance, which was previously defined for si…
We consider here a generalization of a well known discrete dynamical system produced by the bisection of reflection angles that are constructed recursively between two lines in the Euclidean plane. It is shown that similar properties of such systems are observed when the plane is replaced by a regular surface in ${\mat…
Constructs minimal capillary cones with specific symmetry and proves their existence and uniqueness.
Study of curves and surfaces in Riemannian spaces making a constant angle with a parallel transported direction.
We give convergence guarantees for estimating the coefficients of a symmetric mixture of two linear regressions by expectation maximization (EM). In particular, we show that the empirical EM iterates converge to the target parameter vector at the parametric rate, provided the algorithm is initialized in an unbounded co…
Mercat preserves angles to create accurate low-dimensional embeddings.
RENNs protect input privacy by rotating d-ary features.
Let be the orbit map for the diagonal action of the torus on the unit poly-disk , is the unit cube. Let be a cubical subcomplex in . The moment-angle complex $\ma(C)$ is a -invariant bigraded cellular decomposition of the subset wit…
A longstanding problem for Deep Neural Networks (DNNs) is understanding their puzzling ability to generalize well. We approach this problem through the unconventional angle of \textit{cognitive abstraction mechanisms}, drawing inspiration from recent neuroscience work, allowing us to define the Cognitive Neural Activat…
In the last decades the estimation of the intrinsic dimensionality of a dataset has gained considerable importance. Despite the great deal of research work devoted to this task, most of the proposed solutions prove to be unreliable when the intrinsic dimensionality of the input dataset is high and the manifold where th…
Deroin and Tholozan's representations are mapped to complex projective space via action-angle coordinates.
We consider a minimal oriented compact real 2n-submanifold M, immersed into a Kaehler-Einstein manifold N of complex dimension 2n, and scalar curvature R. We assume that and F has equal Kaehler angles. Our main result is to prove that, if n = 2 and , then F is either a complex submanif…
Large twist-angle grain boundaries in layered structures are often described by Scherk's first surface whereas small twist-angle grain boundaries are usually described in terms of an array of screw dislocations. We show that there is no essential distinction between these two descriptions and that, in particular, their…
Study angle structures on 3-manifolds, linking to representation theory.