arXiv research

The paper sets limits for GNNs solving PDEs to avoid under-reaching phenomenon.

EEGNN improves graph neural networks by enhancing graph structure.

This paper examines properties of feedforward graphs to improve neural network performance.

The plateau phenomenon, wherein the loss value stops decreasing during the process of learning, has been reported by various researchers. The phenomenon is actively inspected in the 1990s and found to be due to the fundamental hierarchical structure of neural network models. Then the phenomenon has been thought as inev…

TGR rewires temporal graphs to improve TGNN performance.

The two phase behavior in financial markets actually means the bifurcation phenomenon, which represents the change of the conditional probability from an unimodal to a bimodal distribution. In this paper, the bifurcation phenomenon in Hang-Seng index is carefully investigated. It is observed that the bifurcation phenom…

The paper explains how neural networks learn less salient frequency components during training.

In our previous work "Characterization of certain homorphic geodesic cycles on Hermitian locally symmetric manifolds of the noncompact type" in "Modern methods in Complex Analysis" Annals of Math. Studies 138 (1995) 85-118, we formulated a conjecture: the so called "gap phenomenon". The purpose of the article is two-fo…

Paper derives explicit expression of Alekseev-Meinrenken diffeomorphism.

Study reveals GAGA phenomenon in Poisson cohomology for plane structures with isolated singularities.

Study gap phenomenon in flat manifolds with Ricci curvature.

New transport method simplifies cutoff phenomenon for Markov processes.

Suppose that two large, multi-dimensional data sets are each noisy measurements of the same underlying random process, and principle components analysis is performed separately on the data sets to reduce their dimensionality. In some circumstances it may happen that the two lower-dimensional data sets have an inordinat…

Representation stability is a phenomenon whereby the structure of certain sequences $X_n$ of spaces can be seen to stabilize when viewed through the lens of representation theory. In this paper I describe this phenomenon and sketch a framework, the theory of FI-modules, that explains the mechanism behind it.

New cutoff phenomenon found for geodesic paths on hyperbolic manifolds.

Cohen et al. (2021) show GD trajectories align on a bifurcation diagram.

New phenomenon found in Gothen components' boundary.

It was shown by Fomin, Shapiro and Thurston that some cluster algebras arise from orientable surfaces. Subsequently, Dupont and Palesi extended this construction to non-orientable surfaces. We link this framework to Lam and Pylyavskyy's Laurent phenomenon algebras, showing that both orientable and non-orientable unpunc…

For the supervised least squares classifier, when the number of training objects is smaller than the dimensionality of the data, adding more data to the training set may first increase the error rate before decreasing it. This, possibly counterintuitive, phenomenon is known as peaking. In this work, we observe that a s…

Estimates scalar curvature without nonnegativity, showing gap phenomenon on manifolds.

Artificial neural networks (ANNs) suffer from catastrophic forgetting when trained on a sequence of tasks. While this phenomenon was studied in the past, there is only very limited recent research on this phenomenon. We propose a method for determining the contribution of individual parameters in an ANN to catastrophic…

Let $X$ be a compact complex manifold, consider a small deformation $φ: \mathcal{X} \to B$ of $X$, the dimension of the Dolbeault cohomology groups $H^q(X_t,Ω_{X_t}^p)$ may vary under this defromation. This paper will study such phenomenons by studying the obstructions to deform a class in $H^q(X,Ω_X^p)$ with the param…

This paper identifies and analyzes the Epochal Sawtooth Phenomenon in training loss curves.

When looking at Bott's original proof of his periodicity theorem for the stable homotopy groups of the orthogonal and unitary groups, one sees in the background a differential geometric periodicity phenomenon. We show that this geometric phenomenon extends to the standard inclusion of the orthogonal group into the unit…

Baker and Riley proved that a free group of rank 3 can be contained in a hyperbolic group as a subgroup for which the Cannon-Thurston map is not well-defined. By using their result, we show that the phenomenon occurs for not only a free group of rank 3 but also every non-elementary hyperbolic group. In fact it is shown…

New arithmetic phenomenon 'murmurations' detected using AI.

Let $X$ be a compact complex manifold, consider a small deformation $φ: \mathcal{X} \to B$ of $X$, the dimensions of the cohomology groups of tangent sheaf $H^q(X_t,\mathcal{T}_{X_t})$ may vary under this deformation. This paper will study such phenomenons by studying the obstructions to deform a class in $H^q(X,\mathc…

Categorifies Stokes coefficients in Chern-Simons theory models.

The level curves of an analytic function germ almost always have bumps at unexpected points near the singularity. This profound discovery of N. A'Campo is fully explored in this paper for $f(z,w)\in \C\{z,w\}$, using the Newton-Puiseux infinitesimals and the notion of gradient canyon. Equally unexpected is the Dirac ph…

Study on model collapse in regression models, proposing a mitigation strategy.

Study on rapid policy changes in reinforcement learning.

Meta learning works well with overparameterized models, a phenomenon called 'benign overfitting'.

Under-parameterization hinders deep RL's efficiency.

Consider a set represented by an inequality. An interesting phenomenon which occurs in various settings in mathematics is that the interior of this set is the subset where strict inequality holds, the boundary is the subset where equality holds, and the closure of the set is the closure of its interior. This paper disc…

Accuracy on in-distribution data correlates with out-of-distribution data when data is noisy or contains nuisance features.

Deep neural networks have been shown to suffer from a surprising weakness: their classification outputs can be changed by small, non-random perturbations of their inputs. This adversarial example phenomenon has been explained as originating from deep networks being "too linear" (Goodfellow et al., 2014). We show here t…

Paper warns of metric deformation in manifold learning, leading to incorrect answers.

Let $(M,g)$ be a compact manifold and let $-Δφ_k = λ_k φ_k$ be the sequence of Laplacian eigenfunctions. We present a curious new phenomenon which, so far, we only managed to understand in a few highly specialized cases: the family of functions $f_N:M \rightarrow \mathbb{R}_{\geq 0}$ $$ f_N(x) = \sum_{k \leq N}{ \frac{…

Study shows rigidity of polyhedrons in hyperbolic spaces.

It was shown by Fock, Goncharov and Fomin, Shapiro, Thurston that some cluster algebras arise from triangulated orientable suraces. Subsequently Dupont and Palesi generalised this construction to include unpunctured non-orientable surfaces, giving birth to quasi-cluster algebras. Previously we linked this framework to …

Hybrid regularization avoids double descent in random feature models.

This work reveals how label noise can cause a final ascent in neural network performance curves.

Deep neural networks can grok better than shallow ones, showing multi-stage generalization.

We present a dynamical system framework for understanding Nesterov's accelerated gradient method. In contrast to earlier work, our derivation does not rely on a vanishing step size argument. We show that Nesterov acceleration arises from discretizing an ordinary differential equation with a semi-implicit Euler integrat…

Optimal regularization can prevent the double descent phenomenon in learning models.

Study on Neural Collapse limits in deep learning.

Let $X$ be a compact complex manifold and $E$ be a holomorphic vector bundle on $X$. Given a deformation $(\mathcal{X},\mathcal{E})$ of the pair $(X,E)$ over a small polydisk $B$ centered at the origin, we study the jumping phenomenon of the cohomology groups $\dim_{\mathbb{C}}H^q(\mathcal{X}_t,\mathcal{E}_t)$ near $t …

We show that there are homotopy equivalences $h:N\to M$ between closed manifolds which are induced by cell-like maps $p:N\to X$ and $q:M\to X$ but which are not homotopic to homeomorphisms. The phenomenon is based on construction of cell-like maps that kill certain $\mathbb L$-classes. The image space in these construc…