RNNs solve modular addition tasks using low rank and sparse Fourier structures.
problem Solving modular addition tasks with recurrent neural networks.
method Identified low rank structures and sparse Fourier representations in RNN weights.
result RNNs robust to removing individual frequencies but degrade with more ablation.
Neural networks learn modular arithmetic but not all, extending known solutions to generalize.
problem Neural networks struggle with modular arithmetic, especially for polynomials.
method Developed analytical solutions for MLP networks to learn modular addition and multiplication, then combined these solutions to generalize on arbitrary modular polynomials.
result Neural networks can learn and generalize solutions to modular polynomials, supporting the hypothesis that some polynomials are learnable.
Theoretical analysis explains why models generalize after overfitting in modular addition.
problem Understanding why models generalize after overfitting in modular addition.
method Theoretical analysis and gradient descent behavior of two-layer quadratic networks and Transformers.
result Two-layer quadratic networks and simple Transformers generalize well after initially overfitting, indicating grokking.
Sine activation functions enable two-layer neural networks to learn modular addition more efficiently.
problem Learning modular addition with two-layer neural networks.
method Introduced and analyzed sine activation functions, providing theoretical and empirical evidence.
result Sine activation functions allow for constant-width network realizations of modular addition, whereas ReLU networks require linear width scaling.
We explain how neural networks learn to solve modular addition tasks.
problem How two-layer neural networks learn to solve modular addition tasks.
method Formalized a diversification condition during training, proving it allows the network to approximate the correct logic for modular addition.
result Neural networks can robustly identify the correct sum through phase symmetry and frequency diversification.
Study shows how transformers learn to combine simple tasks into complex ones.
problem Understanding how transformers learn to perform complex tasks not seen during training.
method Controlled setting involving variable assignment and modular addition; partitioned training data analysis.
result Small transformers can generalize to unseen combinations of variables and numbers.
Introduces modular q-holonomic modules to solve q-difference equations.
problem Solving q-difference equations in quantum invariants and Chern-Simons theory. method Defines modular q-holonomic modules with improved analyticity properties. result Modular q-holonomic modules explain structural properties of quantum invariants and Chern-Simons theory. Using an intuitive concept of what constitutes a meaningful community, a novel metric is formulated for detecting non-overlapping communities in undirected, weighted heterogeneous networks. This metric, modularity density, is shown to be superior to the versions of modularity density in present literature. Compared to …
Modular knots follow Chebotarev law from surgeries on hyperbolic fibered links.
problem Understanding knots that behave like prime numbers.
method Analyzing planetary links and surgeries on hyperbolic fibered links in S3. result Modular knots around torus knots Ka,b follow the Chebotarev law. New method uses hyperspherical geometry to improve community detection.
problem Improving community detection methods in network analysis.
method Mapping networks to points on a hypersphere, then projecting to clustering vectors.
result Modularity maximization is equivalent to minimizing angular distance on the hypersphere.
The notion of causality is used in many situations dealing with uncertainty. We consider the problem whether causality can be identified given data set generated by discrete random variables rather than continuous ones. In particular, for non-binary data, thus far it was only known that causality can be identified exce…
Modular categories are a well-known source of quantum 3-manifold invariants. In this paper we study structures on modular categories which allow to define refinements of quantum 3-manifold invariants involving cohomology classes or generalized spin and complex spin structures. A crucial role in our construction is play…
Study explores how neural networks and Transformers learn modular arithmetic with multiple inputs.
problem Understanding how neural networks and Transformers learn modular arithmetic with multiple inputs.
method Analytical characterization of features learned by neural networks and Transformers, focusing on margin maximization and Fourier spectra.
result Neural networks and Transformers require a minimum neuron count of \( m \geq 2^{2k-2} \cdot (p-1) \) to solve modular addition problems with \( k \) inputs and modulus \( p \).
Unified policy controls diverse agents through modular neural networks.
problem Learning control policies for various agent morphologies.
method Shared Modular Policies (SMP) with decentralized control and message passing.
result A single modular policy controls multiple agent morphologies.
Study geodesics in curved spaces, counts ambiguous paths, confirms number theory conjectures.
problem Counting ambiguous geodesics in curved spaces.
method Asymptotic formula for common perpendiculars in negatively curved spaces, applying to modular orbifolds and number fields.
result Confirms and extends Motohashi's conjecture on binary additive divisor problem.
modAL is a modular active learning framework for Python, aimed to make active learning research and practice simpler. Its distinguishing features are (i) clear and modular object oriented design (ii) full compatibility with scikit-learn models and workflows. These features make fast prototyping and easy extensibility p…
We introduce SLM Lab, a software framework for reproducible reinforcement learning (RL) research. SLM Lab implements a number of popular RL algorithms, provides synchronous and asynchronous parallel experiment execution, hyperparameter search, and result analysis. RL algorithms in SLM Lab are implemented in a modular w…
We use modified traces to renormalize Lyubashenko's closed 3-manifold invariants coming from twist non-degenerate finite unimodular ribbon categories. Our construction produces new topological invariants which we upgrade to 2+1-TQFTs under the additional assumption of factorizability. The resulting functors provide mon…
A new method simplifies sampling from complex distributions without using diffusions.
problem Sampling from complex, high-dimensional distributions efficiently.
method Reduces sampling to solving a sequence of 'nice' sampling problems using SLC distributions.
result Shows how to traverse backwards paths using high-accuracy routines for SLC distributions.
Defines new two-variable elliptic genera for manifolds and derives modular forms.
problem Develops new elliptic genera for manifolds.
method Introduces and defines new two-variable elliptic genera for manifolds and derives their properties.
result Derives modular forms from the elliptic genera.
R package for counterfactual explanation methods.
problem Lack of unified interfaces for counterfactual explanation methods.
method Developed a modular R6-based interface for three existing counterfactual methods and proposed extensions.
result Comparison of implemented methods' quality and runtime behavior.
Inferencing with network data necessitates the mapping of its nodes into a vector space, where the relationships are preserved. However, with multi-layered networks, where multiple types of relationships exist for the same set of nodes, it is crucial to exploit the information shared between layers, in addition to the …
A new robust prefix-tuning framework improves model robustness against adversarial attacks.
problem Lack of robustness in prefix-tuning for adversarial attacks.
method Leveraging layerwise activations of pretrained models for additional prefix finetuning during the test phase.
result Framework substantially improves robustness over strong baselines while maintaining comparable accuracy on clean texts.
NACs learn modular neural architectures without domain knowledge.
problem Jointly learn module configuration and execution without domain knowledge.
method Jointly trains two systems: module configuration and execution.
result Improves low-shot adaptation and OOD robustness.
Motivated by ideas from string theory and quantum field theory new invariants of knots and 3-dimensional manifolds have been constructed from complex algebraic structures such as Hopf algebras (Reshetikhin and Turaev), monoidal categories with additional structure (Turaev and Yetter), and modular functors (Walker and K…
We find and propose an explanation for a large variety of modularity-related symmetries in problems of 3-manifold topology and physics of 3d N=2 theories where such structures a priori are not manifest. These modular structures include: mock modular forms, SL(2,Z) Weil representations, quantum mo…
Researchers found the global topology of the Eisenstein-Picard modular surface.
problem Understanding the global topology of the Eisenstein-Picard modular surface.
method Quotient space of the complex hyperbolic plane by the modular group.
result Determined the global topology of the Eisenstein-Picard modular surface as a 4-orbifold.
Study modular surfaces in Lorentz-Minkowski 3-space, classifying and analyzing their curvature and applications.
problem Understanding the curvature properties of modular surfaces in Lorentz-Minkowski space.
method Analyzing the sign of Gaussian and mean curvature, classifying surfaces, and applying to conformal field theories.
result Complete classification of zero Gaussian curvature modular surfaces and non-existence of non-planar maximal modular surfaces.
Modular neural networks generalize better with less data.
problem Theoretical and practical understanding of how modularity improves neural network generalization.
method Theoretical analysis of sample complexity, development of a novel learning rule.
result Modular networks require fewer samples to generalize compared to nonmodular networks, especially in high-dimensional tasks.
Study modular forms over Γ^0(2) and anomaly cancellation formulas.
problem Anomaly cancellation formulas for modular forms over Γ^0(2).
method Study and analysis of modular forms over Γ^0(2).
result Anomaly cancellation formulas derived for modular forms over Γ^0(2).
Unified approach to invariants in equivariant geometry.
problem Constructing invariants in G-equivariant birational geometry. method Combining atom theory and modular symbols.
result Developed new geometric invariants for orbifolds and surfaces.
Our aim is to introduce and advocate non-Σ (non-symmetric) modular operads. While ordinary modular operads were inspired by the structure of the moduli space of stable complex curves, non-Σ modular operads model surfaces with open strings outputs. An immediate application of our theory is a short proof that the mod…
Fuchsian groups with a modular embedding have the richest arithmetic properties among non-arithmetic Fuchsian groups. But they are very rare, all known examples being related either to triangle groups or to Teichmueller curves. In Part I of this paper we study the arithmetic properties of the modular embedding and deve…
Improved algorithm for modular links provides upper volume bounds.
problem Understanding the geometry of modular links and Lorenz links.
method Bunch algorithm to study modular links and provide upper volume bounds.
result First upper volume bound independent of word exponents and quadratic in braid index.
Geodesics on modular surface yield arithmetic 3-manifolds.
problem Understanding arithmetic properties of modular surfaces.
method Constructing geodesics and analyzing their lifts.
result Complements of canonical lifts are arithmetic 3-manifolds.
We introduce the notion of the modular class of a Lie algebroid equipped with a Nambu structure. In particular, we recover the modular class of a Nambu-Poisson manifold M with its Nambu tensor Λ as the modular class of the tangent Lie algebroid TM with Nambu structure Λ. We show that many known properties of th…
New modular forms for anomaly cancellation formulas on any dimensional manifolds.
problem Constructing new modular forms for anomaly cancellation formulas.
method Using E8 bundles, constructing modular forms on any dimensional manifolds. result Derived new anomaly cancellation formulas and applications.
Quantum modularity proved for SU(2) TQFT signature on genus 2 surfaces.
problem Proving quantum modularity of SU(2) TQFT signature for genus 2 surfaces.
method Using quantum modularity of generalized Dedekind sums associated with modular forms and trigonometric sum expressions.
result Quantum modularity of SU(2) TQFT signature on genus 2 surfaces proved.
Motivated by a question of Hirzebruch on the possible topological types of cusp cross-sections of Hilbert modular varieties, we give a necessary and sufficient condition for a manifold M to be diffeomorphic to a cusp cross-section of a Hilbert modular variety. Specialized to Hilbert modular surfaces, this proves that e…
Study of q-rationals and their geometric properties, including deformed Farey triangulation and Springborn operations.
problem Geometry of q-rationals and their properties. method Construction and analysis of deformed Farey triangulation and deformed modular surface; definition and study of Springborn operations.
result Derivation of a formula for the q-deformed midpoint and new q-deformation of Markov numbers. Countable modular groups found on surfaces with infinite type.
problem Finding modular groups of infinite type surfaces.
method Proving countable modular groups for orientable infinite type surfaces.
result Every orientable infinite type surface has a countable modular group.
Quantum modularity proven for specific theta series.
problem Proving quantum modularity for partial theta series with periodic coefficients.
method Explicit proof using Kontsevich-Zagier series and colored Jones polynomials.
result Kontsevich-Zagier series is a weight 3/2 quantum modular form.
The paper introduces elliptic quasi-modular forms via moduli spaces.
problem Developing a theory of elliptic quasi-modular forms.
method Using moduli spaces and the Gauss-Manin connection.
result Presented a succinct theory of elliptic quasi-modular forms.
In this paper the exact linear relation between the leading eigenvectors of the modularity matrix and the singular vectors of an uncentered data matrix is developed. Based on this analysis the concept of a modularity component is defined, and its properties are developed. It is shown that modularity component analysis …
Study Alexander polynomials of modular knots, revealing finite and infinite coefficient properties.
problem Investigate Alexander polynomials of modular knots.
method Use Burau representation and geometric SL2(Z)-invariants. result Alexander polynomials of modular knots have both finite and infinite coefficient properties.
Sharp lower bounds for modular invariants and Dehn twist coefficients in genus 2 and 3.
problem Finding sharp lower bounds for modular invariants and Dehn twist coefficients.
method Analyzing the relation between fractional Dehn twists and modular invariants, classifying pseudo-periodic maps, and proving rigidity properties.
result Sharp lower bounds for modular invariants and Dehn twist coefficients in genus 2 and 3.
This paper develops the exact linear relationship between the leading eigenvector of the unnormalized modularity matrix and the eigenvectors of the adjacency matrix. We propose a method for approximating the leading eigenvector of the modularity matrix, and we derive the error of the approximation. There is also a comp…
Constructs modular forms and proves divisibility results for odd-dimensional manifolds.
problem Constructing modular forms over specific groups and proving divisibility results.
method SL(2, Z) modular forms and Witten genus in odd dimensions.
result Obtained divisibility results of index of Toeplitz operators on spin and spin^c manifolds.