New algorithm reduces communication bandwidth for large-scale deep learning training.
problem Efficiently compressing gradients for ring all-reduce in large-scale clusters.
method Importance weighted pruning based on gradient and parameter size.
result Achieved significant gradient compression ratios (64X and 58.8X) on AlexNet and ResNet50.
GradiVeQ reduces CNN training time by 50% with 5X faster gradient aggregation.
problem Significant communication costs in gradient aggregation for distributed CNN training.
method GradiVeQ uses PCA to vector quantize gradients for direct RAR aggregation.
result GradiVeQ reduces wall-clock gradient aggregation time by more than 5X.
New research shows sparse topologies can lead to faster convergence in distributed optimization.
problem The impact of worker communication topology on convergence speed in distributed optimization.
method Consensus-based distributed optimization methods with local averaging and correction based on local data.
result Sparse topologies can lead to faster convergence in distributed optimization without communication delays.
Paper discusses optimizing deep learning models for supercomputers.
problem Training deep learning models at high petaFLOPS scale.
method Three systems-related optimizations: distributed batch normalization, input pipeline, and 2-D torus all-reduce.
result Trained ResNet-50 on ImageNet to 76.3% accuracy in 2.2 minutes.
This paper surveys distributed training techniques for deep learning models.
problem Substantial compute needed for training deep learning models.
method Exploration of various algorithms and techniques for distributed training.
result Recent advancements have reduced training time from weeks to minutes.
DS-Sync improves distributed DNN training efficiency by 94% with minimal accuracy loss.
problem Network bottlenecks in distributed DNN training.
method Divide workers into non-overlapping groups for independent synchronization, then shuffle workers among groups iteratively.
result DS-Sync achieves up to 94% improvement in training time with minimal accuracy loss.
Elastic Gossip distributes neural network training using gossip-like protocols.
problem Distributing neural network training across heterogeneous environments.
method Pairwise-communication using Gossip-like protocols, building on Elastic Averaging SGD.
result Elastic Gossip performs better than Gossiping SGD in experiments, but hyper-parameter search may yield better configurations.
The paper explores zero-divisors and idempotents in quandle rings, proving their absence in certain cases.
problem Understanding zero-divisors and idempotents in quandle rings.
method Development of quandle rings theory, definition of orderability, computation of idempotents, and analysis of automorphism groups.
result Quandle rings of left or right orderable quandles with semi-latin structure have no zero-divisors.
Paper proves rigidity of spherical ring patterns on surfaces.
problem Proving rigidity of spherical orthogonal ring patterns on closed surfaces.
method Modification of combinatorial total geodesic curvature and variational principles.
result Rigidity of spherical orthogonal ring patterns on closed surfaces proved.
Lie-Rinehart algebras over C∞-rings defined and studied.
problem Defining and studying Lie-Rinehart algebras over C∞-rings. method Defining Lie-Rinehart algebras over C∞-rings and showing their relationship with Poisson C∞-rings. result A natural Poisson bracket on the C∞-ring associated with a Lie-Rinehart algebra over a C∞-ring. A new invariant of Poisson manifolds, a Poisson K-ring, is introduced. Hypothetically, this invariant is more tractable than such invariants as Poisson (co)homology. A version of this invariant is also defined for arbitrary algebroids. Basic properties of the Poisson K-ring are proved and the Poisson K-rings are calcul…
Investigates differential smoothness of 3D skew polynomial rings.
problem Differential smoothness of 3D skew polynomial rings.
method Analyzes Bell and Smith's characterization of 3D skew polynomial rings.
result Provides insights into the differential smoothness of these rings.
We define a notion of stability for chiral ring of four dimensional N=1 theory by introducing test chiral rings and generalized a maximization. We conjecture that a chiral ring is the chiral ring of a superconformal field theory if and only if it is stable. We then study N=1 field theory derived from D3 branes probing …
A classical theorem due to Quillen (1969) identifies the unitary bordism ring with the Lazard ring, which classifies the universal one-dimensional commutative formal group law. We prove an equivariant generalization of this result by identifying the homotopy theoretic Z/2-equivariant unitary bordism ring, in…
The paper examines differential smoothness in skew PBW extensions over polynomial rings.
problem Differential smoothness in skew PBW extensions over polynomial rings.
method Investigation of skew PBW extensions over commutative polynomial rings.
result Results on differential smoothness for skew PBW extensions over polynomial rings.
Criteria for smoothness of ambiskew polynomial rings.
problem Smoothness of ambiskew polynomial rings.
method Determined sufficient criteria for differential smoothness.
result Criteria for differential smoothness of ambiskew polynomial rings.
This paper calculates the skein algebra of the Borromean rings complement.
problem Calculating the skein algebra of the Borromean rings complement.
method Using the skein algebra definition and character variety, the polynomial ring quotient is determined.
result An explicit formula for the skein algebra of the Borromean rings complement is provided.
Non-Euclidean number rings have non-integral Steinberg modules.
problem Characterizing when Steinberg modules are generated by integral elements.
method Analyzing special linear groups over non-Euclidean imaginary number rings.
result Steinberg modules are not generated by integral elements in non-Euclidean rings.
The paper explores idempotents in quandle rings and their connections to quandle coverings.
problem Understanding idempotents in quandle rings and their relation to quandle coverings.
method Investigation of idempotents in quandle rings, proving properties of idempotents in free products and unions of quandles.
result Integral quandle rings of quandles of finite type that are non-trivial coverings over nice base quandles admit infinitely many non-trivial idempotents.
Defines vector fields and differential forms on local C-infinity-ringed spaces.
problem No specific problem stated; focuses on mathematical definitions.
method Defines tangent sheaf, contractions, Lie derivatives, and proves Cartan equations.
result Standard Cartan calculus equations hold for local C-infinity-ringed spaces.
Researchers found only one hyperbolic structure for Borromean rings.
problem Characterizing hyperbolic structures in knot complements.
method Analyzing the fundamental group of the Borromean rings' complement and its representations in PSL(2,C).
result Borromean rings admit exactly one hyperbolic structure.
Study on Gauss map surfaces in 3D space, focusing on anchor rings.
problem Classifying finite type Gauss map surfaces in Euclidean 3-space.
method Investigating a subclass of tubes, anchor rings, and analyzing their Gauss map properties.
result Anchor rings are of infinite type Gauss map.
Global group laws connect equivariant bordism rings to formal group laws.
problem Establishing connections between equivariant bordism rings and formal group laws.
method Global homotopy theory framework; proving isomorphisms and universal properties.
result Equivariant bordism rings are isomorphic to Lazard rings for abelian Lie groups.
New argument for 3-manifold cohomology with F2 coefficients.
problem Characterization of 3-manifold cohomology rings with F2 coefficients. method New argument based on Postnikov's 1948 characterization using intersection rings.
result A new proof for the characterization of 3-manifold cohomology rings.
Paper computes hyperbolic structure of Borromean rings complement.
problem Computing hyperbolic structures for link complements.
method Classical construction of Thurston's sense.
result Exact computation of hyperbolic structure for Borromean rings.
New hyperbolic manifolds found with same trace ring.
problem Finding non-commensurable hyperbolic manifolds with identical trace rings.
method Proved existence of infinitely many non-commensurable manifolds with same ambient group and trace ring.
result Infinitely many non-commensurable hyperbolic manifolds with the same ambient group and trace ring.
We calculate the intersection ring of three-dimensional graph manifolds with rational coefficients and give an algebraic characterization of these rings when the manifold's underlying graph is a tree. We are able to use this characterization to show that the intersection ring obstructs arbitrary three-manifolds from be…
Homological algebra used to study local equivalence of complex rings.
problem Local equivalence of bounded complexes over polynomial rings.
method Homological algebra approach
result Results have been proved in many places in the literature.
In this paper we compute a presentation for the group of ring motions of the split union of a Hopf link with Euclidean components and a Euclidean circle. A key part of this work is the study of a short exact sequence of groups of ring motions of general ring links in R3. This sequence allowed us to build th…
IntSGD compresses SGD gradients without floats, converging as SGD.
problem Efficiently compressing stochastic gradients in distributed SGD.
method Adaptive integer compression of gradients, estimating scaling adaptively.
result IntSGD matches SGD's iteration complexity for convex and non-convex functions.
Study introduces dynamical ideals for non-commutative rings and classifies knots and links.
problem Classifying surface knots and links in smooth 4-manifolds.
method Introduced dynamical analog of prime ideals for non-commutative rings and proved a factorization theorem.
result Classified surface knots and links in smooth 4-manifolds.
PowerSGD compresses gradients for faster distributed optimization.
problem Communication bottleneck in data-parallel distributed optimization.
method Low-rank gradient compressor based on power iteration.
result Achieves test performance on par with SGD and consistent speedups.
We show that solutions of Thurston equation on triangulated 3-manifolds in a commutative ring carry topological information. We also introduce a homogeneous Thurston equation and a commutative ring associated to triangulated 3-manifolds.
We build extensions of the arc rings, relate their centers to the cohomology rings of the Springer varieties, and categorify all level two representations of quantum sl(N).
Study Coxeter groups over fusion rings and their geometric realisations.
problem Understanding Coxeter groups and their embeddings.
method Investigate faithful realisations and Vinberg systems.
result Induce embeddings of hyperplane complements.
Differential K-theory gets a λ-ring structure.
problem Establishing a λ-ring structure in differential K-theory. method Splitting principle for differential K-theory, Adams operations construction.
result Differential K0-ring admits a λ-ring structure. Division algorithm for surface group rings yields standard complexes and cohomological dimensions.
problem Understanding cohomological dimensions of surface group actions.
method Division algorithm for group rings of surface groups.
result Some 2-complexes with surface fundamental groups are standard.
New Frobenius manifold structures found on Dicyclic group orbits.
problem Finding Frobenius manifold structures on orbits spaces of Dicyclic groups.
method Applying Dubrovin's method to Dicyclic groups.
result Dicyclic group orbits spaces acquire two Frobenius manifold structures.
We view strict ring spectra as generalized rings. The study of their algebraic K-theory is motivated by its applications to the automorphism groups of compact manifolds. Partial calculations of algebraic K-theory for the sphere spectrum are available at regular primes, but we seek more conceptual answers in terms of lo…
The paper optimizes dynamic scheduling for ring architectures in deep learning training.
problem Optimizing deep learning training times with ring architectures.
method Formulated a non-convex, non-linear, NP-hard integer programming problem and developed a doubling heuristic.
result Dynamic scheduling can significantly reduce job completion times in ring architectures.
The paper explains the topological origin of the distinction between incidence theorems over division rings and fields.
problem Understanding the distinction between incidence theorems over division rings and fields.
method Extending the surface-graph approach to noncommutative settings, the paper analyzes the topological properties of graphs embedded on surfaces of different genera.
result Theorems associated with graphs on the sphere hold over any division ring, while those on surfaces of positive genus typically hold only if the ground ring is a field.
A C-infinity ring is a set equipped with n-ary operations corresponding to smooth n-ary functions on the real line (satisfying natural axioms). We prove that the cosimplicial abelian group associated to the de Rham complex of Euclidean space has the structure of a cosimplicial C-infinity ring. We also analyse the notio…
Explains the Borromean rings, icosahedron, and Poincaré homology sphere.
problem Exploring the relationship between Borromean rings, icosahedron, and Poincaré homology sphere.
method Introduction of topological concepts and geometric construction of icosahedral compound of octahedra.
result Proofs about the orientation-preserving symmetry group of an icosahedron and the linked nature of Borromean rings.
Generalizes cohomology ring result for combinatorial line arrangements.
problem Cohomology ring of boundary manifold for combinatorial line arrangements.
method Introduced boundary manifold, constructed homology cycles, computed cohomology ring.
result Cohomology ring of boundary manifold is isomorphic to double of Orlik-Solomon algebra.
New method uses quandle rings to distinguish knots and their mirrors.
problem Distinguishing knots and their mirror images.
method Combining idempotents in quandle rings with state sum invariants.
result Improved knot and mirror image distinction using fewer quandles.
Constructs differential forms on C∞-ringed spaces.
problem Developing a theory of differential forms for non-manifold spaces.
method Functorial construction of differential forms on local C∞-ringed spaces. result Stokes' theorem holds for integrated forms on simplices.
The paper defines a ring structure in twisted equivariant KK-theory for Lie groups.
problem Defining a ring structure in twisted equivariant KK-theory for noncompact Lie groups. method Geometric description of representatives and use of equivariant correspondences.
result Established a ring structure in $KK^{ullet}_{G}(G/K, τ_G^G)$.
L. Kauffman conjectured that a particular solution of the Chinese Rings puzzle is the simplest possible. We prove his conjecture by using low-dimensional topology and group theory. We notice also a surprising connection between the Chinese Rings and Habiro moves (related to Vassiliev invariants).