This paper addresses anisotropy in Transformer models, providing geometric insights and empirical support.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Machine learning models accurately predict molecular magnetic anisotropy tensors.
New method improves speed of estimating bivariate functional data.
Improved loss functions adapt to weight-space anisotropy, outperforming isotropic counterparts.
We present a local formulation for 2D Discrete Exterior Calculus (DEC) similar to that of the Finite Element Method (FEM), which allows a natural treatment of material heterogeneity (element by element). It also allows us to deduce, in a robust manner, anisotropic fluxes and the DEC discretization of the pullback of 1-…
The purpose of this work is to extend the formalism of stochastic calculus to the case of spaces with local anisotropy (modeled as vector bundles with compatible nonlinear and distinguished connections and metric structures and containing as particular cases different variants of Kaluza--Klein and generalized Lagrange …
Anisotropic data structure affects learning dynamics and generalization error in linear networks.
We introduce SADs to reveal how network architecture shapes score-based generative models.
New kernel interprets 3D anisotropic data with rotations and improved predictions.
ChebLieNet uses Lie groups to create invariant spectral graph networks.
Random matrix theory explains transient signal detectability in early-stopped gradient flow.
This is the first monograph on the geometry of anisotropic spinor spaces and its applications in modern physics. The main subjects are the theory of gravity and matter fields in spaces provided with off--diagonal metrics and associated anholonomic frames and nonlinear connection structures, the algebra and geometry of …
SpecGD mitigates misalignment in phase retrieval models with anisotropic inputs.
New method models fat-tailed distributions with anisotropic tail-adaptive flows.
ResUNet-CMB neural network reconstructs CMB effects from noisy data.
Statistical analysis of Diffusion Tensor Imaging (DTI) data requires a computational framework that is both numerically tractable (to account for the high dimensional nature of the data) and geometric (to account for the nonlinear nature of diffusion tensors). Building upon earlier studies that have shown that a Rieman…
We synthesize and extend the previous ideas about appearance of both noncommutative and Finsler geometry in string theory with nonvanishing B--field and/or anholonomic (super) frame structures \cite{vstring,vstr2,vnonc,vncf}. There are investigated the limits to the Einstein gravity and string generalizations containin…
Symmetry-electronic fingerprints reveal competing magnetic phases in two-dimensional materials.
RFMs transition from linear to nonlinear under specific input-label correlation.
Counterexample disproves Borde-Sorkin conjecture on causal continuity of Morse spacetimes.
Measurements of cosmic microwave background (CMB) anisotropy are ideal experiments for discovering the non-trivial global topology of the universe. To evaluate the CMB anisotropy in multiply-connected compact cosmological models, one needs to compute the eigenmodes of the Laplace-Beltrami operator. Using the direct bou…
Introduces new spectral triples for parabolic geometry.
Serial section electron microscopy (ssEM) is a widely used technique for obtaining volumetric information of biological tissues at nanometer scale. However, accurate 3D reconstructions of identified cellular structures and volumetric quantifications require precise estimates of section thickness and anisotropy (or stre…
We develop the method of anholonomic frames with associated nonlinear connection (in brief, N--connection) structure and show explicitly how geometries with local anisotropy (various type of Finsler--Lagrange--Cartan--Hamilton geometry) can be modeled in the metric--affine spaces. There are formulated the criteria when…
Anisotropy of a space naturally leads to direction dependent electromagnetic tensors and electromagnetic potentials. Starting from this idea and using variational approaches and exterior derivative formalism, we extend some of the classical equations of electromagnetism to anisotropic (Finslerian) spaces. The results d…
Anisotropic curvature flow studied for planar networks.
Study reveals how neural network architectures bias their learning based on feature directions.
The concept of an objective spatial direction in special relativity is investigated and theories assuming light-speed isotropy while accepting the existence of a privileged spatial direction are classified. A natural generalization of the proper time principle is introduced which makes it possible to devise experimenta…
Study shows how anisotropic data affects learning dynamics in phase retrieval.
Isoperimetric regions in scaled product manifolds are products of regions in each factor.
Helical ribbons arise in many biological and engineered systems, often driven by anisotropic surface stress, residual strain, and geometric or elastic mismatch between layers of a laminated composite. A full mathematical analysis is developed to analytically predict the equilibrium deformed helical shape of an initiall…
We present an introduction to the geometry of higher order vector and co-vector bundles (including higher order generalizations of the Finsler geometry and Kaluza--Klein gravity) and review the basic results on Clifford and spinor structures on spaces with generic local anisotropy modeled by anholonomic frames with ass…
We present an introduction to the geometry of higher order vector and co--vector bundles (including higher order generalizations of the Finsler geometry and Kaluza--Klein gravity) and review the basic results on Clifford and spinor structures on spaces with generic local anisotropy modeled by higher order nonlinear con…
Study hexagonal network evolution under curvature flow.
We generalize Penrose's notion of conformal infinity of spacetime, to situations with anisotropic scaling. This is relevant not only for Lifshitz-type anisotropic gravity models, but also in standard general relativity and string theory, for spacetimes exhibiting a natural asymptotic anisotropy. Examples include the Li…
Study on anisotropic curvature flow for noncompact convex hypersurfaces.
The work extends the A. Connes' noncommutative geometry to spaces with generic local anisotropy. We apply the E. Cartan's anholonomic frame approach to geometrical models and physical theories and develop the nonlinear connection formalism for projective module spaces. Examples of noncommutative generation of anholonom…
Study of cosmic microwave background polarization using spin random fields.
We analyze a gradient flow of closed planar curves minimizing the anisoperimetric ratio. For such a flow the normal velocity is a function of the anisotropic curvature and it also depends on the total interfacial energy and enclosed area of the curve. In contrast to the gradient flow for the isoperimetric ratio, we sho…
Capillarity functionals are parameter invariant functionals defined on classes of two-dimensionals parametric surfaces in R3 as the sum of the area integral with an anisotropic term of suitable form. In the class of parametric surfaces with the topological type of S2 and with fixed volume, extremals of capillarity func…
PolarGrad optimizes deep learning models by considering matrix structure, outperforming Adam and Muon.
New approximative kernels improve PDE-G-CNNs for geometric deep learning.
New method models dewetting of anisotropic particles using numerical techniques.
The Ising model is important in statistical modeling and inference in many applications, however its normalizing constant, mean number of active vertices and mean spin interaction -- quantities needed in inference -- are computationally intractable. We provide accurate approximations that make it possible to numericall…
Bayesian Optimization (BO) has become a core method for solving expensive black-box optimization problems. While much research focussed on the choice of the acquisition function, we focus on online length-scale adaption and the choice of kernel function. Instead of choosing hyperparameters in view of maximum likelihood…
The monograph summarizes the author's results on the geometry of anholonomic and locally anisotropic interactions, published in J. Math. Phys., Nucl. Phys. B, Ann. Phys. (NY), JHEP, Rep. Math. Phys., Int. J. Theor. Phys. and in some former Soviet Union and Romanian scientific journals. The main subjects are in the theo…
We briefly review some basic concepts of parallel displacement in Finsler geometry. In general relativity, the parallel translation of objects along the congruence of the fundamental observer corresponds to the evolution in time. By dropping the quadratic restriction on the measurement of an infinitesimal distance, the…
The Willmore flow is well known problem from the differential geometry. It minimizes the Willmore functional defined as integral of the mean-curvature square over given manifold. For the graph formulation, we derive modification of the Willmore flow with anisotropic mean curvature. We define the weak solution and we pr…