The paper studies neural networks with wide layers and finds a deformed semicircle law.
problem Investigating spectral distributions of neural networks in the ultra-wide regime.
method Analyzes empirical kernel matrices, proves deformed semicircle law, provides nonlinear Hanson-Wright inequality.
result Emergence of a deformed semicircle law in the ultra-wide neural network regime.
Study curve shortening flow in high dimensions with boundary constraints.
problem Understanding the behavior of curves in high-dimensional spaces with boundary conditions.
method Used curvature and higher-derivative estimates, Stahl-type maximum principle, and blow-up analysis.
result Flow converges to a shrinking semicircle model or has only semicircle boundary singularities in low entropy regimes.
Study of correlated Wigner matrices with BBP transitions.
problem Understanding spectral transitions in correlated Wigner matrices.
method Analyzes a Wigner-type matrix with row/column correlations, decomposes into bulk and outliers, and uses integral operators to model transitions.
result Correlated Wigner matrices exhibit multiple BBP transitions at critical points.
Study on eigenvalue distribution of correlated time series deforming the semi-circle law.
problem Eigenvalue distribution of correlated time series differs from the semi-circle law.
method Analysis of Wigner random matrix with temporal correlation.
result Eigenvalue distribution converges to a deformed semi-circle law with longer tail and higher peak.
Recent years have seen a growing interest in understanding deep neural networks from an optimization perspective. It is understood now that converging to low-cost local minima is sufficient for such models to become effective in practice. However, in this work, we propose a new hypothesis based on recent theoretical fi…
We present infinitely many nonlocal conservation laws, a pair of compatible local Hamiltonian structures and a recursion operator for the equations describing surfaces in three-dimensional space that admit nontrivial deformations which preserve both principal directions and principal curvatures (or, equivalently, the s…
Hydrodynamic hierarchy deformed using conservation laws.
problem Deforming a hydrodynamic hierarchy with non-vanishing Nijenhuis torsion.
method Using a chain of conservation laws to deform the hierarchy.
result The resulting hierarchy has non-vanishing Nijenhuis torsion but vanishing Haantjes tensor.
This work presents a general unified theory for coupled nonlinear elastic and inelastic deformations of curved thin shells. The coupling is based on a multiplicative decomposition of the surface deformation gradient. The kinematics of this decomposition is examined in detail. In particular, the dependency of various ki…
We show that finite parallel transports of vectors in Riemannian spaces, determined by the multiplication law in the deformed groups of diffeomorphisms, and sequences of infinitesimal parallel transports of vectors along geodesics are equivalent.
The paper improves conformal prediction by analyzing the beta law of conditional coverage.
problem Improving finite-sample marginal coverage guarantees for non-i.i.d. data.
method The method uses Wasserstein distances to quantify deviations from the beta law of conditional coverage.
result The framework provides direct bounds on marginal coverage gaps and bad-calibration probabilities.
It has been pointed out by Patriarca et al. (2005) that the power-law tailed equilibrium distribution in heterogeneous kinetic exchange models with a distributed saving parameter can be resolved as a mixture of Gamma distributions corresponding to particular subsets of agents. Here, we propose a new four-parameter stat…
Study reveals an equivalence principle for the spectrum of random inner-product kernel matrices in polynomial scaling.
problem Understanding the spectrum of random kernel matrices in polynomial scaling regimes.
method Investigates random matrices with nonlinear kernel functions applied to inner products of uniformly distributed vectors.
result The spectrum of the random kernel matrix is asymptotically equivalent to a simpler matrix model through free additive convolution.
A curve around a sphere must be at least 4π long.
problem Finding the shortest closed curve that encloses a sphere.
method Analyzing curves in Euclidean 3-space and comparing their lengths.
result The shortest curve is composed of 4 semicircles arranged like a baseball seam.
The study explores generalized divergences and exponential families with a focus on sufficient conditions and laws of large numbers.
problem Generalization of Kullback-Leibler divergence and exponential families.
method Investigation of (h,τ)-divergence and (h,τ)-exponential families, definition of (h,τ)-dependence, proof of law of large numbers. result Sufficient condition for (h,τ)-divergence to induce Hessian structure on (h,τ)-exponential family, proof of law of large numbers. We formulate the theory of nearly autoparallel maps (generalizing conformal transforms) of locally anisotropic spaces and define the nearly autoparallel integration as the inverse operation to both covariant derivation and deformation of connections by nearly autoparallel maps. By using this geometric formalism we cons…
Several recent trends in machine learning theory and practice, from the design of state-of-the-art Gaussian Process to the convergence analysis of deep neural nets (DNNs) under stochastic gradient descent (SGD), have found it fruitful to study wide random neural networks. Central to these approaches are certain scaling…
We prove that Wilson loop expectation values for arbitrary simple closed contours obey an area law up to second order in perturbative two-dimensional Yang-Mills theory. Our analysis occurs within a general family of axial-like gauges, which include and interpolate between holomorphic gauge and the Wu-Mandelstam-Liebran…
The study reveals the spectral structure of attention layers and its implications for generalization.
problem Understanding the spectral structure and generalization of trained attention layers.
method Empirical risk minimization in a single-head tied-attention layer, using random matrix theory, spin-glass theory, and approximate message passing.
result Exact high-dimensional characterization of training and test error, interpolation and recovery thresholds, and spectrum of the key and query matrices.
The main result in this paper is that the space of all smooth links in Euclidean 3-space isotopic to the trivial link of n components has the same homotopy type as its finite-dimensional subspace consisting of configurations of n unlinked Euclidean circles (the "rings" in the title). There is also an analogous result f…
The exterior differential system for constant mean curvature (CMC) surfaces in a 3-dimensional space form is an elliptic Monge-Ampere system defined on the unit tangent bundle. We determine the infinite sequence of higher-order symmetries and conservation laws via an enhanced prolongation modelled on a loop algebra val…
GeoHNN models physics laws for stable, accurate predictions.
problem Violations of physical principles in machine learning models.
method Explicitly encodes geometric priors in inertia and phase space.
result Significantly outperforms existing models in long-term stability and accuracy.
We consider the second variational derivative of a given gauge-natural invariant Lagrangian taken with respect to (prolongations of) vertical parts of gauge-natural lifts of infinitesimal principal automorphisms. By requiring such a second variational derivative to vanish, {\em via} the Second Noether Theorem we find t…
Gradient descent recovers planted weights in shallow neural networks with quadratic activations.
problem Learning shallow neural networks with quadratic activations and planted weights.
method Analysis of optimization landscape, gradient descent, semicircle law for Wishart ensemble.
result Gradient descent can recover planted weights if initialized below an energy barrier.
Paper finds isometric timelike minimal surfaces with unique properties.
problem Rigidity of isometric timelike minimal surfaces in Lorentz-Minkowski space.
method Analyzes symmetries and deformations of timelike minimal surfaces.
result Existence of isometric timelike minimal surfaces not congruent to associated family.
We study the general structure of formal perturbative solutions to the Hamiltonian perturbations of spatially one-dimensional systems of hyperbolic PDEs. Under certain genericity assumptions it is proved that any bihamiltonian perturbation can be eliminated in all orders of the perturbative expansion by a change of coo…
Universal model for soft tissue mechanics under shock waves.
problem Modeling shock wave mechanics in soft biological tissues.
method Continuum mixture theory with phase-field mechanics.
result Universal thermodynamically consistent formulation for soft porous tissues.
Physics-informed GANs estimate elastic moduli from mechanical tests.
problem Estimating spatially-varying elastic moduli from measured deformations.
method Physics-informed Generative Adversarial Networks (PI-GANs) with PDE constraints.
result Generated stiffness samples match true distribution statistics.
Evolutionary forms, as well as exterior forms, are skew-symmetric differential forms. But in contrast to the exterior forms, the basis of evolutionary forms is deforming manifolds (with unclosed metric forms). Such forms possess a peculiarity, namely, the closed inexact exterior forms are obtained from that. The closur…
New stability theory for Sinkhorn semigroups with explicit decay rates.
problem Stability and convergence of Sinkhorn iterations for various divergences.
method Operator-theoretic framework based on Lyapunov techniques.
result Explicit exponential decay rates for Sinkhorn iterates.
SPQR improves Q-ensemble diversity in reinforcement learning.
problem Overestimation bias in Q-learning for complex tasks.
method Introduces SPQR for Q-ensemble independence regularization.
result SPQR outperforms baseline algorithms in online and offline RL benchmarks.
Study on utility maximization with Tsallis entropy in reinforcement learning.
problem Exploring utility maximization with Tsallis entropy in reinforcement learning.
method Introducing Tsallis entropy regularizer to induce exploration, investigating specific examples, characterizing well-posedness, designing reinforcement learning algorithm.
result Characterized well-posedness and provided semi-closed-form solutions for specific examples, found distinct optimal strategies.
We review the geometric setting of the field theory with locally anisotropic interactions. The concept of locally anisotropic space is introduced as a general one for various type of extensions of Lagrange and Finsler geometry and higher dimension (Kaluza--Klein type) spaces. The problem of definition of spinors on gen…
This work explains scaling laws as redundancy laws in deep learning.
problem The mathematical origins of scaling laws in deep learning models remain unclear.
method Kernel regression and analysis of data covariance spectra.
result Scaling laws can be explained as redundancy laws, revealing the learning curve's slope depends on data redundancy.
Study on RL on volatility surfaces, proving no free lunch for law-seeking methods.
problem Aligning RL agents with no-arbitrage laws in volatile markets.
method Built a law manifold, defined penalties, and used a Goodhart decomposition.
result No free lunch theorem: Law-seeking RL cannot outperform baselines.
A framework detects where constitutive models fail in elastography, improving clinical interpretation.
problem Assuming constitutive models correctly describe soft tissue mechanics leads to misleading results.
method Probabilistic framework treating stress as a latent variable, comparing it to assumed model predictions.
result Inferred precision field identifies invalid regions with high accuracy, improving model validity.
A new scaling law predicts optimal batch size for training models.
problem Finding the optimal batch size for training models efficiently.
method Proposed a three-term scaling law that considers model size, training data, training steps, and batch size.
result The three-term law accurately recovers the optimal batch size and can be robustly fit with fewer training runs.
Space exploration technology advances exponentially, consistent with Moore's and Wright's laws.
problem Predicting the advancement of space exploration technology.
method Analysis of Moore's and Wright's laws applied to space exploration technology.
result Spacecraft technology advances exponentially, consistent with Moore's and Wright's laws.
This work analyzes neural scaling laws using power-law data spectra and derives analytical expressions for generalization error.
problem Understanding how neural network performance scales with key factors like data size and model complexity.
method Statistical mechanics techniques applied to one-pass stochastic gradient descent in a student-teacher framework.
result Derivation of analytical expressions for generalization error under power-law data spectra and identification of conditions for power-law scaling.
Hybrid ResNet and RMT improve covariance matrix estimation for cryptocurrency portfolios.
problem Noisy, non-Gaussian financial data leads to unstable covariance matrices.
method Combines RMT regularization and ResNet learning for data-driven corrections.
result Hybrid estimator outperforms traditional methods in portfolio optimization.
An Atlas model is a rank-based system of continuous semimartingales for which the steady-state values of the processes follow a power law, or Pareto distribution. For a power law, the log-log plot of these steady-state values versus rank is a straight line. Zipf's law is a power law for which the slope of this line is …
Large models follow power laws in performance with dataset size or parameters.
problem Understanding neural scaling laws in large language models.
method Joint generative data model and random feature model.
result Modeling and solving the dual limit reveals insights into scaling laws.
Conservation law for weakly harmonic mappings in high dimensions.
problem Conservation law for harmonic mappings in supercritical dimensions.
method Partial extension of Rivière's conservation law with Lorentz integrability condition.
result Conservation law for weakly harmonic mappings in supercritical dimensions.
Survey on conservation laws for geometric PDEs.
problem Modeling polyharmonic maps.
method Conservation law approach.
result Overview of conservation laws in geometric PDEs.
Dynamic risk measures follow law invariance principles over time.
problem Tackles dynamic risk measurement principles.
method Shows equivalence between adapted law invariance and recursive one-step conditional-law representation for time-consistent risk measures.
result Identifies adapted law invariance as the dynamic counterpart of ordinary law invariance.
Unified theory for neural scaling laws in hierarchically compositional data.
problem Understanding neural scaling laws in hierarchically compositional data.
method Probabilistic context-free grammars and power-law distributed production rules.
result Unified learning curve behavior for classification and next-token prediction tasks.
Defines formal vertex laws related to Lie conformal algebras.
problem No specific problem stated; focuses on definitions and proofs.
method Definitions and proofs of vertex/conformal versions of classical Lie theory results.
result Proves vertex/conformal versions of important Lie theory results.
We summarize a book under publication with his title written by the three present authors, on the theory of Zipf's law, and more generally of power laws, driven by the mechanism of proportional growth. The preprint is available upon request from the authors. For clarity, consistence of language and conciseness, we disc…
New concept of partial law invariance connects decision theory and financial risk management.
problem Connecting decision theory and financial risk management under uncertainty.
method Characterizing partially law-invariant coherent risk measures via a novel representation formula.
result Strong partial law invariance bridges the gap between existing risk measure representations.