We establish a Lehto--Virtanen-type theorem and a rescaling principle for an isolated essential singularity of a holomorphic curve in a complex space, which are useful for establishing a big Picard-type theorem and a big Brody-type one for holomorphic curves.
A new method to rescale ReLU neural networks based on path-lifting.
problem Lack of principled ways to leverage rescaling symmetries in ReLU neural networks.
method Introduces a geometrically motivated criterion to rescale neural network parameters, aligning a kernel in the path-lifting space with a chosen reference.
result Proposed method can speed up training and aligns a kernel in the path-lifting space with a chosen reference.
The paper proves a rescaling principle for quasiregular curves and applies it to hyperbolicity.
problem Proving hyperbolicity for quasiregular curves.
method Rescaling principle for quasiregular curves into calibrated manifolds.
result Equivalence of Brody hyperbolicity and normality of quasiregular curves.
We consider geometric flow equations for contracting and expanding normal velocities, including powers of the Gauss curvature, of the mean curvature, and of the norm of the second fundamental form, and ask whether - after appropriate rescaling - closed strictly convex surfaces converge to spheres. To prove this, many a…
We study the small-time behaviour of the rough Bergomi model, introduced by Bayer, Friz and Gatheral (2016), and prove a large deviations principle for a rescaled version of the normalised log stock price process, which then allows us to characterise the small-time behaviour of the implied volatility.
The paper establishes a connection between force-free fields and conformally geodesic fields.
problem Understanding the relationship between force-free fields and conformally geodesic fields.
method Developed an equivalence between force-free fields and conformally geodesic fields, generalized to arbitrary dimensions.
result Established that stationary points of hierarchies of L2 and L1-optimization problems are related by a conformal change of metric. The article extends previous work on contracting convex hypersurfaces by nonhomogeneous curvature functions.
problem Contraction of convex hypersurfaces by nonhomogeneous functions of curvature.
method Extending previous results to various cases, showing convergence to asymptotically round points under pinching conditions.
result Convergence to asymptotically round points under suitable rescaling and pinching conditions.
Estimates LLC for deep linear networks up to 100M parameters.
problem Quantifying model complexity for large-scale deep learning architectures.
method Empirical estimation of LLC using a method developed for DLNs.
result LLC can be accurately measured for DLNs up to 100M parameters.
New operators help focus on specific areas in complex math problems.
problem Concentration in complex mathematical structures.
method Construct conjugate-linear perturbations of twisted spinc Dirac operators using the conjugate-linear Hodge star operator.
result These perturbations satisfy the concentration principle.
Study Chen's flow of curves in two settings: closed circles and lines, identifying geometric conditions for global behavior.
problem Understanding the global behavior of Chen's flow of curves in two settings.
method Investigated two settings: closed immersed ω-circles and immersed lines with a cocompactness condition. Analyzed geometric conditions and curvature effects.
result Identified conditions ensuring the flow shrinks every initial curve to a point, including a rescaling method.
In this short notes, we discuss monotonicity formulas under various rescaled versions of Ricci flow. The main result is Theorem \ref{theo rescaled}.
The paper calculates spectral torsion for rescaled Dirac operators on manifolds.
problem Computing spectral torsion for rescaled Dirac operators.
method Using trilinear Clifford multiplication and functional of differential one-forms.
result Computed spectral torsion for four types of rescaled Dirac operators.
New spectral torsion defined for rescaled Dirac operators.
problem Defining spectral torsion for rescaled Dirac operators.
method Using three vector fields and noncommutative residue.
result Computed spectral torsion for one form rescaled Dirac operators.
For a Riemannian manifold M, we determine some curvature properties of a tangent bundle equipped with the rescaled metric.The main aim of this paper is to give explicit formulae for the rescaled metric on TM, and investigate the geodesics on the tangent bundle with respect to the rescaled Sasaki metric.
Study geometric characterization of asymptotic pseudodifferential calculus on spinor bundles.
problem Geometric characterization of asymptotic pseudodifferential calculus on spinor bundles.
method Groupoid approach to pseudodifferential calculus, rescaled bundle.
result Rescaled bundle provides geometric characterization to asymptotic pseudodifferential calculus on spinor bundles.
New method extends invariant reduction to rescaled geometric structures.
problem Computing invariant geometric structures under symmetries.
method Extends invariant reduction to rescaled structures using shift rule.
result Emergence and loss of invariance in reductions.
The paper calculates the noncommutative residue for a rescaled Dirac operator on 6D manifolds.
problem Computing the noncommutative residue for a specific Dirac operator on 6D manifolds.
method Calculations and proofs for the rescaled Dirac operator fDh on 6D compact manifolds.
result Proof of the Kastler-Kalau-Walze type theorem for the rescaled Dirac operator on 6D compact manifolds with boundary.
Rescaling expansiveness proven for k*-expansive vector fields.
problem Proving rescaling expansiveness for k*-expansive vector fields.
method Introducing and exploring singular-expansive flows.
result Rescaling expansiveness established for k*-expansive vector fields.
Fast algorithm for rescaling vectors with clipping, improving training efficiency.
problem Efficiently rescale vectors to a desired length while maintaining them within a domain after clipping.
method Analytical solution for optimal rescaling using fast and differentiable algorithm.
result Optimal rescaling can be found analytically, improving training efficiency for neural networks.
This paper tackles non-vacuous generalization bounds in ReLU networks by resolving rescaling invariances.
problem Non-vacuous generalization guarantees for ReLU networks with rescaling invariances.
method Proposes a lifted representation to resolve rescaling invariances and studies KL-based rescaling-invariant PAC-Bayes bounds.
result KL-based rescaling-invariant PAC-Bayes bounds provide tighter guarantees and resolve discrepancies in network complexity.
Localizes Wodzicki residue for logarithm of differential operators.
problem Localizing Wodzicki residue for logarithm of differential operators.
method Localisation formula using rescaled differential operators and spinor bundles.
result Expresses index of Dirac operator in terms of local density involving logarithm.
Random hyperbolic surfaces with punctures converge to the Brownian sphere.
problem Understanding the geometry of random hyperbolic surfaces with punctures.
method Rescaling and encoding via plane trees with continuous labels.
result Rescaled random hyperbolic surfaces converge to the Brownian sphere.
We prove a local index theorem of Atiyah-Singer type for Dirac operators on manifolds with a Lie structure at infinity (Lie manifolds for short). With the help of a renormalized supertrace, defined on a suitable class of regularizing operators, the proof of the index theorem relies on a rescaling technique similar in s…
New Lipschitz bound for ReLU networks resists weight rescaling.
problem Lack of robustness guarantees for ReLU networks under weight perturbations.
method Rescaling-invariant Lipschitz bound based on path-metrics.
result The new bound applies to various ReLU-DAG architectures and resists neuron-wise rescalings.
We exploit the spinor description of four-dimensional Walker geometry, and conformal rescalings of such, to describe the local geometry of four-dimensional neutral geometries with algebraically degenerate self-dual Weyl curvature and an integrable distribution of alpha-planes (algebraically special real alpha-geometry)…
Adam performs better with equal momentum parameters, revealing a gradient scale invariance principle.
problem Why Adam performs better with β1=β2. method Formalized gradient scale invariance and proved it for Adam with equal β1 and β2. result Adam becomes gradient scale invariant of first order if and only if β1=β2. The paper constructs bundles and recovers Kirillov character formula.
problem Constructing smooth vector bundles over deformation to the normal cone.
method Rescaling of vector bundles and equivariant constructions.
result Recovery of Kirillov character formula for equivariant index.
A new debiasing method for high-dimensional regression with applications to PCR.
problem Debiasing in high-dimensional statistics with i.i.d. samples and sub-Gaussian covariates.
method Spectrum-Aware Debiasing using rescaled gradient descent with spectral information.
result Achieves debiasing in broader contexts with structured dependencies, heavy tails, and low-rank structures.
Study proves existence and uniqueness of ancient flows from cones.
problem Existence and uniqueness of ancient rescaled mean curvature flows.
method Proved existence and uniqueness using strong uniqueness theorem.
result Proved existence and uniqueness of ancient flows from cones.
It has been empirically observed that the flatness of minima obtained from training deep networks seems to correlate with better generalization. However, for deep networks with positively homogeneous activations, most measures of sharpness/flatness are not invariant to rescaling of the network parameters, corresponding…
Method determines latent dimensionality in international trade flows.
problem Finding meaningful low-dimensional latent features in high-dimensional international trade data.
method Proposes a latent dimension determination method based on clustering of nonnegative RESCAL decompositions.
result Validates the latent features against empirical economic facts.
Improved LLM pre-training performance through better weight and variance control.
problem Improper weight and variance control in LLM pre-training affects downstream task performance.
method Introduced Layer Index Rescaling (LIR) and Target Variance Rescaling (TVR) techniques.
result Substantial improvements in downstream task performance (up to 4.6%) and reduced extreme activation values.
Let X and Y be finite-type CW-complexes (X connected, Y simply connected), such that the rational cohomology ring of Y is a k-rescaling of the rational cohomology ring of X. Assume H^*(X,Q) is a Koszul algebra. Then, the homotopy Lie algebra pi_*(Omega Y) tensor Q equals, up to k-rescaling, the graded rational Lie alge…
"Ends of hyperbolic 3-manifolds should support canonical Wick Rotations, so they realize effective interactions of their ending globally hyperbolic spacetimes of constant curvature." We develop a consistent sector of WR-rescaling theory in 3D gravity, that, in particular, concretizes the above guess for many geometrica…
Let (M,g) be an n−dimensional Riemannian manifold and T11(M) be its (1,1)−tensor bundle equipped with the rescaled Sasaki type metric which rescale the horizontal part by a nonzero differentiable function f. In the present paper, we discuss curvature properties of the Levi-Civita connectio…
A new method to improve deep neural networks using weight rescaling.
problem Overfitting and sensitivity to hyperparameters in weight decay.
method Weight rescaling (WRS) to control weight norm and prevent overfitting.
result WRS outperforms weight decay and other methods in various applications.
EC method calibrates neural networks by matching average confidence to correct label proportion.
problem Overoptimism in neural network prediction confidence.
method Expectation consistency (EC) post-training rescaling of weights.
result EC achieves similar calibration performance to temperature scaling (TS) but is based on a principled Bayesian principle.
The abstract discusses nonuniqueness results for specific Riemannian invariants.
problem Identifying conditions for nonhomothetic conformal rescalings with constant Riemannian invariants.
method Identifying sufficient conditions for finite and infinite geometrically distinct periodic conformal rescalings.
result Improves and establishes nonuniqueness results for various Riemannian invariants.
We develop a ``canonical Wick rotation-rescaling theory in 3-dimensional gravity''. This includes: (a) A simultaneous classification that shows how generic maximal globally hyperbolic spacetimes of constant curvature, which admit a complete Cauchy surface (in particular a compact one), as well as complex projective str…
We obtain a first order extension of the large deviation estimates in the Gärtner-Ellis theorem. In addition, for a given family of measures, we find a special family of functions having a similar Laplace principle expansion up to order one to that of the original family of measures. The construction of the special fam…
We study the small-time fluctuations for diffusion processes which are conditioned by their initial and final positions, under the assumptions that the diffusivity has a sub-Riemannian structure and that the drift vector field lies in the span of the sub-Riemannian structure. In the case where the endpoints agree and t…
We study various covering spectra for complete noncompact length spaces with universal covers (including Riemannian manifolds and the pointed Gromov Hausdorff limits of Riemannian manifolds with lower bounds on their Ricci curvature). We relate the covering spectrum to the (marked) shift spectrum of such a space. We de…
Rescaled ASGD optimizes distributed learning under heterogeneous data.
problem Vanilla ASGD biases towards a frequency-weighted average of local objectives.
method Rescale worker stepsizes by their computation times.
result Rescaled ASGD converges to the correct global objective in fixed-computation model.
Study shows uniform decay rate for singular mean curvature flows.
problem Understanding singularities in mean curvature flows.
method Rescaled flow analysis near compact singularities.
result Uniform decay order bound for the rescaled flow.
Study of null mean curvature flow on de Sitter lightcone, related to 2d-Ricci flow.
problem Analyzing singularity formation and asymptotic behavior of null mean curvature flow.
method Rescaling procedure to relate to 2d-Ricci flow, singularity analysis, asymptotic behavior study.
result Ancient solutions to the flow can be understood in terms of 2d-Ricci flow.
Uniform diameter bounds for Calabi-Yau fibrations with singular fibers.
problem Bounding the diameter of Calabi-Yau fibrations near singular fibers.
method Uniform diameter bound proof for Calabi-Yau fibrations with canonical singular fibers.
result Uniform diameter bounds for all fibres in suitable rescaling.
In this paper, we show that the inverse anisotropic mean curvature flow in Rn+1, initiating from a star-shaped, strictly F-mean convex hypersurface, exists for all time and after rescaling the flow converges exponentially fast to a rescaled Wulff shape in the C∞ topology. As an application, we p…
The abstract discusses how Kähler-Einstein metrics relate to algebraic geometry.
problem Understanding the connection between Kähler-Einstein metrics and algebraic geometry.
method Exploring metric limits and rescalings of Kähler-Einstein metrics in relation to moduli spaces and singularities.
result Proposes tentative conjectural pictures connecting Kähler-Einstein metrics and algebraic geometry.