Negative step sizes improve second-order methods for neural networks.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Estimates for harmonic functions in curved spaces.
The class of second order ODE's cubic with respect to the first order derivative is considered. Using geometric structures associated with these equations, the subclasses of umbilical equations, zero mean curvature equations, and zero Gaussian curvature equations are defined. Zero mean curvature equations are studied w…
AdamQLR optimizes Adam with K-FAC heuristics, achieving comparable performance to tuned benchmarks.
In recent years, Streets and Tian introduced a series of curvature flows to study non-Kähler geometry. In this paper, we study how to construct second order curvature flows in a uniform way, under some natural assumptions which holds in Streets and Tian's works. As a result, by classifying the lower order tensors, we c…
We establish a second order smooth variational principle valid for functions defined on (possibly infinite-dimensional) Riemannian manifolds which are uniformly locally convex and have a strictly positive injectivity radius and bounded sectional curvature.
Second-order optimization speeds up deep hedging for complex options.
We prove comparison, uniqueness and existence results for viscosity solutions to a wide class of fully nonlinear second order partial differential equations defined on a finite-dimensional Riemannian manifold . Finest results (with hypothesis that require the function to be degenerate ell…
A new method for computing image curvature efficiently and accurately.
Smooth solutions found for a curvature problem in hyperbolic space.
We apply the Cartan equivalence method to the study of real analytic second order ODEs under the local real analytic diffeomorphism of $\C^2$ which are area-preserving. This enables us to give a characterization of the second order ODEs which are equivalent to under such transformations. Moreover w…
We consider the heat equation associated with a class of second order hypoelliptic Hörmander operators with constant second order term and linear drift. We describe the possible small time heat kernel expansion on the diagonal giving a geometric characterization of the coefficients in terms of the divergence of the dri…
Optimizes curves on Riemannian manifolds to minimize curvature.
Study shows Kähler-Einstein metric singularities linked to curvature.
ISAAC Newton uses input-based curvature for efficient training.
We use the solution space of a pair of ODEs of at least second order to construct a smooth surface in Euclidean space. We describe when this surface is a proper embedding which is geodesically complete with finite total Gauss curvature. If the associated roots of the ODEs are real and distinct, we give a universal uppe…
Given a compact three-manifold together with a Riemannian metric, we prove the short-time existence of a solution to the renormalization group flow, truncated at the second order term, under a suitable hypothesis on the sectional curvature of the initial metric.
A new method for optimizing deep neural networks using TKFAC.
The paper studies connections in superintegrable systems, revealing geometric insights.
Superintegrable systems on curved manifolds found to have Hessian structures.
In this paper, we study stochastic non-convex optimization with non-convex random functions. Recent studies on non-convex optimization revolve around establishing second-order convergence, i.e., converging to a nearly second-order optimal stationary points. However, existing results on stochastic non-convex optimizatio…
Sharp lower bound found for integral varifolds' mean curvature.
We introduce the discrete Einstein metrics as critical points of discrete energy on triangulated 3-manifolds, and study them by discrete curvature flow of second (fourth) order. We also study the convergence of the discrete curvature flow. Discrete curvature flow of second order is an analogue of smooth Ricci flow.
Extends Calabi operator to Riemannian locally symmetric spaces.
ADAHESSIAN optimizes machine learning models with adaptive second-order methods.
We analyse second order (in Riemann curvature) geometric flows (un-normalised) on locally homogeneous three manifolds and look for specific features through the solutions (analytic whereever possible, otherwise numerical) of the evolution equations. Several novelties appear in the context of scale factor evolution, fix…
New method solves complex curvature equations.
SONIA optimizes machine learning problems with a novel algorithm.
Second-order symmetric Lorentzian spaces, that is to say, Lorentzian manifolds with vanishing second derivative of the curvature tensor R, are characterized by several geometric properties, and explicitly presented. Locally, they are a product M=M_1 x M_2 where each factor is uniquely determined as follows: M_2 is a Ri…
In this paper, we consider an equivalence problem of second order partially differential equations (PDE) and a duality of the flat differential equation. For the equivalence problem, explicit form of invariants (curvatures) are given. We also investigate a duality associated with the flat equation using double fibratio…
At each point in an immersed surface in there is a curvature ellipse in the normal plane which codifies all the local second order geometry of the surface. More recently, at the singular point of a corank 1 singular surface in , a curvature parabola in the normal plane which codifies all the …
New superintegrable systems derived from Frobenius structures.
We prove local existence for the second order Renormalization Group flow initial value problem on closed Riemannian manifolds in general dimensions, for initial metrics whose sectional curvatures satisfy the condition , at all points and planes . This extends results…
We give the definition of angles on a Gromov-Hausdorff limit space of a sequence of complete n-dimensional Riemannian manifolds with a lower Ricci curvature bound. We apply this to prove there is a weakly second order differential structure on these spaces and prove there is a unique Levi-Civita connection allowing us …
We briefly review the notion of second order constrained (continuous) system (SOCS) and then propose a discrete time counterpart of it, which we naturally call discrete second order constrained system (DSOCS). To illustrate and test numerically our model, we construct certain integrators that simulate the evolution of …
We discuss in which sense general metric measure spaces possess a first order differential structure. Building on this, we then see that on spaces with Ricci curvature bounded from below a second order calculus can be developed, permitting to define Hessian, covariant/exterior derivatives and Ricci curvature.
By using a certain second order differential equation, the notion of adapted coordinates on Finsler manifolds is defined and some classifications of complete Finsler manifolds are found. Some examples of Finsler metrics, with positive constant sectional curvature, not necessarily of Randers type nor projectively flat, …
In this paper, we report a "new" continuity path which links the constant scalar curvature equation to a second order elliptic equation. This is largely an expository article where we describes various aspects of geometry and analysis associated with path.
Study on maximum principles for nonlinear equations on Riemannian manifolds.
Defines axial curvatures for corank 1 singular manifolds in higher dimensions.
Generalizes beam models to include curvature and torsion.
In this work we classify the stable regions (second order minima of perimeter under an area constraint) in tori of revolution with piecewise continuous decreasing Gauss curvature from the longest parallel and with a horizontal symmetry. Some applications to isoperimetric problems are also given.
New elastic energy for irregular curves defined through polygonal approximations.
Superintegrable systems on surfaces are classified geometrically.
Improved Local SGD convergence for general convex objectives with bounded second-order heterogeneity.
The study extends Obata's theorem and classifies Finsler manifolds with transnormal functions.
Simplifies convolutions using tensor networks and einsum for efficient second-order methods.
Solves Dirichlet problem for prescribed scalar curvature in Anti-de Sitter space