A new method computes gradients without backpropagation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
FDS tackles long horizon hyperparameter optimization issues.
Paper introduces FoMoH for optimization without backpropagation.
The paper proposes a method to compute higher infinitesimals in numerical and symbolic analysis.
This work speeds up hyperparameter selection for non-smooth convex models using implicit differentiation.
We study two procedures (reverse-mode and forward-mode) for computing the gradient of the validation error with respect to the hyperparameters of any iterative learning algorithm such as stochastic gradient descent. These procedures mirror two methods of computing gradients for recurrent neural networks and have differ…
Backpropagation-free trunk training improves model performance on various benchmarks.
Develops accelerated methods for optimization using low-dimensional projected-gradient information.
ACA method improves gradient estimation for neural ODEs, reducing error and training time.
We propose a fast second-order method that can be used as a drop-in replacement for current deep learning solvers. Compared to stochastic gradient descent (SGD), it only requires two additional forward-mode automatic differentiation operations per iteration, which has a computational cost comparable to two standard for…
A new stochastic method tackles bi-level optimization problems in deep learning.
Cross validation (CV) and the bootstrap are ubiquitous model-agnostic tools for assessing the error or variability of machine learning and statistical estimators. However, these methods require repeatedly re-fitting the model with different weighted versions of the original dataset, which can be prohibitively time-cons…
VSML unifies meta learning concepts and enables simple backpropagation.
Neural network model improves leaf spectral reflectance prediction for grapevines.
Neural nets improve plasma equilibrium modeling for NSTX-U.
The closure conditions of the inexact exterior differential form and dual form (an equality to zero of differentials of these forms) can be treated as a definition of some differential-geometrical structure. Such a connection discloses the properties and specific features of the differential-geometrical structures. The…
Differential completions and compactifications of differential spaces are introduced and investigated. The existence of the maximal differential completion and the maximal differential compactification is proved. A sufficient condition for the existence of a complete uniform differential structure on a given differenti…
In this paper we give explicit formulas of differential characteristic classes of principal -bundles with connections and prove their expected properties. In particular, we obtain explicit formulas for differential Chern classes, differential Pontryagin classes and differential Euler class. Furthermore, we show that…
We define the Simons-Sullivan differential analytic index by translating the Freed-Lott differential analytic index via explicit ring isomorphisms between Freed-Lott differential K-theory and Simons-Sullivan differential K-theory. We prove the differential Grothendieck-Riemann-Roch theorem in Simons-Sullivan differenti…
We generalize stochastic smoothing for gradient estimation of non-differentiable functions.
The paper proves Gorenstein contractions for multiscale differentials on nodal curves.
Classifies components of strata of k-differentials on Riemann surfaces.
Monotonic differentiable sorting networks improve upon previous methods.
Lecture notes introduce differential geometry using sheaves and differential operators.
Given a unital associatve graded algebra we construct the graded q-differential algebra by means of a graded q-commutator, where q is a primitive N-th root of unity. The N-th power (N>1) of the differential of this graded q-differential algebra is equal to zero. We use our approach to construct the graded q-differentia…
Finite intersection numbers between horizontal foliations of quadratic differentials.
We give chain homotopy maps of Khovanov-type link homology of a universal differential. The universal differential, discussed by Mikhail Khovanov, Marco Mackaay, Paul Turner and Pedro Vaz, contains the original Khovanov's differential and Lee's differential. We also consider the conditions of any differential ensuring …
We consider differentiable maps in the setting of Abstract Differential Geometry and we study the conditions that ensure the uniqueness of differentials in this setting. In particular, we prove that smooth maps between smooth manifolds admit a unique differential, coinciding with the usual one. Thus smooth manifolds fo…
Paper solves a class of differential equations with specific solutions.
We develop differential algebraic K-theory for rings of integers in number fields and we construct a cycle map from geometrized bundles of modules over such a ring to the differential algebraic K-theory. We also treat some of the foundational aspects of differential cohomology, including differential function spectra a…
By adapting the Cheeger-Simons approach to differential cohomology, we establish a notion of differential cohomology with compact support. We show that it is functorial with respect to open embeddings and that it fits into a natural diagram of exact sequences which compare it to compactly supported singular cohomology …
We study two notions of relative differential cohomology, using the model of differential characters. The two notions arise from the two options to construct relative homology, either by cycles of a quotient complex or of a mapping cone complex. We discuss the relation of the two notions of relative differential cohomo…
In this paper we discuss the question of integrating differential graded Lie algebras (DGLA) to differential graded Lie groups (DGLG). We first recall the classical problem of integration in the context, and present the construction for (non-graded) differential Lie algebras. Then, we define the category of differentia…
New privacy framework tailored to specific data distributions.
Studies projective geometry and partial differential equations prolongation.
Develops differential K-theory for noncommutative algebras.
Extends differential geometry concepts to manifolds with super tangent bundles.
In this paper, motivated by the classical notion of a Strebel quadratic differential on a compact Riemann surfaces without boundary we introduce the notion of a quasi-Strebel structure for a meromorphic differential of an arbitrary order. It turns out that every differential of even order k exceeding 2 satisfying certa…
Generalized differential cohomology theories, in particular differential K-theory (often called "smooth K-theory"), are becoming an important tool in differential geometry and in mathematical physics. In this survey, we describe the developments of the recent decades in this area. In particular, we discuss axiomatic ch…
Differentiable pipeline replaces non-differentiable CAE components for shape optimization.
Differentiable programming aids in solving differential equations and their sensitivities.
The purpose of this paper is to connect two subjects: the theory of quantum integrable systems (complete commutative rings of differential operators), and differential Galois theory. We define quantum completely integrable systems (QCIS), algebraically integrable QCIS, the differential Galois group of a QCIS. We show t…
A brief introduction to exterior differential systems for graduate students familiar with manifolds and differential forms. For complete files, see https://github.com/Ben-McKay/introduction-to-exterior-differential-systems
DiffEqFlux.jl is a library for fusing neural networks and differential equations. In this work we describe differential equations from the viewpoint of data science and discuss the complementary nature between machine learning models and differential equations. We demonstrate the ability to incorporate DifferentialEqua…
Differential K-theory gets a -ring structure.
We study Cheeger-Simons differential characters and provide geometric descriptions of the ring structure and of the fiber integration map. The uniqueness of differential cohomology (up to unique natural transformation) is proved by deriving an explicit formula for any natural transformation between a differential cohom…
Defines semi-symmetric metric connections on differential forms.
In this paper we first prove that every differential character can be represented by differential form with singularities. Then we lift the Gauss-Bonnet-Chern theorem for vector bundles to differential characters.