Billiard motion in ellipses analyzed with canonical coordinates.
problem Understanding billiard motion in ellipses.
method Canonical coordinates and kinematic analysis.
result Explicit parametrization of billiard motions using Jacobian elliptic functions.
Study on K3 surfaces' collapsing and special Kähler structures.
problem Understanding the structure of K3 surfaces' collapsing metrics.
method Analyzing M2 and establishing connections to SKSs and Jacobian elliptic K3 surfaces. result Established a bijection between integral singular SKSs on P1 and Jacobian elliptic K3 surfaces. Every fibration of a projective hyper-Kähler fourfold has fibers which are Abelian surfaces. In case the Abelian surface is a Jacobian of a genus two curve, these have been classified by Markushevich. We study those cases where the Abelian surface is a product of two elliptic curves, under some mild genericity hypothes…
By carrying out a rational transformation on the base curve CP1 of the Seiberg-Witten curve for N=2 supersymmetric pure SU(2)-gauge theory, we obtain a family of Jacobian elliptic K3 surfaces of Picard rank 17. The isogeny relating the Seiberg-Witten curve for pure SU(2)-ga…
We survey the Hirzebruch signature theorem as a special case of the Atiyah-Singer index theorem. The family version of the Atiyah-Singer index theorem in the form of the Riemann-Roch-Grothendieck-Quillen (RRGQ) formula is then applied to the complexified signature operators varying along the universal family of ellipti…
The main aim of this paper is to study soliton surfaces immersed in Lie algebras associated with ordinary differential equations (ODE's) for elliptic functions. That is, given a linear spectral problem for such an ODE in matrix Lax representation, we search for the most general solution of the wave function which satis…
Modern treatment of Winger's pencil reveals deep connections to modular curves and monodromy.
problem Understanding the structure and deformations of genus ten curves with icosahedral symmetry.
method Analyzing the Jacobian of the Winger pencil and its monodromy properties.
result The Jacobian of the Winger pencil contains an elliptic curve with a distinguished point of order 3 and a monodromy group isomorphic to Γ1(3).
This study connects Jacobian regularization to adversarial robustness and improves generalization.
problem Adversarial attacks make deep neural networks vulnerable.
method Developed a connection between Jacobian regularization and adversarial training, and established robust generalization gaps.
result Jacobian norms are related to both standard and robust generalization.
Efficiently regularizes deep learning models using Jacobian nuclear norm.
problem Regularizing deep learning models to prevent overfitting and improve generalization.
method Proposes a denoising-style approximation to penalize the Jacobian nuclear norm without computing the Jacobian matrix.
result Demonstrates that penalizing the average squared Frobenius norm of Jg and Jh is equivalent to penalizing the Jacobian nuclear norm for function compositions. Paper tackles Hessian/Jacobian-free stochastic bilevel optimization with O(ε−1.5) complexity.
problem Nonconvex-strongly-convex bilevel optimization problem.
method FdeHBO optimizer with finite-difference Hessian/Jacobian-vector approximation and momentum.
result FdeHBO achieves O(ε−1.5) iterations for ε-accurate stationary point. JacNet learns Jacobians to enforce structure on derivatives for invertibility and Lipschitz functions.
problem Enforcing structure on derivatives of neural network mappings.
method Proposes using a neural network to directly learn the Jacobian of the input-output function, allowing control over derivative structure.
result Demonstrates learning invertible approximations to simple and 1-Lipschitz functions.
The Seiberg-Witten family of elliptic curves defines a Jacobian rational elliptic surface Z over CP1. We show that for the ∂ˉ-operator along the fiber the logarithm of the regularized determinant −1/2logdet′(∂ˉ∗∂ˉ) satisfies the anomaly equation of the …
There is a natural sequence of CY manifolds that are double covers of the projective g dimensional spaces ramified over 2g+2 hyperplanes. We observe that some of them are obtained as quotient of the action of the semi-direct product of g-1 copies of cyclic Z/2Z groups with the symmetric g group on the product of g-copi…
This work proves the asymptotic freeness of layerwise Jacobians in MLPs with Haar orthogonal matrices.
problem Proving the asymptotic freeness of layerwise Jacobians in multilayer perceptrons (MLPs).
method Replacing each layer's parameter matrix with itself multiplied by a Haar orthogonal matrix, and using the invariance of the MLP.
result Proves the asymptotic freeness of layerwise Jacobians in MLPs with Haar orthogonal matrices.
New algorithms estimate Jacobian matrices for large-scale machine learning.
problem Efficiently computing search directions for large nonlinear least squares.
method Exploit low-rank structure in Hessian to estimate Jacobian matrices.
result Two algorithms perform well compared to state-of-the-art methods.
A new EnKF method for elliptic PDEs reduces dimensionality for accurate state estimation.
problem Elliptic PDEs in fluid flows make traditional EnKF regularization ineffective.
method Low-rank factorization of the Kalman gain based on the Jacobian spectrum.
result Inference can be performed in a low-dimensional subspace of the state space.
The paper discusses fractional Sobolev immersions of flat domains into 3D space.
problem Developing C1 regularity and isometric immersions of flat domains with fractional Sobolev regularity. method Analysis of weak Codazzi-Mainardi equations, study of $W^{2, rac2s}$ planar deformations, and properties of the distributional Jacobian determinant.
result Generalization of isometric immersions with local fractional Sobolev regularity.
We show that there are separated nets in the Euclidean plane which are not biLipschitz equivalent to the integer lattice. The argument is based on the construction of a continuous function which is not the Jacobian of a biLipschitz map.
Recovering hidden influence networks from cascade data using Jacobian-based machine learning.
problem Recovering influence networks behind dynamic cascades.
method CascadeNet, a Jacobian-based machine learning framework.
result CascadeNet achieves high accuracy in network recovery.
The Jacobian matrix (or the gradient for single-output networks) is directly related to many important properties of neural networks, such as the function landscape, stationary points, (local) Lipschitz constants and robustness to adversarial attacks. In this paper, we propose a recursive algorithm, RecurJac, to comput…
This work relaxes energy constraints in self-attention layers for a more general analysis.
problem Understanding inherent biases and dynamics in self-attention layers without energy functions.
method Dynamical systems analysis and Jacobian matrix examination.
result Normalized dynamics are close to a critical state, indicating high inference performance.
GrokAlign aligns Jacobians to accelerate grokking in deep networks.
problem Accelerating the training dynamics of deep networks to avoid delayed generalisation and robustness.
method Aligning the Jacobians of a deep network with the training data to ensure grokking under a low-rank assumption.
result GrokAlign regularizes Jacobians to induce grokking sooner than conventional methods.
Normalizing flows optimize Jacobian determinant for unique likelihood objective.
problem Optimizing normalizing flows for unique likelihood.
method Showed Jacobian determinant is unique for given distributions, leading to a unique global optimum. Used eigenvalues of auto-correlation matrix for explicit likelihood expression.
result Explicit expression of likelihood for flows, independent of neural network parameterization, with theoretical optimal value.
A new method for faster bandwidth selection in Gaussian kernel ridge regression.
problem Efficiently selecting the bandwidth in Gaussian kernel ridge regression.
method Formulated an approximate Jacobian expression for bandwidth selection, proposing a closed-form heuristic.
result Our method is as accurate as cross-validation and marginal likelihood maximization but up to six orders of magnitude faster.
The Jacobian Conjecture is proven for all Jacobian maps.
problem Proving the Jacobian Conjecture for all Jacobian maps.
method Using the Weyl algebra and holonomic modules, the paper shows that the Jacobian module is 1-generated and has finite length.
result The Jacobian Conjecture is true for all Jacobian maps.
We prove some value of the harmonic volume for the Klein quartic C is nonzero modulo ${1/2}\{mathbb Z}$, using special values of the generalized hypergeometric function 3F2. This result tells us the algebraic cycle C−C− is not algebraically equivalent to zero in the Jacobian variety J(C).
A new algorithm solves constrained optimization problems with stochastic gradients.
problem Nonlinear equality constrained optimization with rank-deficient Jacobians.
method Step decomposition strategy combining normal and tangential steps.
result Convergence guarantees in rank-deficient Jacobian cases.
We compute the local Lipschitz constant of ReLU networks precisely.
problem Estimating the local Lipschitz constant of ReLU networks is hard.
method We use a novel approach involving the generalized Jacobian and backpropagation.
result We provide an algorithm to compute the exact Lipschitz constant of ReLU networks.
Study shows connections between Jacobian torsors and Fermat curves.
problem Understanding torsors of Jacobian of universal Fermat curves.
method Analyzes torsors of Jacobian of universal family of degree-m Fermat curves. result Every torsor is a connected component of the Picard scheme.
A new method speeds up training of deep models by avoiding Jacobian determinant computation.
problem Efficiently training deep neural networks with complex log-determinant terms.
method Relative gradients to compute Jacobian updates efficiently.
result Training neural networks with Jacobian log-determinant objectives becomes feasible.
This work introduces the concept of tangent space regularization for neural-network models of dynamical systems. The tangent space to the dynamics function of many physical systems of interest in control applications exhibits useful properties, e.g., smoothness, motivating regularization of the model Jacobian along sys…
Abstract: Unknown status of Jacobian Conjecture, proof has a gap.
problem Status of Jacobian Conjecture
method Analysis of proof of theorem 2.1
result Proof of theorem 2.1 contains a gap
In the field of optimal transport theory, an optimal map is known to be a gradient map of a potential function satisfying cost-convexity. In this paper, the Jacobian determinant of a gradient map is shown to be log-concave with respect to a convex combination of the potential functions when the underlying manifold is t…
A well-conditioned Jacobian spectrum has a vital role in preventing exploding or vanishing gradients and speeding up learning of deep neural networks. Free probability theory helps us to understand and handle the Jacobian spectrum. We rigorously show almost sure asymptotic freeness of layer-wise Jacobians of deep neura…
The Jacobian conjecture is simplified using polynomial mappings.
problem Simplifying the Jacobian conjecture over the real field.
method Using polynomial mappings to restrict transitions on manifolds.
result An equivalent statement of the Jacobian conjecture.
Recent years have witnessed the rapid development of block coordinate update (BCU) methods, which are particularly suitable for problems involving large-sized data and/or variables. In optimization, BCU first appears as the coordinate descent method that works well for smooth problems or those with separable nonsmooth …
Derives derivatives and geometric framework for functions with non-independent variables.
problem Characterizing functions with non-independent variables in probabilistic models.
method Derives actual and dependent partial derivatives, dependent Jacobian matrix, and tensor metric.
result Derives gradient, Hessian, and Taylor expansion for functions with non-independent variables.
We prove two-sided inequalities for the Lp-norm of a pushforward or pullback (with respect to an orientation-preserving diffeomorphism) on oriented volume and Riemannian manifolds. For a function or density on a volume manifold, these bounds depend only on the Jacobian determinant, which arises through the change of…
Develops a new non-abelian framework for Riemann surfaces and differential equations.
problem Analyzing second-order differential equations on Riemann surfaces.
method Gauge-theoretic framework and non-abelian approach.
result Extends Dedekind's Schwarzian approach to generic one-parameter families of curves of genus g.
Recent work (Pennington et al, 2017) suggests that controlling the entire distribution of Jacobian singular values is an important design consideration in deep learning. Motivated by this, we study the distribution of singular values of the Jacobian of the generator in Generative Adversarial Networks (GANs). We find th…
Self Normalizing Flows improve normalizing flows by reducing computational complexity.
problem Efficient gradient computation in normalizing flows, especially in Jacobian determinant terms.
method Introducing Self Normalizing Flows that replace expensive terms with learned approximate inverses.
result Models can be trained more quickly and perform better than functionally constrained counterparts.
We derive an analytic formula for the dual Jacobian matrix of a generalised hyperbolic tetrahedron. Two cases are considered: a mildly truncated and a prism truncated tetrahedron. The Jacobian for the latter arises as an analytic continuation of the former, that falls in line with a similar behaviour of the correspondi…
We study the moduli space of torsion-free G2-structures on a fixed compact manifold, and define its associated universal intermediate Jacobian J. We define the Yukawa coupling and relate it to a natural pseudo-Kahler structure on J. We consider natural Chern-Simons type functionals, whose critical points give associati…
The paper extends infinite-width analysis to neural network Jacobians, revealing convergence to Gaussian processes and linear ODEs.
problem Understanding the training dynamics of neural networks in the infinite-width limit.
method Extending infinite-width analysis to Jacobians, characterizing convergence to Gaussian processes and linear ODEs.
result The evolution of MLPs under robust training in the infinite-width limit is described by a linear ODE.
Study proves uniform ellipticity implies uniform polyconvexity for anisotropic energy functionals.
problem Investigating uniform ellipticity and polyconvexity for anisotropic geometric energy functionals.
method Proves a variant of a recent result using real polyhedral chains.
result Uniform ellipticity of an anisotropic energy functional implies uniform polyconvexity of the integrand.
New deficit functions link elliptic and parabolic inequalities, proving log Sobolev.
problem Proving log Sobolev inequality using deficit functions.
method Introducing two deficit functions, one elliptic and one parabolic, and showing their pointwise convergence and equations.
result Elliptic deficit converges to parabolic deficit, leading to an elliptic proof of log Sobolev inequality.
We provide a characterization for complex analytic curves among two-dimensional minimal graphs in R4 via the Jacobian
We extend the well-known result that any f∈W1,n(Ω,Rn), Ω⊂Rn with strictly positive Jacobian is actually continuous: it is also true for fractional Sobolev spaces Ws,sn(Ω) for any s≥n+1n, where the sign condition on the Jacobian is understood in a distr…