arXiv research

Local invertibility of higher order tensor transforms on compact manifolds.

Enhances stock movement prediction using Higher Order Transformers for multimodal time-series data.

This paper precisely estimates transformer derivatives for explicit learning guarantees.

Transformers can approximate Newton's method for logistic regression.

We recover the higher order terms for the acoustic wave equation from measurements of the modulus of the solution. The recovery of these coefficients is reduced to a question of stability for inverting a Hamiltonian flow transform, not the geodesic X-ray transform encountered in other inverse boundary problems like the…

We analyze Darboux transformations in very general settings for multidimensional linear partial differential operators. We consider all known types of Darboux transformations, and present a new type. We obtain a full classification of all operators that admit Wronskian type Darboux transformations of first order and a …

We extend the framework of variational autoencoders to represent transformations explicitly in the latent space. In the family of hierarchical graphical models that emerges, the latent space is populated by higher order objects that are inferred jointly with the latent representations they act on. To explicitly demonst…

After defining cohomologically higher order BRST and anti-BRST operators for a compact simple algebra {\cal G}, the associated higher order Laplacians are introduced and the corresponding supersymmetry algebra $Σ$ is analysed. These operators act on the states generated by a set of fermionic ghost fields transforming u…

We find a remarkable subalgebra of higher symmetries of the elliptic Euler-Darboux equation. To this aim we map such equation into its hyperbolic analogue already studied by Shemarulin. Taking into consideration how symmetries and recursion operators transform by this complex contact transformation, we explicitly give …

A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher…

PARD generates graphs efficiently and invariantly to node ordering.

Bi-linear feature learning models, like the gated autoencoder, were proposed as a way to model relationships between frames in a video. By minimizing reconstruction error of one frame, given the previous frame, these models learn "mapping units" that encode the transformations inherent in a sequence, and thereby learn …

In this paper we study the problem of uniqueness for spacelike hypersurfaces with constant higher order mean curvature in generalized Robertson-Walker (GRW) spacetimes. In particular, we consider the following question: Under what conditions must a compact spacelike hypersurface with constant higher order mean curvatur…

The need to efficiently calculate first- and higher-order derivatives of increasingly complex models expressed in Python has stressed or exceeded the capabilities of available tools. In this work, we explore techniques from the field of automatic differentiation (AD) that can give researchers expressive power, performa…

In this article, using the generalized Newton transformation, we define higher order mean curvatures of distributions of arbitrary codimension and we show that they agree with the ones from Brito and Naveira (Ann. Global Anal. Geom. 18, 371-383 (2000)). We also introduce higher order mean curvature vector fields and we…

We present a geometric approach to the field theory with higher order anisotropic interactions. The concepts of higher order space, or locally anisotropic, space (in brief, h-space, or la-space) are introduced as general ones for various types of higher order extensions of Lagrange and Finsler geometry and higher dimen…

This work generalizes transformer attention to capture higher-order correlations efficiently.

Paper transforms a complex equation into simpler forms for analysis.

The aim of this paper is to propose an unambiguous intrinsic formalism for higher-order field theories which avoids the arbitrariness in the generalization of the conventional description of field theories, which implies the existence of different Cartan forms and Legendre transformations. We propose a differential-geo…

FairGP uses graph partitioning to make Graph Transformers fair and scalable.

Extends RRR to capture nonlinear interactions in multi-response regression.

A new method uses higher-order Langevin dynamics with critical damping for better generative modeling.

New estimator stabilizes higher-order influence functions for stable statistical inference.

New estimator stabilizes higher-order influence functions for bilinear forms.

Motivated by applications in computational anatomy, we consider a second-order problem in the calculus of variations on object manifolds that are acted upon by Lie groups of smooth invertible transformations. This problem leads to solution curves known as Riemannian cubics on object manifolds that are endowed with norm…

Transformed quadrics from 2D to higher dimensions.

The book can be divided in three parts: the Lagrange geometry of order $k$, presented in the first three chapters, the geometrical theory of the dual manifolds $T^{*k}M$ - chapters 4-7 and the geometry of Hamilton spaces of order $k$ and their subspaces, contained in the last four chapters. They are studied directly an…

The complex wave representation (CWR) converts unsigned 2D distance transforms into their corresponding wave functions. Here, the distance transform S(X) appears as the phase of the wave function φ(X)---specifically, φ(X)=exp(iS(X)/τwhere τis a free parameter. In this work, we prove a novel result using the higher-orde…

We propose an extension of the differential system for constant mean curvature (CMC) surfaces in a three dimensional space form to an associated hierarchy of evolution equations by the higher-order commuting symmetries. The infinite sequence of higher-order conservation laws of CMC surfaces admit the corresponding exte…

New model learns graph neural networks equivariant to various transformations.

The paper studies geometric Airy curve flows on R^n and their properties.

We find the complete set of fundamental invariants for systems of ordinary differential equations of order $\ge 4$ under the group of point transformations generalizing similar results for contact invariants of a single ODE and point invariants of systems of the second and the third order. It turns out that starting fr…

We give a detailed microlocal study of X-ray transforms over geodesics-like families of curves with conjugate points of fold type. We show that the normal operator is the sum of a pseudodifferential operator and a Fourier integral operator. We compute the principal symbol of both operators and the canonical relation as…

The moments of spatial probabilistic systems are often given by an infinite hierarchy of coupled differential equations. Moment closure methods are used to approximate a subset of low order moments by terminating the hierarchy at some order and replacing higher order terms with functions of lower order ones. For a give…

Study third order Einstein deformations for Kähler-Einstein metrics on compact manifolds.

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum order, and then identify useful feature interactions through model training, which…

The paper studies Clifford-Bianchi groups acting on hyperbolic spaces and their properties.

We provide a generalization of Bianchi's Bäcklund transformation from 2-dimensional quadrics to higher dimensional quadrics. The starting point of our investigation is the higher dimensional (infinitesimal) version of Bianchi's main four theorems on the theory of deformations of quadrics and Bianchi's treatment of the …

Researchers find explicit Bäcklund transforms for specific quadrics.

Let $M$ be a smooth manifold and $\mathcal{S}$ a semi-spray defined on a sub-bundle $\mathcal{C}$ of the tangent bundle $TM$. In this work it is proved that the only non-trivial $k$-jet approximation to the exact geodesic deviation equation of $\mathcal{S}$, linear on the deviation functions and invariant under an spec…

Transforms game optimization dynamics into frequency domain for precise hyperparameter analysis.

In this work, we consider solutions of the Maxwell equations on the Schwarzschild-de Sitter family of black hole spacetimes. We prove that, in the static region bounded by black hole and cosmological horizons, solutions of the Maxwell equations decay to stationary Coulomb solutions at a super-polynomial rate, with deca…

Researchers create higher-dimensional $\mathcal{I}^\prime$-curvatures and find counterexamples to the Hirachi conjecture.

The convolution method for the numerical solution of forward-backward stochastic differential equations (FBSDEs), introduced in [21], uses a uniform space grid. In this paper we utilize a tree-like spatial discretization that approximates the BSDE on the tree, so that no spatial interpolation procedure is necessary. In…

We study the microlocal properties of the geodesic X-ray transform $\mathcal{X}$ on a manifold with boundary allowing the presence of conjugate points. Assuming that there are no self-intersecting geodesics and all conjugate pairs are nonsingular we show that the normal operator $\mathcal{N} = \mathcal{X}^t \circ \math…

The paper examines $L^p$ gradient and Riesz transform estimates under Ricci lower bounds.

This work improves online SGD's sample complexity for multi-index models by considering higher-order terms.

Transformers capture combinatorial tasks with bounded error and logarithmic sample dependence.