Continuum transformers learn operators in context via gradient descent.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Fine-tunes language models with captions for differential equation solving.
Study on neural scaling laws for solving linear systems in-context.
New operations defined on moduli spaces for bundles with orientations.
ICON-OCnet solves optimal execution problems with neural networks and few examples.
Data-efficient PDE operator learning without expensive simulations.
Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of infinite-dimensional operator-valued kernels which are suitable for extending func…
Kock [Bull. Austral. Math. Soc., 25 (1982), 357-386] has considered differential forms with values in a group in a context where neighborhood relations are available. By doing so, he has made it clear where the so-called Maurer-Cartan formula should come from. In this paper, while we retain the classical definition of …
We investigate index theory in the context of Dirac operators coupled to superconnections. In particular, we prove a local index theorem for such operators, and for families of such operators. We investigate eta-invariants and prove an APS-theorem, and construct a geometric determinant line bundle for families of such …
The time evolution operator is introduced in the graded context and its main properties are discussed. In particular, the operator is used to analize the projectability of constraint functions arising in the Lagrangian formalism for singular Lagrangians.
ICON learns differential equation operators from prompts, reducing retraining and improving few-shot learning.
ICON learns differential equation operators from examples, revealing probabilistic inference.
We show how the machine of PROP profiles invented by S. Merkulov can be used to study and classify natural operators in differential geometry. We also give an interpretation of graph complexes arising in this context in terms of representation theory. As application, we prove several results on classification of natura…
In the context of synthetic differential geometry, we study the Laplace operator an a Riemannian manifold. The main new aspect is a neighbourhood of the diagonal, smaller than the second neighbourhood usually required as support for second order differential operators. The new neighbourhood has the property that a func…
We derive an inequality that relates nodal set and eigenvalues of a class of twisted Dirac operators on closed surfaces and point out how this inequality naturally arises as an eigenvalue estimate for the Dirac operator. This allows us to obtain eigenvalue estimates for the twisted Dirac operator appearing…
This paper deals with eigenvalue optimization problems for a family of natural Schrödinger operators arising in some geometrical or physical contexts. These operators, whose potentials are quadratic in curvature, are considered on closed surfaces immersed in space forms and we look for geometries that maximize the eige…
Contextualized ML learns context-dependent effects using deep learning.
New method solves high-dimensional Bayesian inverse problems efficiently.
Transformers can predict new tokens based on any number of context tokens, approximating continuous mappings with fixed resources.
New eigenvalue estimate for CR manifolds' Kohn-Dirac operator.
In this article, we introduce the notion of cycling operations of arbitrary order in Garside groups, which is a full generalization of the cycling and decycling operations. Theoretically, this notion together with other related concepts provides a context in which various definitions and arguments concerning Garside gr…
We investigate constructions of higher arity self-distributive operations, and give relations between cohomology groups corresponding to operations of different arities. For this purpose we introduce the notion of mutually distributive -ary operations generalizing those for the binary case, and define a cohomology t…
Motivated by the study of Hörmander's sums-of-squares operators and their generalizations, we define the convolution algebra of transverse distributions associated to a singular foliation. We prove that this algebra is represented as continuous linear operators on the spaces of smooth functions and generalized function…
This paper describes recent development and test implementation of a continuous time recurrent neural network that has been configured to predict rates of change in securities. It presents outcomes in the context of popular technical analysis indicators and highlights the potential impact of continuous predictive capab…
We study the -spectrum of the Dirac operator on complete manifolds. One of the main questions in this context is whether this spectrum depends on . As a first example where -independence fails we compute explicitly the -spectrum for the hyperbolic space and its product with compact spaces.
The aim of this paper is to introduce new forms of the weak and Omori-Yau maximum principles for linear operators, notably for trace type operators, and show their usefulness, for instance, in the context of PDE's and in the theory of hypersurfaces. In the final part of the paper we consider a large class of non-linear…
Defines Wodzicki residue using groupoids and fibered distributions.
We prove existence, uniqueness, and regularity of viscosity solutions to the stationary and evolution obstacle problems defined by a class of nonlocal operators that are not stable-like and may have supercritical drift. We give sufficient conditions on the coefficients of the operator to obtain Hölder and Lipschitz con…
We propose a generalization of the classical notions of plumbing and Murasugi summing operations to smooth manifolds of arbitrary dimensions, so that in this general context Gabai's credo "the Murasugi sum is a natural geometric operation" holds. In particular, we prove that the sum of the pages of two open books is ag…
Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the celebrated Random Fourier Feature methodology to get an approximation of operator-…
Mobile context determination is an important step for many context aware services such as location-based services, enterprise policy enforcement, building or room occupancy detection for power or HVAC operation, etc. Especially in enterprise scenarios where policies (e.g., attending a confidential meeting only when the…
We extend the Atiyah, Patodi, and Singer index theorem for first order differential operators from the context of manifolds with cylindrical ends to manifolds with periodic ends. This theorem provides a natural complement to Taubes' Fredholm theory for general end-periodic operators. Our index theorem is expressed in t…
This study explores the index theory of Heisenberg elliptic and transversally Heisenberg elliptic operators using -theory.
Geometric operators link solutions on different spacetimes.
We study a Dirichlet-to-Neumann eigenvalue problem for differential forms on a compact Riemannian manifold with smooth boundary. This problem is a natural generalization of the classical Steklov problem on functions. We derive a number of upper and lower bounds for the first eigenvalue in several contexts: many of thes…
Understanding how funding and 4H context regulate crypto markets.
In this paper we present explicit formulas for the fundamental solution to the Klein-Gordon operator on some higher dimensional generalizations of the Möbius strip and the Klein bottle with values in distinct pinor bundles. The fundamental solution is described in terms of generalizations of the Weierstraß -functi…
New analysis proves sketching operators' RIP guarantees for mixture models without importance sampling.
The Serre-Swan theorem in differential geometry establishes an equivalence between the category of smooth vector bundles over a smooth compact manifold and the category of finitely generated projective modules over the unital ring of smooth functions. This theorem is here generalized to manifolds of bounded geometry. I…
VectorNet predicts car behavior using vectorized HD maps and agent dynamics.
Study on estimating distances between covariance operators and Gaussian processes.
We introduce the notion of Ricci-corrected differentiation in parabolic geometry, which is a modification of covariant differentiation with better transformation properties. This enables us to simplify the explicit formulae for standard invariant operators given in work of Cap, Slovak and Soucek, and at the same time e…
We use the theory of Berezin-Toeplitz operators of Ma and Marinescu to study the quantum Hamiltonian dynamics associated with classical Hamiltonian flows over closed prequantized symplectic manifolds in the context of geometric quantization of Kostant and Souriau. We express the associated evolution operators via paral…
Develops trace class operators and inverse Laplacian theory for infinite dimensions.
We prove trace identities for commutators of operators, which are used to derive sum rules and sharp universal bounds for the eigenvalues of periodic Schroedinger operators and Schroedinger operators on immersed manifolds. In particular, we prove bounds on the eigenvalue lambda_{N+1} in terms of the lower spectrum, bou…
We show that the (graded) spectral flow of a family of Toeplitz operators on a complete Riemannian manifold is equal to the index of a certain Callias-type operator. When the dimension of the manifold is even this leads to a cohomological formula for the spectral flow. As an application, we compute the spectral flow of…
We consider generalized gradients in the general context of -structures. They are natural first order differential operators acting on sections of vector bundles associated to irreducible -representations. We study their geometric properties and show in particular their conformal invariance.
Derives an index formula for families of end-periodic Dirac operators.