arXiv research

Study pseudo-differential operators on compact Lie groups using symbols and functional calculus.

The notion of pseudo-differential operators with coefficients in a continuous trace algebra over a manifold are introduced and their index theory is studied. The algebra of principal symbols in this calculus provides an abstract Poincaré dual to the continuous trace algebra. Index formulas for pseudo-differential opera…

We generalize the notion of a Lie algebroid over infinite jet bundle by replacing the variational anchor with an N-tuple of differential operators whose images in the Lie algebra of evolutionary vector fields of the jet space are subject to collective commutation closure. The linear space of such operators becomes an a…

New kernels allow learning from non-separable data.

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the celebrated Random Fourier Feature methodology to get an approximation of operator-…

Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of infinite-dimensional operator-valued kernels which are suitable for extending func…

We consider the problem of learning a vector-valued function f in an online learning setting. The function f is assumed to lie in a reproducing Hilbert space of operator-valued kernels. We describe two online algorithms for learning f while taking into account the output structure. A first contribution is an algorithm,…

Although operator-valued kernels have recently received increasing interest in various machine learning and functional data analysis problems such as multi-task learning or functional regression, little attention has been paid to the understanding of their associated feature spaces. In this paper, we explore the potent…

A new algorithm for high-dimensional hedging problems.

Random features improve neural operators' generalization properties.

A new approach to Riemannian geometry using embedded and submersion structures.

New formulas for Riemannian gradient and Hessian on manifold metrics.

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like multi-task learning and structured out- put prediction. We show that multi-task ke…

The paper develops a new probabilistic framework for denoising diffusion models using free entropy and stochastic analysis.

In this paper we consider the problems of supervised classification and regression in the case where attributes and labels are functions: a data is represented by a set of functions, and the label is also a function. We focus on the use of reproducing kernel Hilbert space theory to learn from such functional data. Basi…

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general framework for nonparametric ODE models using penalized regression in Reproducing Kerne…

Racah matrices and higher $j$-symbols are used in description of braiding properties of conformal blocks and in construction of knot polynomials. However, in complicated cases the logic is actually inverted: they are much better deduced from these applications than from the basic representation theory. Following the re…

I prove the bistability of linear evolution equations $x' = A(t)x$ in a Banach space $E$, where the operator-valued function $A$ is of the form $A(t) = f'(t)G(t,f(t))$ for a binary operator-valued function $G$ and a scalar function $f$. The constant that bounds the solutions of the equation is computed explicitly; it i…

Quantum kernel machines need to use more complex kernels to fully exploit their potential.

New kernels capture both local and non-local interactions efficiently.

We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) problem using operator-valued kernels. We show that some of the existing formulations of this problem are special cases of our framework. We then propose a c…

Unified formula for higher traces of linear maps on finite-dimensional normed spaces.

Open problem: Establishing bounds for Cayley-table completion to discover discrete algorithmic axioms.

A new model captures forward curve dynamics with stochastic volatility.

Infinite-Task Learning uses RKHSs to learn functions over hyperparameter space.

The paper develops SGD for estimating operators from data.

FFBO optimizes functions as inputs and outputs, improving on existing BO methods.

Paper develops metrics for random dynamical systems using vector-valued RKHSs.

VaSST uses soft symbolic trees for probabilistic symbolic regression.

In this paper we present a nonparametric method for extending functional regression methodology to the situation where more than one functional covariate is used to predict a functional response. Borrowing the idea from Kadri et al. (2010a), the method, which support mixed discrete and continuous explanatory variables,…

Paper develops a duality approach for robust loss functions in infinite-dimensional RKHSs.

In this paper we introduce a new family of operator-valued distributions on Euclidian space acting by convolution on differential forms. It provides a natural generalization of the important Riesz distributions acting on functions, where the corresponding operators are $(-Δ)^{-α/2}$, and we develop basic analogous prop…

We describe dimensionally constrained symbolic regression which has been developed for mass measurement in certain classes of events in high-energy physics (HEP). With symbolic regression, we can derive equations that are well known in HEP. However, in problems with large number of variables, we find that by constraini…

Paper closes neural-symbolic learning loop with grammar model and back-search algorithm.

Geometric symbols help compute heat invariants.

Reinforcement learning and symbolic planning have both been used to build intelligent autonomous agents. Reinforcement learning relies on learning from interactions with real world, which often requires an unfeasibly large amount of experience. Symbolic planning relies on manually crafted symbolic knowledge, which may …

For an arbitrary Riemannian manifold $X$ and Hermitian vector bundles $E$ and $F$ over $X$ we define the notion of the normal symbol of a pseudodifferential operator $P$ from $E$ to $F$. The normal symbol of $P$ is a certain smooth function from the cotangent bundle $T^*X$ to the homomorphism bundle $Hom (E,F)$ and dep…

Based on the ideas of Optimal Control, we introduce the new basic characteristic of a bracket generating distribution, the Jacobi symbol. In contrast to the classical Tanaka symbol, the set of Jacobi symbols is discrete and classifiable. We give an explicit and unified algebraic procedure for the construction of the ca…

Symbolic knowledge in neural models can inadvertently make them more vulnerable to adversarial attacks.

We introduce mod 3 triple Milnor invariants and triple cubic residue symbols for certain primes of the Eisenstein number field $\mathbb{Q}(\sqrt{-3})$, following the analogies between knots and primes. Our triple symbol generalizes both the cubic residue symbol and Rédei's triple symbol, and describes the decomposition…

Develops a framework for learning nonlinear operators using Mercer kernels.

A formula for Rademacher symbols in triangle groups is provided.

The symbolic dynamics technique is well-known for low-dimensional dynamical systems and chaotic maps, and lies at the roots of the thermodynamic formalism of dynamical systems. Here we show that this technique can also be successfully applied to time series generated by complex systems of much higher dimensionality. Ou…

Complex $b$-$6j$ symbols relate to hyperbolic tetrahedron volumes and determinants.

The paper classifies symbols of differential operators on vector bundles.

NeSS combines neural and symbolic approaches for better compositional generalization.

Defines transverse symbols for foliated manifolds and proves their K-homology class.

A new method for spotting symbols in CAD images reduces annotation costs and improves accuracy.