arXiv research

Deep neural networks with adversarial training achieve sup-norm convergence for nonparametric regression.

The higher order singular value decomposition (HOSVD) of tensors is a generalization of matrix SVD. The perturbation analysis of HOSVD under random noise is more delicate than its matrix counterpart. Recently, polynomial time algorithms have been proposed where statistically optimal estimates of the singular subspaces …

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its derivatives as a "non-smooth + non-smooth" optimization problem. Modern technique…

If $(M,g)$ is a compact real analytic Riemannian manifold, we give a necessary and sufficient condition for there to be a sequence of quasimodes of order $o(λ)$ saturating sup-norm estimates. In particular, it gives optimal conditions for existence of eigenfunctions satisfying maximal sup norm bounds. The condition is …

We show the local wellposedness of biharmonic wave maps with initial data of sufficiently high Sobolev regularity and a blow-up criterion in the sup-norm of the gradient of the solutions. In contrast to the wave maps equation we use a vanishing viscosity argument and an appropriate parabolic regularization in order to …

Study on Vapnik-Chervonenkis dimension of product intervals in R^d.

Unified approach for data-driven control of stochastic processes.

Geometric quantization extended to big line bundles.

The paper studies heat behavior on curved spaces without radiality assumption.

A key problem in reinforcement learning for control with general function approximators (such as deep neural networks and other nonlinear functions) is that, for many algorithms employed in practice, updates to the policy or $Q$-function may fail to improve performance---or worse, actually cause the policy performance …

New method quantifies uncertainty in distributed regression.

This paper analyzes how machine learning models resist adversarial attacks in nonparametric regression.

We complete the quasi-isometric classification of irreducible lattices in semisimple Lie groups over nondiscrete locally compact fields of characteristic zero by showing that any quasi-isometry of a rank one S-arithmetic lattice in a semisimple Lie group over nondiscrete locally compact fields of characteristic zero is…

Analyzes Kodaira-Iitaka dimension and multiplicity using intersection theory.

Self-focal points on ellipsoids of dimension 3 or higher are rare.

A compact Riemannian manifold may be immersed into Euclidean space by using high frequency Laplace eigenfunctions. We study the geometry of the manifold viewed as a metric space endowed with the distance function from the ambient Euclidean space. As an application we give a new proof of a result of Burq-Lebeau and othe…

General lower bounds on neural network approximation in L^p norm.

Let $Y$ be a compact, oriented 3-manifold with a contact form $a$ and a metric $ds^2$. Suppose that $F\to Y$ is a principal bundle with structure group $U(2) = SU(2)\times_{\pm1}S^1$ such that $F/S^1$ is the principal SO(3) bundle of orthonormal frames for $TY$. A unitary connection $A_0$ on the Hermitian line bundle $…

We review recent work on the local geometry and optimal regularity of Lorentzian manifolds with bounded curvature. Our main results provide an estimate of the injectivity radius of an observer, and a local canonical foliations by CMC (Constant Mean Curvature) hypersurfaces, together with spatially harmonic coordinates.…

We prove uniform sup-norm estimates for the Monge-Ampere equation with respect to a family of Kahler metrics which degenerate towards a pull-back of a metric from a lower dimensional manifold. This is then used to show the existence of generalized Kahler-Einstein metrics as the limits of the Kahler-Ricci flow for some …

Existence of Q-processes for Brownian motion on hyperbolic spaces with Poissonian potentials shown.

Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-wise and simultaneous Bayesian credible sets in GP regression. As an intermediate result, we develop…

The study connects norms and filtrations on section rings of projective manifolds.

This paper analyzes deep Stable neural networks, showing convergence rates under different growth settings.

New methods for estimating and inferring nonparametric structural functions and elasticities.

Study on $Q$-function estimation for continuous state-action MDPs, deriving rates and conditions.

Study Hamiltonian diffeomorphisms on symplectic manifolds and properties of invariant convex functions.

We consider the problem of online nonparametric regression with arbitrary deterministic sequences. Using ideas from the chaining technique, we design an algorithm that achieves a Dudley-type regret bound similar to the one obtained in a non-constructive fashion by Rakhlin and Sridharan (2014). Our regret bound is expre…

We analyze the differential relation corresponding to integrability of almost complex structures, reformulated as a directed immersion relation by Demailly and Gaussier. Combining results of Clemente [3], we show that applying h-principle techniques yields the following statement: for an almost complex manifold with ar…

We prove new improved endpoint, $L^{p_c}$, $p_c=\tfrac{2(n+1)}{n-1}$, estimates (the "kink point") for eigenfunctions on manifolds of nonpositive curvature. We do this by using energy and dispersive estimates for the wave equation as well as new improved $L^p$, $2<p< p_c$, bounds of Blair and the author \cite{BSTop}, \…

Machine learning and statistics typically focus on building models that capture the vast majority of the data, possibly ignoring a small subset of data as "noise" or "outliers." By contrast, here we consider the problem of jointly identifying a significant (but perhaps small) segment of a population in which there is a…

We establish a uniform estimate for the injectivity radius of the past null cone of a point in a general Lorentzian manifold foliated by spacelike hypersurfaces and satisfying an upper curvature bound. Precisely, our main assumptions are, on one hand, upper bounds on the null curvature of the spacetime and the lapse fu…

Improved reinforcement learning for environments with distributional shifts.

Deep neural networks (DNNs) generate much richer function spaces than shallow networks. Since the function spaces induced by shallow networks have several approximation theoretic drawbacks, this explains, however, not necessarily the success of deep networks. In this article we take another route by comparing the expre…

Dimension reduction and variable selection are performed routinely in case-control studies, but the literature on the theoretical aspects of the resulting estimates is scarce. We bring our contribution to this literature by studying estimators obtained via L1 penalized likelihood optimization. We show that the optimize…

Study robust distribution estimation with Wasserstein distance, achieving optimal risk.

Bounds on Gaussian approximation for neural networks with novel smoothing techniques.

Theory of MoE Transformers' generalization and scaling.

New algorithm for robust density estimation in corrupted data.

This paper aims at formulating the issue of ranking multivariate unlabeled observations depending on their degree of abnormality as an unsupervised statistical learning task. In the 1-d situation, this problem is usually tackled by means of tail estimation techniques: univariate observations are viewed as all the more …

New algorithm for active bipartite ranking with continuous distributions.

Proves weak convergence equals mean convergence in GGC.

This is an intuitive survey of extrinsic and intrinsic notions of convergence of manifolds complete with pictures of key examples and a discussion of the properties associated with each notion. We begin with a description of three extrinsic notions which have been applied to study sequences of submanifolds in Euclidean…

The abstract discusses convergence properties of Lipschitz functions and sets defined by equations.

Study shows intrinsic timed Hausdorff convergence leads to Gromov-Hausdorff and big bang convergence.

Studied SGD convergence under weak conditions.

Study on convergence rate of $Q$-curvature flow in 6 dimensions.

The objective of this paper is to introduce the notion of generalized almost statistical (briefly, GAS) convergence of bounded real sequences, which generalizes the notion of almost convergence as well as statistical convergence of bounded real sequences. As a special kind of Banach limit functional, we also introduce …