Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

102203305406 · Jun 202019922001200920172026
48 results for universal limits

Develops a new approach to establish universality for any-dimensional machine learning models.

problem Understanding universality for models with inputs of varying sizes.
method Identifies any-dimensional functions with a unique function in an infinite-dimensional limit space, using symmetries and relations between inputs of different sizes.
result Establishes universality for several existing architectures and proposes modifications to restore it.

Stochastic gradient descent converges to universal limits in high dimensions.

problem Statistical tasks in high dimensions with specific data projections.
method Stochastic gradient descent applied to mixture distributions, proving universality of limits.
result The ODE limits are universal for mixtures of arbitrary product distributions.

Study on nodal components of random band-limited functions on surfaces, finding a universal law.

problem Distribution of tangencies of nodal components to a vector field on surfaces.
method Analysis of random band-limited functions on smooth compact Riemannian surfaces with vector fields.
result The distribution of tangencies to a vector field on nodal components of random band-limited functions on surfaces follows a universal deterministic law.

Sumformer simplifies Transformers to handle long sequences efficiently.

problem Quadratic complexity of Transformers limits their use with long sequences.
method Introducing Sumformer, a simple architecture that universally approximates equivariant sequence-to-sequence functions.
result Sumformer achieves the first universal approximation results for Linformer and Performer.

The study constructs a dense orbit in the universal commensurability augmented Teichmüller space.

problem Understanding the dense orbit in the universal commensurability augmented Teichmüller space.
method Using isometric embeddings and directed limits of augmented Teichmüller and moduli spaces.
result The action of the universal commensurability modular group on the universal commensurability augmented Teichmüller space produces a dense orbit.

New framework explains normalizing flows' power and limitations.

problem Understanding the expressive power and limitations of normalizing flows.
method Theoretical framework for well-conditioned coupling-based normalizing flows and volume-preserving flows.
result RealNVP is distributionally universal, but volume-preserving flows are not.

We extend the notion of canonical measures to all (possibly non-compact) metric graphs. This will allow us to introduce a notion of "hyperbolic measures" on universal covers of metric graphs. Kazhdan's theorem for Riemann surfaces describes the limiting behavior of canonical (Arakelov) measures on finite covers in rela…

2017-11-07abs ↗pdf ↗

Thurston's boundary to the universal Teichmüller space T(H)T(\mathbb{H}) is the set of asymptotic rays to the embedding of T(H)T(\mathbb{H}) in the space of geodesic currents; the boundary is identified with the projective bounded measured laminations PMLbdd(H)PML_{bdd}(\mathbb{H}) of H\mathbb{H}. We prove that each Teichmüller …

2015-05-25abs ↗pdf ↗

In this survey article we will consider universal lower bounds on the volume of a Riemannian manifold, given in terms of the volume of lower dimensional objects (primarily the lengths of geodesics). By `universal' we mean without curvature assumptions. The restriction to results with no (or only minimal) curvature assu…

2003-02-20abs ↗pdf ↗

A new method inflates and deflates data manifolds to estimate densities without losing universality.

problem Density estimation on low-dimensional manifolds with non-Euclidean support.
method Inflation-deflation approach using Normalizing Flows with added noise.
result Exact estimation of densities on manifolds with sufficient conditions and Gaussian noise approximation.

Derived geometry can be defined as the universal way to adjoin finite homotopical limits to a given category of manifolds compatibly with products and glueing. The point of this paper is to show that a construction closely resembling existing approaches to derived geometry in fact produces a geometry with this universa…

2017-01-29abs ↗pdf ↗

Study shows perceptrons with random labels perform similarly to Gaussian data.

problem The assumption of Gaussian input data is often seen as a limitation in machine learning.
method Analyzed generalized linear classification (perceptron model) with random labels.
result Minimum training loss is independent of data covariance for high-dimensional input data.

Learning three data points can generate all types of periodic orbits in a neural network.

problem Can learning three data points generate all types of periodic orbits in a neural network?
method Investigated a continuous one-dimensional map with period three in a random neural network in its thermodynamic limit.
result Almost all learned periods are unstable, and each network has its own characteristic attractors.

Study shows limitations and universality of equivariant QNNs with SnS_n-equivariant gates.

problem Understanding the expressiveness of SnS_n-equivariant QNNs with kk-body gates.
method Investigated the interplay between symmetry and kk-bodyness in SnS_n-equivariant QNN generators.
result QNNs are semi-universal but not universal with one- and two-body SnS_n-equivariant gates.

Paper generalizes Gaussian universality and CGMT to dependent data, impacting data augmentation in high-dimensional logistic regression.

problem Limitation of Gaussian universality and CGMT in handling dependent data.
method Generalizes Gaussian universality and CGMT to dependent data (block dependence, m-dependence, mixing). Establishes a novel CGMT framework.
result Gaussian universality holds for high-dimensional logistic regression under various types of dependence.

Single-head transformers with a single self-attention layer can approximate any sequence-to-sequence function and are efficient under certain conditions.

problem Statistical and computational limits of prompt tuning for transformer-based models.
method Investigation of single-head transformers with a single self-attention layer, proving universality and efficiency under SETH.
result Existence of almost-linear time prompt tuning inference algorithms under certain conditions.

Graph Neural Networks struggle on random graphs without node identifiers.

problem Graph Neural Networks' limitations on random graphs without node identifiers.
method Study of Graph Neural Networks and Structural Graph Neural Networks convergence on large random graphs.
result Structural Graph Neural Networks are more powerful and universal than Graph Neural Networks on random graphs.

A taut foliation of a hyperbolic 3-manifold has the continuous extension property for leaves in almost every direction; that is, for each leaf of the universal cover of the foliation and almost every geodesic ray in the leaf, the limit of the ray in the universal cover of the 3-manifold is a well-defined point in the i…

2000-08-15abs ↗pdf ↗

A practical limitation of deep neural networks is their high degree of specialization to a single task and visual domain. Recently, inspired by the successes of transfer learning, several authors have proposed to learn instead universal, fixed feature extractors that, used as the first stage of any deep network, work w…

2018-03-27abs ↗pdf ↗

This work establishes universality for deep equivariant networks, overcoming limitations of previous approaches.

problem Rarity of universality results for equivariant neural networks, especially in high-dimensional settings.
method Develops a more general account of universality for equivariant networks, introducing entry-wise separability and readout layers.
result Deep equivariant networks achieve universality under entry-wise separability, with or without readout layers.

This paper explores the limits of deep learning in poly-time.

problem Characterizing function distributions that deep learning can or cannot learn efficiently.
method Analysis of SGD and GD-based deep learning approaches, proving universality and non-universality results.
result SGD-based deep learning is efficiently universal, while GD-based is not, especially with large batches.

The study characterizes quasiperiodic surfaces in pseudo-hyperbolic spaces with curvature conditions.

problem Characterizing quasiperiodic surfaces in pseudo-hyperbolic spaces.
method Curvature conditions, Gromov hyperbolicity, conformal hyperbolicity.
result Limit curves of quasiperiodic surfaces in the Einstein Universe have canonical quasisymmetric parametrizations.

Unified framework for accelerating DNNs on resource-limited platforms.

problem Accelerating DNN execution on resource-limited platforms.
method Block-based pruning framework with reweighted regularization.
result First universal framework for both CNNs and RNNs with real-time acceleration and no accuracy compromise.

We study the volume distribution of nodal domains of random band-limited functions on generic manifolds, and find that in the high energy limit a typical instance obeys a deterministic universal law, independent of the manifold. Some of the basic qualitative properties of this law, such as its support, monotonicity and…

2016-06-18abs ↗pdf ↗

Study of convergence of point-object configurations to a charged dust continuum.

problem Understanding the convergence of discretized point-object configurations to a charged dust continuum.
method Establishing existence and uniqueness of horizons/minimal surfaces, studying geometries of regions exterior to minimal surfaces, and discussing limits.
result Examples of scalar curvature jumps upon taking Gromov-Hausdorff and intrinsic flat limits.

We study the spherical cap packing problem with a probabilistic approach. Such probabilistic considerations result in an asymptotic sharp universal uniform bound on the maximal inner product between any set of unit vectors and a stochastically independent uniformly distributed unit vector. When the set of unit vectors …

2015-11-19abs ↗pdf ↗

This paper gives a quantitative version of Thurston's hyperbolic Dehn surgery theorem. Applications include the first universal bounds on the number of non-hyperbolic Dehn fillings on a cusped hyperbolic 3-manifold, and estimates on the changes in volume and core geodesic length during hyperbolic Dehn filling. The proo…

2002-04-30abs ↗pdf ↗

The paper analyzes thin-shell limits for viscous operators on Riemannian hypersurfaces.

problem Analyzing boundary conditions and thin-shell limits for viscous operators on arbitrary smooth hypersurfaces.
method Decomposing the ambient Bochner Laplacian into intrinsic and radial pieces, proving results for stress-free and Hodge boundary conditions.
result Universal thin-shell limits for viscous operators on arbitrary smooth hypersurfaces, including stress-free and Hodge boundary conditions.

Thurston's boundary to the universal Teichmüller space T(D)T(\mathbb{D}) is the space PMLbdd(D)PML_{bdd}(\mathbb{D}) of projective bounded measured laminations of D\mathbb{D}. A geodesic ray in T(D)T(\mathbb{D}) is of Teichmüller type if it shrinks vertical foliation of an integrable holomorphic quadratic differential. In a prio…

2015-05-28abs ↗pdf ↗

We present evidence, that if a large enough set of high resolution stock market data is analyzed, certain analogies with physics -- such as scaling and universality -- fail to capture the full complexity of such data. Despite earlier expectations, the mean value per trade, the mean number of trades per minute and the m…

2005-12-21abs ↗pdf ↗

We consider compact, aspherical solenoids obtained as the inverse limit of a system of CW~complexes and covering maps. This includes PP-adic solenoids, as well as the universal hyperbolic solenoid of Teichmüller theory. Using ideas from shape theory, we classify maps between such solenoids up to homotopy, and we prove…

2010-09-28abs ↗pdf ↗

Exact distribution of split conformal prediction coverage found.

problem Determining the reliability of prediction sets in batch mode.
method Analysis of exchangeable data to find universal distribution of empirical coverage.
result Exact distribution of empirical coverage is universal and determined by nominal miscoverage level and calibration sample size.

New geometric invariant from disc intersections captures all coloured Jones polynomials.

problem Constructing a universal knot invariant from configuration spaces.
method Defining a new local system and Lagrangian submanifolds in the disc.
result The new invariant recovers Habiro's universal invariant and more.