Novel approach to universal online learning for bounded losses, closing open problems.
problem Characterizing processes for universal online learning under non-i.i.d. conditions.
method Characterization of processes admitting strong and weak universal learning, introduction of optimistically universal learning rule.
result Introduction of a novel 1NN algorithm that is optimistically universal for bounded losses.
Universal Gaussian parity proven for 2D knots.
problem Proving universal Gaussian parity for 2D knots.
method Analyzing Gaussian parity on free 2D knots.
result Gaussian parity is universal for 2D knots.
GCNNs gain rotation invariance with more training augmentation, making SVD-Universal more effective.
problem Improving robustness of GCNNs to adversarial attacks.
method SVD-Universal technique applied to GCNNs trained with larger rotations.
result SVD-Universal becomes more effective as GCNNs gain rotation invariance.
The study of universal links in 3-manifolds and their properties.
problem Existence and characterization of universal links in 3-manifolds.
method Analyzing branched coverings and distinguishing between universal and complement universal links.
result Closed spherical 3-manifolds are the only ones admitting universal links.
Universal MLPs with a single hidden layer can learn any function.
problem Learning on various data structures like sequences, images, sets, and graphs.
method Using group theory, the paper proves the universality of a broad class of equivariant MLPs with a single hidden layer.
result Having a hidden layer on which the group acts regularly is sufficient for universal equivariance (invariance).
Constructs universal link invariants from intersections in configuration spaces.
problem Globalise topologically all coloured Jones polynomials and ADO polynomials.
method Defines new link invariants from graded intersections in configuration spaces.
result Recover all coloured Jones polynomials and ADO polynomials for links.
We construct universal Lefschetz fibrations, defined in analogy with classical universal bundles. We also introduce the cobordism groups of Lefschetz fibrations, and we see how these groups are quotients of the singular bordism groups via the universal Lefschetz fibrations.
We present a universal knot polynomials for 2- and 3-strand torus knots in adjoint representation, by universalization of appropriate Rosso-Jones formula. According to universality, these polynomials coincide with adjoined colored HOMFLY and Kauffman polynomials at SL and SO/Sp lines on Vogel's plane, and give their ex…
Revives Vogel's diagrammatic technique for universal Lie algebra computations.
problem The universality of Lie algebra quantities remains open, despite many being described.
method Diagrammatic algebra based on Vogel's Λ-algebra.
result Diagrammatic technique enables truly universal computations in Lie theory.
We prove Runge-type theorems and universality results for locally univalent holomorphic and meromorphic functions. Refining a result of M. Heins, we also show that there is a universal bounded locally univalent function on the unit disk. These results are used to prove that on any hyperbolic simply connected plane doma…
Simple technique turns any adversarial attack into a universal one using few test examples.
problem Creating universal adversarial attacks with minimal data.
method Universalization technique using few adversarial test examples and spectral properties.
result Simple universalization technique achieves comparable fooling rates to state-of-the-art methods.
Universal inequalities found for Laplacian eigenvalues on convex domains.
problem Finding bounds for Laplacian eigenvalues on convex domains.
method Established two universal inequalities.
result Found new bounds for Laplacian eigenvalues.
Universal inequalities for Laplacian eigenvalues on discrete groups.
problem Proving inequalities for Laplacian eigenvalues on discrete groups.
method Analyzing Laplacian eigenvalues with Dirichlet boundary conditions on subsets of discrete groups.
result Yang-type universal inequalities for Cayley graphs of amenable groups and the d-regular tree.
New maps connect universal circles to ideal sphere for hyperbolic manifolds.
problem Understanding universal circles for Anosov foliations with branching.
method Introduced a new type of Cannon--Thurston map for leftmost universal circles.
result Fundamental group acts on leftmost universal circle with pseudo-Anosov dynamics.
This paper studies universal rates of ERM for binary classification under agnostic learning.
problem The challenge of achieving universal rates of ERM for binary classification under agnostic learning.
method The paper explores the agnostic universal rates of ERM for binary classification, revealing three possible rates: e−n, o(n−1/2), or arbitrarily slow. result The paper provides a complete characterization of which concept classes fall into each of the three categories of agnostic universal rates.
Develops a new approach to establish universality for any-dimensional machine learning models.
problem Understanding universality for models with inputs of varying sizes.
method Identifies any-dimensional functions with a unique function in an infinite-dimensional limit space, using symmetries and relations between inputs of different sizes.
result Establishes universality for several existing architectures and proposes modifications to restore it.
Softmax attention approximates complex functions and subsumes many known universal approximators.
problem Universal approximation of continuous sequence-to-sequence functions.
method Interpolation-based analysis of attention's internal mechanism, showing its ability to approximate ReLU functions.
result Softmax attention is a universal approximator for continuous sequence-to-sequence functions.
MLPs can approximate any function in context, challenging the importance of in-context universality.
problem Understanding why transformers are more effective than classical models.
method Proved MLPs with trainable activation functions are universal in context.
result Transformer success is likely due to factors other than in-context universality.
Solves open problem on universally consistent online learning with unbounded losses.
problem Open problem on universally consistent online learning with unbounded losses.
method Constructs random measurable partitions of the instance space.
result Simple memorization rule is optimistically universal for any unbounded loss.
Proves universal pairing result for 2-complexes, showing lack of positivity.
problem Detecting equivalence relations in 2-complexes.
method Analogous to Freedman et al. for manifolds, but for 2-complexes.
result Universal pairing does not detect simple homotopy equivalence vs 3-deformations for 2-complexes.
The paper explores universal circles for Anosov foliations and their uniqueness.
problem Exploring the uniqueness of universal circles for Anosov foliations.
method Using the flow space of an Anosov flow to parameterize the circle bundle at infinity of the foliations.
result Several constructions of a universal circle are typically distinct and not conjugate.
The paper tightens bounds on distances between Reeb graphs.
problem Certifying quasi-universality of distances between Reeb graphs.
method Establishes tight bi-Lipschitz bounds for various distances.
result Proves strict universality of the functional contortion distance for contour trees and coincides with interleaving distance for merge trees.
A universal LSTM model outperforms asset-specific models in forecasting stock volatilities.
problem Forecasting stock volatilities across different assets.
method Trained an LSTM network on a pooled dataset of liquid stocks to forecast daily realized volatilities.
result The LSTM model consistently outperforms other asset-specific parametric models in volatility forecasting.
The universal Liouville action equals the renormalized volume of a hyperbolic 3-manifold.
problem Understanding the geometric significance of the universal Liouville action.
method Analyzing the Weil-Petersson universal Teichmüller space and its relation to hyperbolic 3-manifolds.
result The gradient flow of the universal Liouville action converges to the origin, providing a bound on Weil-Petersson distance.
Using deep neural networks that are either invariant or equivariant to permutations in order to learn functions on unordered sets has become prevalent. The most popular, basic models are DeepSets [Zaheer et al. 2017] and PointNet [Qi et al. 2017]. While known to be universal for approximating invariant functions, DeepS…
MAT combines meta-learning and adversarial training to defend against universal patches.
problem Defending against universal patches that fool models in various contexts.
method Meta adversarial training (MAT) integrates meta-learning with adversarial training.
result MAT increases robustness against universal patch attacks on image classification and traffic-light detection.
Study of Gödel Universe as Lie group with specific metric.
problem Characterize geodesics in the Gödel Universe.
method Geometric theory of optimal control applied to Lie groups with left-invariant Lorentz metrics.
result No closed timelike or isotropic geodesics in the Gödel Universe.
The universal sl_2 invariant of string links has a universality property for the colored Jones polynomial of links, and takes values in the h-adic completed tensor powers of the quantized enveloping algebra of sl_2. In this paper, we exhibit explicit relationships between the universal sl_2 invariant and Milnor invaria…
We introduce a class of metrics on gauge theoretic moduli spaces. These metrics are made out of the universal matrix that appears in the universal connection construction of M. S. Narasimhan and S. Ramanan. As an example we construct metrics on the c_{2}=1 SU(2) moduli space of instantons on R^4 for various universal m…
We extend a recently proposed 1-nearest-neighbor based multiclass learning algorithm and prove that our modification is universally strongly Bayes-consistent in all metric spaces admitting any such learner, making it an "optimistically universal" Bayes-consistent learner. This is the first learning algorithm known to e…
Study classifies twist knots with maximal self-linking number in S^3.
problem Classifying transverse-universal knots in S^3.
method Classification of transverse twist knots with maximal self-linking number.
result Obtained an infinite family of non-transverse-universal knots.
Universal approximation for stochastic processes using Brownian motion.
problem Approximating stochastic processes with linear functionals.
method Establishing Lp-type universal approximation theorems for rough path spaces. result Linear functionals on the signature of time-extended Brownian motion can approximate any p-integrable stochastic process. Deep networks have recently been shown to be vulnerable to universal perturbations: there exist very small image-agnostic perturbations that cause most natural images to be misclassified by such classifiers. In this paper, we propose the first quantitative analysis of the robustness of classifiers to universal perturba…
Universal geometry organizes heterotic moduli spaces.
problem Understanding the structure of heterotic compactifications.
method Fibering compactification data over moduli space and analyzing universal curvatures.
result Deformations are components of universal curvatures, incorporating α′2 corrections. Proves DCNNs with expansive convolution are strongly universally consistent.
problem Theoretical consistency of deep convolutional neural networks (DCNNs).
method Empirical risk minimization on DCNNs with expansive convolution (with zero-padding).
result DCNNs with expansive convolution are strongly universally consistent.
The Euler characteristic is the only additive topological invariant for spaces of certain sort, in particular, for manifolds with some finiteness properties. A generalization of the notion of a manifold is the notion of a V-manifold. Here we discuss a universal additive topological invariant of V-manifolds: the univers…
This research finds three meta-indicators for university rankings.
problem Complexity in university ranking systems.
method Interpretable machine learning approach.
result Identified three meta-indicators: time, space, and relationships.
CF-INNs can approximate any invertible function, resolving a long-standing problem.
problem Whether CF-INNs can approximate any invertible function.
method Demonstrated CF-INNs are universal approximators for invertible functions by showing a convenient criterion.
result CF-INNs are universal approximators for invertible functions.
The study extends kernel universality to Riemannian symmetric spaces.
problem Understanding kernel universality in non-Euclidean domains.
method Harmonic analysis on Riemannian symmetric spaces.
result Proves universality of recent kernels on Riemannian symmetric spaces.
New universal automorphic functions capture monstrous moonshine.
problem Developing a universal framework for automorphic functions.
method Reformulating old results, constructing new coordinates, and defining central extensions.
result New invariant 1-forms and representations for universal Teichmüller space.
Universal spaces for finite topological spaces simplify shape descriptions.
problem Describing shape properties of compact metric spaces.
method Inverse limits of finite spaces and Alexandroff extensions.
result Universal spaces simplify shape descriptions of compact metric spaces.
Paper calculates stable cohomology of universal degree d hypersurfaces.
problem Computing stable cohomology of universal degree d hypersurfaces.
method Uses stable cohomology and geometric description of stable classes.
result Geometric description of stable classes of universal degree d hypersurfaces.
This work establishes universality for deep equivariant networks, overcoming limitations of previous approaches.
problem Rarity of universality results for equivariant neural networks, especially in high-dimensional settings.
method Develops a more general account of universality for equivariant networks, introducing entry-wise separability and readout layers.
result Deep equivariant networks achieve universality under entry-wise separability, with or without readout layers.
Metric spaces with certain curvature properties are universally infinitesimally Hilbertian.
problem Analyzing the infinitesimal geometry of metric spaces with curvature bounds.
method Proving a metric space with a Gromov-Hausdorff tangent splitting property is universally infinitesimally Hilbertian.
result Metric spaces with curvature bounds are universally infinitesimally Hilbertian.
In analogy with the vector bundle theory we define universal and strongly universal Lefschetz fibrations over bounded surfaces. After giving a characterization of these fibrations we construct very special strongly universal Lefschetz fibrations when the fiber is the torus or an orientable surface with connected bounda…
Convolutional neural networks (CNN) have become one of the most popular machine learning tools and are being applied in various tasks, however, CNN models are vulnerable to universal perturbations, which are usually human-imperceptible but can cause natural images to be misclassified with high probability. One of the s…
Market sectors play a key role in the efficient flow of capital through the modern Global economy. We analyze existing sectorization heuristics, and observe that the most popular - the GICS (which informs the S&P 500), and the NAICS (published by the U.S. Government) - are not entirely quantitatively driven, but rather…
Drinfel'd used associators to construct families of universal representations of braid groups. We consider semi-associators (i.e., we drop the pentagonal axiom and impose a normalization in degree one). We show that the process may be reversed, to obtain semi-associators from universal representations of 3-braids. We v…