Unified framework proves neural networks' ability to mimic complex tasks.
problem Lack of a single constructive framework for neural network universality.
method Introduces neural network approximate identity (nAI) and proves it leads to universality.
result Any nAI activation function is universal.
Framework for universal graph function approximators outperforms existing methods.
problem Graph classification and separation of graph classes.
method Inspired by persistent homology, dependency parsing, and multivalued functions, the framework constructs universal approximators on graph isomorphism classes.
result Achieves state-of-the-art performance on four graph datasets.
Paper relaxes symmetry conditions for universal feature selection in noisy data.
problem Feature selection in noisy data with weak symmetry.
method Developed a universal feature selection framework using singular value decomposition of canonical dependence matrix.
result Selected features achieve asymptotically optimal error exponents up to a residual term.
New method generates universal adversarial perturbations across different image sources.
problem Certifying robustness of deep learning models with universal adversarial perturbations across various image sources.
method Few-shot learning approach using bilevel optimization and learning-to-optimize techniques.
result Improved attack success rate and faster performance compared to existing methods.
Adversarial examples are inputs intentionally perturbed with the aim of forcing a machine learning model to produce a wrong prediction, while the changes are not easily detectable by a human. Although this topic has been intensively studied in the image domain, classification tasks in the audio domain have received les…
The Bayesian framework is a well-studied and successful framework for inductive reasoning, which includes hypothesis testing and confirmation, parameter estimation, sequence prediction, classification, and regression. But standard statistical guidelines for choosing the model class and prior are not always available or…
We study the natural Kähler metrics on moduli spaces of stable oriented pairs in a very general framework, and we prove a universal formula expressing the Kähler class of such a moduli space in terms of characteristic classes of the universal bundle. We use these results to compute explicitly the volumina of certain Qu…
Revives Vogel's diagrammatic technique for universal Lie algebra computations.
problem The universality of Lie algebra quantities remains open, despite many being described.
method Diagrammatic algebra based on Vogel's Λ-algebra.
result Diagrammatic technique enables truly universal computations in Lie theory.
Develops hierarchical reinforcement learning value function approximators.
problem Estimating long-term returns in reinforcement learning with multiple goals.
method Introduces hierarchical universal value function approximators (H-UVFAs) using the options framework.
result Demonstrates generalization and improved performance of H-UVFAs over UVFAs.
MPE framework proves universal approximation for quantum data distribution.
problem Challenges in generating quantum data from underlying distributions.
method Many-body Projected Ensemble (MPE) framework for quantum state design.
result MPE can approximate any quantum distribution within 1-Wasserstein distance error.
A new framework for systematic graph neural network data augmentation.
problem Diversity and difficulty in choosing graph neural network data augmentation techniques.
method Comprehensive framework capturing all previous RDAs, formal universality proof, automatic training method.
result Improved state of the art through new RDAs and impartial comparison.
Universal AI seeks high-optionality states through empowerment and curiosity.
problem Understanding and optimizing AI behavior in uncertain environments.
method Unified framework combining AIXI and variational empowerment, showing how universal AI agents balance goal-directed behavior with uncertainty reduction curiosity.
result Self-AIXI asymptotically converges to AIXI performance and exhibits power-seeking behavior due to intrinsic motivations.
In the framework of Lorentzian warped products, we study the Friedmann-Robertson-Walker cosmological model to investigate non-smooth curvatures associated with multiple discontinuities involved in the evolution of the universe. In particular we analyze non-smooth features of the spatially flat Friedmann-Robertson-Walke…
New framework explains normalizing flows' power and limitations.
problem Understanding the expressive power and limitations of normalizing flows.
method Theoretical framework for well-conditioned coupling-based normalizing flows and volume-preserving flows.
result RealNVP is distributionally universal, but volume-preserving flows are not.
Study extends Vogel's universality to torus knots in adjoint representation.
problem Applying Vogel's universality to knot invariants in adjoint representation theory.
method Extending Vogel's parameters to include torus knots T[m,n] and focusing on T[4,n] with odd n. result Unified description of adjoint invariants for torus knots T[4,n] with odd n. Accelerating DNN execution on various resource-limited computing platforms has been a long-standing problem. Prior works utilize l1-based group lasso or dynamic regularization such as ADMM to perform structured pruning on DNN models to leverage the parallel computing architectures. However, both of the pruning dimensio…
This paper studies universal rates of ERM for binary classification under agnostic learning.
problem The challenge of achieving universal rates of ERM for binary classification under agnostic learning.
method The paper explores the agnostic universal rates of ERM for binary classification, revealing three possible rates: e−n, o(n−1/2), or arbitrarily slow. result The paper provides a complete characterization of which concept classes fall into each of the three categories of agnostic universal rates.
We present a novel framework for estimation and inference with the broad class of universal approximators. Estimation is based on the decomposition of model predictions into Shapley values. Inference relies on analyzing the bias and variance properties of individual Shapley components. We show that Shapley value estima…
INNs can approximate diverse functions despite layer restrictions.
problem Can INNs approximate sufficiently diverse functions?
method Developed a theoretical framework based on differential geometry to simplify the approximation problem of diffeomorphisms.
result INNs have the universal approximation property.
The common assumption of universal behavior in stock market data can sometimes lead to false conclusions. In statistical physics, the Hurst exponents characterizing long-range correlations are often closely related to universal exponents. We show, that in the case of time series of the traded value, these Hurst exponen…
Universal online optimization for dynamic environments using uniclass prediction.
problem Online optimization in changing environments with dynamic regret.
method Reduces dynamic online optimization to uniclass prediction problem, allowing control over dynamic regret bounds.
result First paper with state-of-the-art dynamic regret guarantees for general convex cost functions.
A universal framework for constructing confidence sets using sequential likelihood mixing.
problem Constructing reliable confidence sets for realizable likelihood functions.
method Sequential likelihood mixing, integrating Bayesian inference and regret inequalities.
result Establishes fundamental connections and provable coverage guarantees for various inference techniques.
New framework for knots on Seifert surfaces, no universal host.
problem Understanding how knots appear on minimal genus Seifert surfaces.
method Directed relation and friendship defined on knot types.
result No single knot is a universal host, but families can be.
Paper derives Riccati equation for static spaces and proves its applications.
problem Deriving Riccati equation for static spaces.
method Proving splitting theorem and connectivity of conformal boundary.
result Establishes compactness of universal covering for static triples.
PanRep learns universal node embeddings for heterogeneous graphs.
problem Learning universal node embeddings for heterogeneous graphs.
method Graph Neural Network (GNN) model with four decoders capturing different properties.
result PanRep outperforms unsupervised and supervised methods in node classification and link prediction.
New framework predicts crypto volatility, outperforming traditional models.
problem Forecasting volatility in cryptocurrencies during the crypto-winter.
method Combines LSTM and rough volatility models, using a parsimonious parametric model.
result Similar prediction performances with fewer parameters, suggesting universality of volatility mechanisms.
NP-iMCMC algorithm for nonparametric models in universal PPLs.
problem Developing inference algorithms for arbitrary nonparametric models in universal PPLs.
method Unifying involutive MCMC framework with a general procedure for state movement.
result Proves the correctness of the NP-iMCMC sampler and shows significant performance improvements.
End-to-end portfolio optimization framework bypassing covariance matrix estimation.
problem Optimizing portfolios with large numbers of assets and constraints.
method Deep learning approach that directly optimizes asset distributions without forecasting.
result Framework outperforms classical methods and handles various constraints.
We prove a very general Kobayashi-Hitchin correspondence on arbitrary compact Hermitian manifolds. This correspondence refers to moduli spaces of "universal holomorphic oriented pairs". Most of the classical moduli problems in complex geometry (e. g. holomorphic bundles with reductive structure groups, holomorphic pair…
Develops a new framework for large-scale geometry.
problem Characterizing large-scale models of metric spaces.
method Categorical framework for metric Rips filtration and universal quasigeodesic cones.
result Establishes universal properties and adjointness of the Rips colimit.
Paper generalizes Gaussian universality and CGMT to dependent data, impacting data augmentation in high-dimensional logistic regression.
problem Limitation of Gaussian universality and CGMT in handling dependent data.
method Generalizes Gaussian universality and CGMT to dependent data (block dependence, m-dependence, mixing). Establishes a novel CGMT framework.
result Gaussian universality holds for high-dimensional logistic regression under various types of dependence.
Sparse data models, where data is assumed to be well represented as a linear combination of a few elements from a dictionary, have gained considerable attention in recent years, and their use has led to state-of-the-art results in many signal and image processing tasks. It is now well understood that the choice of the …
Deep learning models converge to Gaussian dynamics with mixed structured inputs.
problem Understanding neural network dynamics with complex input distributions.
method Extended hidden manifold model to Gaussian mixtures, analyzed via SGD.
result Learning dynamics with mixed inputs converge to Gaussian behavior.
UNOT solves optimal transport problems efficiently using neural networks.
problem Computational expense in solving optimal transport problems.
method UNOT (Universal Neural Optimal Transport) uses Fourier Neural Operators to predict OT distances and plans accurately and efficiently.
result UNOT achieves up to 7.4x speedup over the Sinkhorn algorithm while maintaining accuracy.
RealUID distills matching models using real data without GANs.
problem Slow inference in matching models like diffusion and flow.
method RealUID is a universal distillation framework that incorporates real data into the distillation procedure without using GANs.
result RealUID offers a simple theoretical foundation that covers previous distillation methods for Flow Matching and Diffusion models.
Implementing k-NN classification using Gromov--Wasserstein distances
problem Comparing metric measure spaces
method Gromov--Wasserstein and fused Gromov--Wasserstein distances
result Universal consistency of k-NN classifiers OptFormer learns universal HPO from diverse datasets.
problem Learning HPO from experiments with different hyperparameters.
method Text-based Transformer framework for joint policy and function prediction.
result OptFormer can imitate multiple HPO algorithms and improve predictions.
Unified framework for comparing classification metrics across different imbalance rates.
problem Differences in scale and sensitivity to class imbalance rates in classification metrics.
method Introduces outperformance standardization (OPS) function to map metrics to a common scale.
result Unified o-value metric provides clear comparison across different imbalance rates.
Researchers prove no unexpected relations between complex manifold numbers.
problem Proving no unexpected universal linear relations between Hodge, Betti, and Chern numbers of compact complex manifolds.
method Developed a framework to tackle more general questions involving all cohomological invariants, solved specific construction problems.
result Obtained full answers to general questions about universal relations and bimeromorphic invariants in low dimensions.
New approach finds minimum width for deep, narrow MLPs.
problem Finding the minimum width for deep, narrow MLPs to approximate continuous functions.
method Proposes a framework to simplify finding minimum width into determining a geometrical function w(dx,dy) based on input and output dimensions. result Proves that w(dx,dy) equals the optimal minimum width for deep, narrow MLPs to achieve universality. We consider the problem of identifying universal low-dimensional features from high-dimensional data for inference tasks in settings involving learning. For such problems, we introduce natural notions of universality and we show a local equivalence among them. Our analysis is naturally expressed via information geometr…
Deep neural operators learn complex probabilistic models efficiently.
problem Learning complex probabilistic models with global Lipschitz conditions.
method Deep neural-operator framework under global Lipschitz conditions.
result Explicit network-size bounds for universal approximation of probabilistic models.
We present a data-driven framework for learning fair universal representations (FUR) that guarantee statistical fairness for any learning task that may not be known a priori. Our framework leverages recent advances in adversarial learning to allow a data holder to learn representations in which a set of sensitive attri…
New framework for conditional risk minimization using optimal transport.
problem High-stakes decisions with side information, especially economic conditions.
method Universal framework based on union-ball formulation in optimal transport.
result Offers interpretability, tractability, and scalability for various risk functionals.
Paper proves GDL models can approximate any continuous function on non-Euclidean data.
problem Processing non-Euclidean data with universal feedforward models.
method Introduces geometric deep learning framework for differentiable manifold geometries.
result GDL models can uniformly approximate any continuous function on compact sets.
Universal probabilistic programming systems (PPSs) provide a powerful framework for specifying rich probabilistic models. They further attempt to automate the process of drawing inferences from these models, but doing this successfully is severely hampered by the wide range of non--standard models they can express. As …
For every abelian compact Lie group A, we prove that the homotopical A-equivariant complex bordism ring, introduced by tom Dieck (1970), is isomorphic to the A-equivariant Lazard ring, introduced by Cole-Greenlees-Kriz (2000). This settles a conjecture of Greenlees. We also show an analog for homotopical real bordism r…
A grand challenge of the 21st century cosmology is to accurately estimate the cosmological parameters of our Universe. A major approach to estimating the cosmological parameters is to use the large-scale matter distribution of the Universe. Galaxy surveys provide the means to map out cosmic large-scale structure in thr…