Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

106213319425 · Jun 202019922001200920172026
48 results for universal technique

Softmax attention approximates complex functions and subsumes many known universal approximators.

problem Universal approximation of continuous sequence-to-sequence functions.
method Interpolation-based analysis of attention's internal mechanism, showing its ability to approximate ReLU functions.
result Softmax attention is a universal approximator for continuous sequence-to-sequence functions.

Survey of universal portfolio techniques for minimizing investment regret.

problem Minimizing investment regret in algorithmic trading.
method Explains various universal portfolio techniques and their proofs.
result Coverage of fundamental concepts and algorithms in regret minimization.

Simple technique turns any adversarial attack into a universal one using few test examples.

problem Creating universal adversarial attacks with minimal data.
method Universalization technique using few adversarial test examples and spectral properties.
result Simple universalization technique achieves comparable fooling rates to state-of-the-art methods.

We define the class of Haken nn--manifolds as a generalisation of Haken 3--manifolds. We prove that the interior of the universal covering of a Haken nn--manifold is $\RR^n$, which generalises a result of Waldhausen. The techniques used allow us to provide a new proof of Waldhausen's universal cover theorem for Haken…

2011-08-02abs ↗pdf ↗

Develops experimental design for discovering missing physics in bioreactors.

problem Discovering missing physics in incomplete model structures of process systems.
method Combines universal differential equations and symbolic regression with sequential experimental design.
result Successfully recovered true model structure of a bioreactor using machine learning techniques.

WWe define the notion of a random metric space and prove that with probability one such a space is isometricto the Urysohn universal metric space. The main technique is the study of universal and random distance matrices; we relate the properties of metric (in particulary universal) space to the properties of distance …

2004-02-16abs ↗pdf ↗

Neural networks are known to be vulnerable to adversarial examples, inputs that have been intentionally perturbed to remain visually similar to the source input, but cause a misclassification. It was recently shown that given a dataset and classifier, there exists so called universal adversarial perturbations, a single…

2017-08-17abs ↗pdf ↗

A new framework for systematic graph neural network data augmentation.

problem Diversity and difficulty in choosing graph neural network data augmentation techniques.
method Comprehensive framework capturing all previous RDAs, formal universality proof, automatic training method.
result Improved state of the art through new RDAs and impartial comparison.

Machine learning techniques are being applied to scientific fields, showing promise and challenges.

problem Applying machine learning to scientific data poses challenges in universality and robustness.
method Critical analysis of anomaly detection techniques, focusing on data universality, robustness, and transferability.
result Machine learning techniques show potential but also present domain-specific challenges.

Minimum width for ReLU networks to approximate L^p functions is max(d_x+1, d_y).

problem Characterizing the minimum width for ReLU networks to approximate L^p functions.
method Analyzing networks with ReLU activation functions and proving the minimum width required.
result The minimum width required for the universal approximation of L^p functions is exactly max(d_x+1, d_y).

This note provides a neat and enjoyable expansion and application of the magnificent Ordentlich-Cover theory of "universal portfolios." I generalize Cover's benchmark of the best constant-rebalanced portfolio (or 1-linear trading strategy) in hindsight by considering the best bilinear trading strategy determined in hin…

2019-07-23abs ↗pdf ↗

Unified method for CNNs to approximate equivariant maps across various groups.

problem Limited universal approximation theorems for CNNs with specific groups and settings.
method Unified approach to derive universal approximation theorems for equivariant maps by CNNs in diverse settings.
result Ability to handle non-linear equivariant maps between infinite-dimensional spaces for non-compact groups.

In this work, we demonstrate the existence of universal adversarial audio perturbations that cause mis-transcription of audio signals by automatic speech recognition (ASR) systems. We propose an algorithm to find a single quasi-imperceptible perturbation, which when added to any arbitrary speech signal, will most likel…

2019-05-09abs ↗pdf ↗

This research formalizes uncertainty quantification for Universal Differential Equations models.

problem Quantifying uncertainties in Universal Differential Equations models.
method Formalized uncertainty quantification methods for UDEs, including frequentist and Bayesian approaches.
result Evaluation of ensemble, variational inference, and MCMC sampling methods for UDEs.

Data augmentation affects estimates' uncertainty and distribution in complex ways.

problem Understanding how data augmentation impacts the variance and limiting distribution of estimates.
method Developed an adaptation of Lindeberg's technique for block dependence.
result Data augmentation can increase rather than decrease uncertainty, and it may shift the double-descent peak of an empirical risk.

Single-head attention approximates any function under various norms.

problem Universal approximation of functions using attention mechanisms.
method Interpreting attention as partitioning and summing linear transformations.
result Single-head attention can approximate any continuous function under LL_\infty-norm and Lebesgue integrable functions under LpL_p-norm.

New method generates universal adversarial perturbations across different image sources.

problem Certifying robustness of deep learning models with universal adversarial perturbations across various image sources.
method Few-shot learning approach using bilevel optimization and learning-to-optimize techniques.
result Improved attack success rate and faster performance compared to existing methods.

We present proofs of classical results in Poisson geometry using techniques from Dirac geometry. This article is based on mini-courses at the Poisson summer school in Geneva, June 2016, and at the workshop "Quantum Groups and Gravity" at the University of Waterloo, April 2016.

2016-12-02abs ↗pdf ↗

Study proves deep narrow RNNs can approximate any function, with minimum width independent of data length.

problem Proving universality of deep narrow RNNs with bounded widths.
method Analyzing RNNs as dynamical systems, proving universality for deep narrow structures with specific widths.
result Minimum width for universality of deep narrow RNNs is independent of data length.

We explore the complex associated to a link in the geometric formalism of Khovanov's (n=2) link homology theory, determine its exact underlying algebraic structure and find its precise universality properties for link homology functors. We present new methods of extracting all known link homology theories directly from…

2007-06-25abs ↗pdf ↗

A practical limitation of deep neural networks is their high degree of specialization to a single task and visual domain. Recently, inspired by the successes of transfer learning, several authors have proposed to learn instead universal, fixed feature extractors that, used as the first stage of any deep network, work w…

2018-03-27abs ↗pdf ↗

We introduce the TUH EEG Seizure Corpus (TUSZ), which is the largest open source corpus of its type, and represents an accurate characterization of clinical conditions. In this paper, we describe the techniques used to develop TUSZ, evaluate their effectiveness, and present some descriptive statistics on the resulting …

2018-01-03abs ↗pdf ↗

Paper develops efficient methods for estimating Hessian inverses in stochastic optimization.

problem Estimating the inverse Hessian for convex function minimization.
method Robbins-Monro procedure for recursive estimation of the inverse Hessian.
result Develops universal stochastic Newton methods with improved efficiency.

Inductive transfer learning has greatly impacted computer vision, but existing approaches in NLP still require task-specific modifications and training from scratch. We propose Universal Language Model Fine-tuning (ULMFiT), an effective transfer learning method that can be applied to any task in NLP, and introduce tech…

2018-01-18abs ↗pdf ↗

The universe's shape and size are determined in general cosmological models.

problem Determining the shape and size of the universe in general cosmological models.
method Using differential geometry and extensions of the Bonnet-Myers theorem, the researchers derived conditions for a finite universe and provided a list of possible topologies.
result The spatial sections of the universe can be either S1imesS2S^1 imes S^2, S1ildeimesS2S^1 ilde{ imes}S^2, S1imesRP2S^1 imes\mathbb{RP}^2, RP3#RP3\mathbb{RP}^3 \# \mathbb{RP}^3, or covered by the sphere S3S^3 or torus T3T^3.

This paper improves support recovery in universal one-bit compressed sensing with fewer measurements.

problem Support recovery in universal one-bit compressed sensing.
method Developed algorithms to recover the support of sparse signals with a small number of false positives.
result Support recovery with ildeO(k3/2) ilde{O}(k^{3/2}) measurements, improving to ildeO(k) ilde{O}(k) with known dynamic range.

A grand challenge of the 21st century cosmology is to accurately estimate the cosmological parameters of our Universe. A major approach to estimating the cosmological parameters is to use the large-scale matter distribution of the Universe. Galaxy surveys provide the means to map out cosmic large-scale structure in thr…

2017-11-06abs ↗pdf ↗

Deep residual networks can approximate any continuous function using control theory.

problem Universal approximation capabilities of deep residual neural networks.
method Relating residual networks to control systems and using Lie algebraic techniques.
result Deep residual networks with adequately deep layers can approximate any continuous function on a compact set.

Soft Truncation improves diffusion model performance by balancing loss scales across diffusion times.

problem Inverse correlation between density estimation and sample generation in diffusion models.
method Introduces Soft Truncation, a training technique that softens the truncation hyperparameter.
result Soft Truncation achieves state-of-the-art performance on various datasets.