Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

55110165220 · May 202619922001200920172026
48 results for universal mechanism

Single-head attention approximates any function under various norms.

problem Universal approximation of functions using attention mechanisms.
method Interpreting attention as partitioning and summing linear transformations.
result Single-head attention can approximate any continuous function under LL_\infty-norm and Lebesgue integrable functions under LpL_p-norm.

A universal LSTM model outperforms asset-specific models in forecasting stock volatilities.

problem Forecasting stock volatilities across different assets.
method Trained an LSTM network on a pooled dataset of liquid stocks to forecast daily realized volatilities.
result The LSTM model consistently outperforms other asset-specific parametric models in volatility forecasting.

Universal model for soft tissue mechanics under shock waves.

problem Modeling shock wave mechanics in soft biological tissues.
method Continuum mixture theory with phase-field mechanics.
result Universal thermodynamically consistent formulation for soft porous tissues.

New model suggests universe emerges from single particle quantum mechanics.

problem Exploring how the universe might arise from a single particle in quantum mechanics.
method Novel spontaneous symmetry breaking acting on probability distributions of Hamiltonians.
result Evidence supports the hypothesis that nature seeks tensor decompositions.

This text explains how fiber bundle structure is fundamental for classical physics.

problem None explicitly stated, but implied as understanding fiber bundles is crucial for physics.
method Explains the fiber bundle structure and its universality for physics laws.
result Fiber bundle structure is fundamental for classical physics laws.

This study approximates neural network features for modeling relations and attention mechanisms.

problem Approximating neural network features for modeling relations and attention mechanisms.
method Analyzes inner products of multi-layer perceptrons for universal approximation of symmetric and asymmetric relation functions.
result Universal approximation of relation functions and attention mechanisms using inner products of neural networks.

New findings on universal learning in contextual bandits with adversarial rewards.

problem Learning in contextual bandits with time-varying, adversarial rewards.
method Characterization of learnable processes and necessary/sufficient conditions for universal learning.
result Optimistic universal learning for contextual bandits with adversarial rewards is impossible in general.

A mechanical linkage is a mechanism made of rigid rods linked together by flexible joints, in which some vertices are fixed and others may move. The partial configuration space of a linkage is the set of all the possible positions of a subset of the vertices. We characterize the possible partial configuration spaces of…

2014-01-06abs ↗pdf ↗

We present an axiomatic modification of quaternionic quantum mechanics with a possible-worlds semantics capable of predicting essential "nonquantum" features of an observable universe model - the dimensionality and topology of spacetime, the existence, the signature and a specific form of a metric on it, and certain na…

2007-02-28abs ↗pdf ↗

Softmax attention approximates complex functions and subsumes many known universal approximators.

problem Universal approximation of continuous sequence-to-sequence functions.
method Interpolation-based analysis of attention's internal mechanism, showing its ability to approximate ReLU functions.
result Softmax attention is a universal approximator for continuous sequence-to-sequence functions.

Deep neural networks near edge of chaos show universal scaling laws.

problem Understanding the behavior of deep neural networks near critical points.
method Analogy to absorbing phase transitions in statistical mechanics, deterministic propagation dynamics, mean-field and directed percolation universality classes.
result Deep neural networks exhibit universal scaling laws near the edge of chaos.

Paper develops a privacy-preserving nonparametric regression method.

problem Nonparametric regression with local differential privacy constraints.
method Privatised discretisation and Laplace noise applied to feature vectors and responses.
result Strongly universally consistent estimator for regression and classification.

This work establishes universality for deep equivariant networks, overcoming limitations of previous approaches.

problem Rarity of universality results for equivariant neural networks, especially in high-dimensional settings.
method Develops a more general account of universality for equivariant networks, introducing entry-wise separability and readout layers.
result Deep equivariant networks achieve universality under entry-wise separability, with or without readout layers.

A mechanical linkage is a mechanism made of rigid rods linked together by flexible joints, in which some vertices are fixed and others may move. The partial configuration space of a linkage is the set of all the possible positions of a subset of the vertices. We characterize the possible partial configuration spaces of…

2014-07-25abs ↗pdf ↗

These notes were inspired by the course ''Quantum Field Theory from a Functional Integral Point of View'' given at the University of Zurich in Spring 2017 by Santosh Kandel. We describe Feynman's path integral approach to quantum mechanics and quantum field theory from a functional integral point of view, where the mai…

2019-02-22abs ↗pdf ↗

In this paper we develop a Hamilton-Jacobi theory in the setting of almost Poisson manifolds. The theory extends the classical Hamilton-Jacobi theory and can be also applied to very general situations including nonholonomic mechanical systems and time dependent systems with external forces.

2012-09-24abs ↗pdf ↗

Geometric mechanics approach to constrained and floating multibody systems using Hamel's equations.

problem Analytical mechanics of constrained and floating multibody systems.
method Geometric approach using bundle structures and connections, with Hamel's equations as a universal non-holonomic formulation.
result Achieved intrinsic splitting and inertial decoupling of reduced Euler-Lagrange equations.
Research in Econophysicscond-mat.stat-mech

This article is written for the online newspaper "The Photon" published by the Department of Physics, University of Maryland. The article describes econophysics research done in the group of Victor Yakovenko. It briefly surveys the subjects "Statistical Mechanics of Money, Income, and Wealth" and "Probability Distribut…

2003-02-13abs ↗pdf ↗

In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." In this manuscript we introduce the SciML software ecosystem as a tool for mixing the information of physical laws and scientific models with data-driven machine learning approache…

2020-01-13abs ↗pdf ↗

The abstract explores a new wave equation linking quantum mechanics and complex adaptive systems.

problem Understanding the underlying mechanism of distribution formation in complex quantum entanglement.
method Exploring the logical relationship between Schrödinger's wave equation and Shi's trading volume-price wave equation in finance.
result A non-localized wave equation in quantum mechanics reveals the invariance of interaction as a universal law.

Model approximates continuous functions in 1-Wasserstein space.

problem Approximating continuous functions in 1-Wasserstein space.
method Probabilistic Transformer (PT) model with three phases: feature map, deep neural network, and probabilistic extension of attention mechanism.
result Can approximate any continuous function from R^d to P1(R^D) uniformly on compact sets.

This paper describes a language representation model which combines the Bidirectional Encoder Representations from Transformers (BERT) learning mechanism described in Devlin et al. (2018) with a generalization of the Universal Transformer model described in Dehghani et al. (2018). We further improve this model by addin…

2019-05-16abs ↗pdf ↗

Single-layer Transformer can approximate any sequence mapping.

problem Lack of theoretical understanding of Transformers.
method Review of linear algebra, probability, and optimization concepts; detailed analysis of Transformer architecture.
result A single-layer Transformer can approximate any continuous sequence-to-sequence mapping to arbitrary precision.

It is now well established empirically that financial price changes are distributed according to a power law, with cubic exponent. This is a fascinating regularity, as it holds for various classes of securities, on various markets, and on various time scales. The universality of this law suggests that there must be som…

2016-12-27abs ↗pdf ↗

New framework predicts crypto volatility, outperforming traditional models.

problem Forecasting volatility in cryptocurrencies during the crypto-winter.
method Combines LSTM and rough volatility models, using a parsimonious parametric model.
result Similar prediction performances with fewer parameters, suggesting universality of volatility mechanisms.

Generative diffusion models exhibit phase transitions in statistical mechanics, impacting their performance.

problem Understanding the performance and capabilities of generative diffusion models.
method Reformulating generative diffusion models using statistical mechanics, focusing on phase transitions and symmetry breaking.
result Generative diffusion models undergo second-order phase transitions with mean-field universality, critical instability, and mean-field critical exponents.

We consider the binary classification problem in a setup that preserves the privacy of the original sample. We provide a privacy mechanism that is locally differentially private and then construct a classifier based on the private sample that is universally consistent in Euclidean spaces. Under stronger assumptions, we…

2019-12-10abs ↗pdf ↗

We argue that an important contributing factor into market inefficiency is the lack of a robust mechanism for the stock price to rise if a company has good earnings, e.g., via buybacks/dividends. Instead, the stock price is prone to volatility due to rather random perception/interpretation of earnings announcements (am…

2015-11-04abs ↗pdf ↗

Many independent studies on stocks and futures contracts have established that market impact is proportional to the square-root of the executed volume. Is market impact quantitatively similar for option markets as well? In order to answer this question, we have analyzed the impact of a large proprietary data set of opt…

2016-02-09abs ↗pdf ↗

Dropout schedules can be optimized to significantly reduce model test loss.

problem Improving model performance in neural networks.
method Developed a mean-field theory of dropout at the edge of chaos, proposing front-loaded dropout schedules.
result Front-loaded dropout schedules reduce test loss by 18-35% over constant dropout.

The paper presents instructive interdisciplinary applications of constrained mechanics calculus in economics on a level appropriate for the undergraduate physics education. The aim of the paper is: 1. to meet the demand for illustrative examples suitable for presenting the background of the highly expanding research fi…

2011-06-17abs ↗pdf ↗