Superposition accelerates training to a universal power-law exponent.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Study harmonic surfaces in 3D space, proving superposition principle.
Superposition rules form a class of functions that describe general solutions of systems of first-order ordinary differential equations in terms of generic families of particular solutions and certain constants. In this work we extend this notion and other related ones to systems of higher-order differential equations …
Mixed superposition rules, i.e., functions describing the general solution of a system of first-order differential equations in terms of a generic family of particular solutions of first-order systems and some constants, are studied. The main achievement is a generalization of the celebrated Lie-Scheffers Theorem, char…
In many learning tasks, structural models usually lead to better interpretability and higher generalization performance. In recent years, however, the simple structural models such as lasso are frequently proved to be insufficient. Accordingly, there has been a lot of work on "superposition-structured" models where mul…
The paper develops methods to derive mixed superposition rules for Lie systems and applies them to various physical systems.
Quantum machine learning uses superposition to create a large ensemble of classifiers.
We consider the class of integer rectifiable currents without boundary satisfying a positivity condition. We establish that these currents can be written as a linear superposition of graphs of finitely many functions with bounded variation.
Formulae for Bäcklund transformations of hyperbolic and elliptic sine-Gordon/sinh-Gordon equations.
New algorithm extracts features from superpositions in machine learning models.
Observing a linear superposition principle, a family of new minimal hypersurfaces in Euclidean space is found, as well as that linear combinations of generalized helicoids induce new algebraic minimal cones of arbitrarily high degree.
High dimensional superposition models characterize observations using parameters which can be written as a sum of multiple component parameters, each with its own structure, e.g., sum of low rank and sparse matrices, sum of sparse and rotated sparse vectors, etc. In this paper, we consider general superposition models …
Superposition in autoencoders leads to loss in simple models.
Paper introduces Manifold Probe for discovering representation manifolds in superposition.
New methods combine model predictions to avoid linear mixtures' limitations.
We consider the learning of multi-agent Hawkes processes, a model containing multiple Hawkes processes with shared endogenous impact functions and different exogenous intensities. In the framework of stochastic maximum likelihood estimation, we explore the associated risk bound. Further, we consider the superposition o…
The study examines Euclid's Book I, focusing on area applications and construction methods.
Paper proposes an algorithm to reconstruct optimal model structure from graph adjacency matrix.
Sparse superposition codes were recently introduced by Barron and Joseph for reliable communication over the AWGN channel at rates approaching the channel capacity. The codebook is defined in terms of a Gaussian design matrix, and codewords are sparse linear combinations of columns of the matrix. In this paper, we prop…
MIMONets speed up neural network inference by processing multiple inputs in parallel.
Gravitational instantons are constructed as superpositions of Atiyah-Hitchin and Taub-NUT geometries.
We analyze families of non-autonomous systems of first-order ordinary differential equations admitting a common time-dependent superposition rule, i.e., a time-dependent map expressing any solution of each of these systems in terms of a generic set of particular solutions of the system and some constants. We next study…
Quantum computing speeds up asset pricing models exponentially.
Explores tensor products in hyperdimensional computing.
We consider the demixing problem of two (or more) structured high-dimensional vectors from a limited number of nonlinear observations where this nonlinearity is due to either a periodic or an aperiodic function. We study certain families of structured superposition models, and propose a method which provably recovers t…
SupSup model learns thousands of tasks without forgetting, using randomly initialized subnetworks.
A theory of feature geometry using spectral analysis of weight matrices.
The superposition of temporal point processes has been studied for many years, although the usefulness of such models for practical applications has not be fully developed. We investigate superposed Hawkes process as an important class of such models, with properties studied in the framework of least squares estimation…
We develop theoretical foundations of Resonator Networks, a new type of recurrent neural network introduced in Frady et al. (2020) to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures. Given a composite vector formed by the Hadamard product between a discrete set of high-dim…
This paper proves a version for stochastic differential equations of the Lie-Scheffers Theorem. This result characterizes the existence of nonlinear superposition rules for the general solution of those equations in terms of the involution properties of the distribution generated by the vector fields that define it. Wh…
Study new -contact distributions and Lie systems.
We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an algorithm that stably estimate the underlying components under general \emph{struc…
We show that Scherk's first surface, a one-parameter family of solutions to the minimal surface equation, may be written as a linear superposition of other solutions with specific parametric values.
Simpler proof for non-basic sets in 2D.
Defines manifolds of mappings between function spaces and discusses their properties.
We fit the volatility fluctuations of the S&P 500 index well by a Chi distribution, and the distribution of log-returns by a corresponding superposition of Gaussian distributions. The Fourier transform of this is, remarkably, of the Tsallis type. An option pricing formula is derived from the same superposition of Black…
Quantum algorithms for multi-armed bandits are explored with limited reward access.
Automated method finds meaningful directions in neural network activations.
Recently, Generative Adversarial Networks (GANs) have emerged as a popular alternative for modeling complex high dimensional distributions. Most of the existing works implicitly assume that the clean samples from the target distribution are easily available. However, in many applications, this assumption is violated. I…
In this paper we develop some group theoretical methods which are shown to be very useful for a better understanding of the properties of the Riccati equation and we discuss some of its integrability conditions from a group theoretical perspective. The nonlinear superposition principle also arises in a simple way.
Near-future large galaxy surveys will encounter blended galaxy images at a fraction of up to 50% in the densest regions of the universe. Current deblending techniques may segment the foreground galaxy while leaving missing pixel intensities in the background galaxy flux. The problem is compounded by the diffuse nature …
This work concerns the definition and analysis of a new class of Lie systems on Poisson manifolds enjoying rich geometric features: the Lie--Hamilton systems. We devise methods to study their superposition rules, time independent constants of motion and Lie symmetries, linearisability conditions, etc. Our results are i…
It is proved that the members of the Riccati hierarchy, the so-called Riccati chain equations, can be considered as particular cases of projective Riccati equations, which greatly simplifies the study of the Riccati hierarchy. This also allows us to characterize Riccati chain equations geometrically in terms of the pro…
Quantum variational circuits improve reinforcement learning efficiency.
During the fabrication of casting parts sensor data is typically automatically recorded and accumulated for process monitoring and defect diagnosis. As casting is a thermal process with many interacting process parameters, root cause analysis tends to be tedious and ineffective. We show how a decomposition based on non…
Proves Khovanov homology functoriality and positivity for gl2 webs.
Quantum computing improves training of binary neural networks.
APD method decomposes neural network parameters into simple, faithful components.