We consider the learning of multi-agent Hawkes processes, a model containing multiple Hawkes processes with shared endogenous impact functions and different exogenous intensities. In the framework of stochastic maximum likelihood estimation, we explore the associated risk bound. Further, we consider the superposition o…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “superposition operators”
A theory of feature geometry using spectral analysis of weight matrices.
problem Current methods decompose neural network activations into sparse linear features, losing geometric structure.
method Develops a theory by analyzing the spectra of weight-derived matrices, introducing the frame operator.
result Features collapse onto single eigenspaces, organizing into tight frames, and admit discrete classification.
Superposition accelerates training to a universal power-law exponent.
problem Training dynamics in neural networks.
method Teacher-student framework and analytic theory.
result Superposition leads to a universal power-law exponent of ~1, independent of data and channel statistics.
Manifolds of mappings associated with real-valued function spaces and natural mappings between themmath.DG
Defines manifolds of mappings between function spaces and discusses their properties.
problem Defining smooth manifolds of mappings between function spaces.
method Defines a smooth manifold structure on sets of continuous mappings and discusses properties of natural mappings.
result Properties of spaces of sections and smoothness of natural mappings between spaces of mappings.
MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in Superpositioncs.LG
MIMONets speed up neural network inference by processing multiple inputs in parallel.
problem Reducing computational cost in neural network inference for large datasets.
method Proposes MIMONets, which augment neural network architectures with variable binding mechanisms to handle multiple inputs in superposition.
result Achieves significant speedups (2-4x) with minimal accuracy loss, demonstrating adaptability across different architectures.
Study harmonic surfaces in 3D space, proving superposition principle.
problem Understanding harmonic surfaces in .
method Using harmonic Enneper immersions and superposition principle.
result Minimal and maximal surfaces can be decomposed into harmonic components.
Superposition rules form a class of functions that describe general solutions of systems of first-order ordinary differential equations in terms of generic families of particular solutions and certain constants. In this work we extend this notion and other related ones to systems of higher-order differential equations …
Mixed superposition rules, i.e., functions describing the general solution of a system of first-order differential equations in terms of a generic family of particular solutions of first-order systems and some constants, are studied. The main achievement is a generalization of the celebrated Lie-Scheffers Theorem, char…
Quantum credit loansq-fin.GN
Quantum mechanics applied to credit loans for better repayment schedules.
problem Improving repayment schedules for credit loans.
method Introducing quantum mechanics concepts to credit loans, defining operators for debt, amortization, interest, and installments, and using SO(M) symmetry to optimize periodic payments.
result Optimized repayment schedules for borrowers without altering lender's earnings.
In many learning tasks, structural models usually lead to better interpretability and higher generalization performance. In recent years, however, the simple structural models such as lasso are frequently proved to be insufficient. Accordingly, there has been a lot of work on "superposition-structured" models where mul…
The paper develops methods to derive mixed superposition rules for Lie systems and applies them to various physical systems.
problem Finding general solutions for Lie systems.
method Develops mixed superposition rules for Lie systems with imprimitive Lie algebras and semidirect sums.
result Extends coalgebra method to Lie systems of partial differential equations.
Quantum machine learning uses superposition to create a large ensemble of classifiers.
problem Improving machine learning efficiency on quantum computers.
method Using superposition to create an exponentially large ensemble of classifiers, trained with an optimization-free learning algorithm.
result Adding an optimization step improves the performance of quantum ensembles of classifiers.
We consider the class of integer rectifiable currents without boundary satisfying a positivity condition. We establish that these currents can be written as a linear superposition of graphs of finitely many functions with bounded variation.
Formulae for Bäcklund transformations of hyperbolic and elliptic sine-Gordon/sinh-Gordon equations.
problem Finding solutions for specific types of equations.
method Providing superposition formulae for Bäcklund transformations.
result Algebraically obtain infinitely many solutions after first integration.
New algorithm extracts features from superpositions in machine learning models.
problem Challenges in extracting interpretable features from complex models in superposition.
method An efficient query algorithm that identifies non-degenerate feature directions and reconstructs the function.
result Identifies all feature directions whose responses are non-degenerate and reconstructs the function \( f \) in a general superposition setting.
Observing a linear superposition principle, a family of new minimal hypersurfaces in Euclidean space is found, as well as that linear combinations of generalized helicoids induce new algebraic minimal cones of arbitrarily high degree.
High dimensional superposition models characterize observations using parameters which can be written as a sum of multiple component parameters, each with its own structure, e.g., sum of low rank and sparse matrices, sum of sparse and rotated sparse vectors, etc. In this paper, we consider general superposition models …
Superposition in autoencoders leads to loss in simple models.
problem Mechanistic interpretability of neural networks
method Analyzing mathematical basis for superposition and providing bounds for reconstruction loss
result Upper and lower bounds for L2 reconstruction loss in the sparse regime
Paper introduces Manifold Probe for discovering representation manifolds in superposition.
problem Discovering representation manifolds in complex superposition representations.
method Generalizes linear regression probes to learn feature spaces and directions in superposition representations.
result Demonstrates Manifold Probe on Llama 2-7b representations, finding causally involved manifolds in model behaviour.
New methods combine model predictions to avoid linear mixtures' limitations.
problem Combining predictions from different models to avoid linear mixtures' limitations.
method Log-linear pooling (locking) and quantum superposition (quacking) to optimise model weights.
result Demonstrated locking method with illustrative example and practical application.
The study examines Euclid's Book I, focusing on area applications and construction methods.
problem Exploring Euclid's geometric constructions and proofs, particularly those involving area calculations.
method Summarizing medieval editions and ancient commentaries, comparing constructions and proofs.
result Medieval editions often avoid Euclid's use of superposition in area proofs, offering alternative constructions.
Paper proposes an algorithm to reconstruct optimal model structure from graph adjacency matrix.
problem Optimal model structure reconstruction from weighted colored graph adjacency matrix.
method Uses prize-collecting Steiner tree algorithm to reconstruct minimum spanning tree.
result Demonstrates the effectiveness of the prize-collecting Steiner tree algorithm for model structure reconstruction.
A notion known as smooth envelope, or superposition closure, appears naturally in several approaches to generalized smooth manifolds which were proposed in the last decades. Such an operation is indispensable in order to perform differential calculus. A derivation of the enveloping algebra can be restricted to the orig…
Sparse superposition codes were recently introduced by Barron and Joseph for reliable communication over the AWGN channel at rates approaching the channel capacity. The codebook is defined in terms of a Gaussian design matrix, and codewords are sparse linear combinations of columns of the matrix. In this paper, we prop…
Gravitational instantons are constructed as superpositions of Atiyah-Hitchin and Taub-NUT geometries.
problem Constructing gravitational instantons from Atiyah-Hitchin and Taub-NUT geometries.
method A gluing construction that captures the superposition of moduli spaces of centred SU(2) monopoles and Taub-NUT manifolds.
result Gravitational instantons are explicitly shown to be superpositions of Atiyah-Hitchin and Taub-NUT geometries.
We analyze families of non-autonomous systems of first-order ordinary differential equations admitting a common time-dependent superposition rule, i.e., a time-dependent map expressing any solution of each of these systems in terms of a generic set of particular solutions of the system and some constants. We next study…
We develop a multivalued theory for the stability operator of (a constant multiple of) a minimally immersed submanifold of a Riemannian manifold . We define the multiple valued counterpart of the classical Jacobi fields as the minimizers of the second variation functional defined on a Sobolev space of …
Quantum computing speeds up asset pricing models exponentially.
problem Solving dynamic nonlinear asset pricing models efficiently.
method Utilizes quantum superposition and entanglement to solve models exponentially faster than classical methods.
result Exponential computational speed-up for solving asset pricing models.
Quantum algorithm improves ensemble classification with reduced memory and time requirements.
problem High memory and computational time requirements in ensemble methods.
method Quantum superposition, entanglement, and interference to build an ensemble of classification models.
result Exponential growth of ensemble size with linear increase in depth of circuit.
Explores tensor products in hyperdimensional computing.
problem Understanding tensor products in hyperdimensional computing.
method Generalized results from graph embeddings to vector symbolic architectures and hyperdimensional computing.
result Tensor product is the most general and expressive representation with errorless unbinding and detection.
We consider the demixing problem of two (or more) structured high-dimensional vectors from a limited number of nonlinear observations where this nonlinearity is due to either a periodic or an aperiodic function. We study certain families of structured superposition models, and propose a method which provably recovers t…
SupSup model learns thousands of tasks without forgetting, using randomly initialized subnetworks.
problem Sequentially learning many tasks without forgetting.
method Randomly initialized base network with task-specific subnetworks (supermasks).
result Gradient-based optimization can identify the correct subnetwork for new tasks.
New method for explaining neural network activation functions.
problem Transparency in black-box deep learning algorithms.
method Symbolic explanation of activation functions using adaptive Gaussian Processes.
result Achieved partially explainable learning model with scalable topology.
The superposition of temporal point processes has been studied for many years, although the usefulness of such models for practical applications has not be fully developed. We investigate superposed Hawkes process as an important class of such models, with properties studied in the framework of least squares estimation…
Resonator Networks outperform optimization methods at solving high-dimensional vector factorizationcs.NE
We develop theoretical foundations of Resonator Networks, a new type of recurrent neural network introduced in Frady et al. (2020) to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures. Given a composite vector formed by the Hadamard product between a discrete set of high-dim…
This paper proves a version for stochastic differential equations of the Lie-Scheffers Theorem. This result characterizes the existence of nonlinear superposition rules for the general solution of those equations in terms of the involution properties of the distribution generated by the vector fields that define it. Wh…
This paper proposes a brain-inspired approach to quantum machine learning with the goal of circumventing many of the complications of other approaches. The fact that quantum processes are unitary presents both opportunities and challenges. A principal opportunity is that a large number of computations can be carried ou…
Study new -contact distributions and Lie systems.
problem Characterizing and understanding -contact distributions.
method Analyzing Goursat distributions and Lie systems.
result Characterized new types of -contact distributions.
We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an algorithm that stably estimate the underlying components under general \emph{struc…
We show that Scherk's first surface, a one-parameter family of solutions to the minimal surface equation, may be written as a linear superposition of other solutions with specific parametric values.
Endowing differentiable functions from a compact manifold to a Lie group with the pointwise group operations one obtains the so-called current groups and, as a special case, loop groups. These are prime examples of infinite-dimensional Lie groups modelled on locally convex spaces. In the present paper, we generalise th…
Proposes a new graph representation method using tensor products.
problem Dynamic graph representation and theoretical properties.
method Bind-and-sum approach in hyperdimensional computing (HDC), tensor product as binding operation.
result Memory vs. size analysis of graph representation size scaling.
Simpler proof for non-basic sets in 2D.
problem Proving non-basic sets in 2D.
method Defining Sternfeld arrays and proving non-basic sets.
result Simpler proof of non-basic sets in 2D.
We fit the volatility fluctuations of the S&P 500 index well by a Chi distribution, and the distribution of log-returns by a corresponding superposition of Gaussian distributions. The Fourier transform of this is, remarkably, of the Tsallis type. An option pricing formula is derived from the same superposition of Black…
Quantum algorithms for multi-armed bandits are explored with limited reward access.
problem Exploring quantum speed-ups in multi-armed bandit problems with limited reward information.
method Introduced new bandit models and showed query complexity equivalence with classical algorithms.
result No quadratic speed-up is possible for multi-armed bandits with limited reward access.
Automated method finds meaningful directions in neural network activations.
problem Mixed selectivity in neurons makes interpretation challenging.
method Automated quantification of interpretability and discovery of meaningful directions.
result Meaningful directions in neural network activations are more interpretable than individual neurons.
In this work, we formulate the fixed-length distribution matching as a Bayesian inference problem. Our proposed solution is inspired from the compressed sensing paradigm and the sparse superposition (SS) codes. First, we introduce sparsity in the binary source via position modulation (PM). We then present a simple and …
We propose a unified framework to solve general low-rank plus sparse matrix recovery problems based on matrix factorization, which covers a broad family of objective functions satisfying the restricted strong convexity and smoothness conditions. Based on projected gradient descent and the double thresholding operator, …