Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

83166248331 · Jun 202019922001200920172026
48 results for matrix expectation identities

We study the problem of detecting an abrupt change to the signal covariance matrix. In particular, the covariance changes from a "white" identity matrix to an unknown spiked or low-rank matrix. Two sequential change-point detection procedures are presented, based on the largest and the smallest eigenvalues of the sampl…

2017-06-15abs ↗pdf ↗

This paper speeds up mean curvature computation for high-dimensional data.

problem Efficiently computing mean curvature in high-dimensional datasets.
method Two contributions: algebraic identity and truncated SVD approximation.
result Mean curvature computation reduced from O(m4)O(m^4) to O(k2m+kmp2)O(k^2 m + k m p^2).

New Stein identity for q-Gaussians reduces gradient variance in machine learning.

problem Improving gradient estimators for non-Gaussian distributions.
method Deriving a new Stein identity for bounded-support q-Gaussians and simplifying previous results.
result Gradient estimators for q-Gaussians have nearly identical forms to Gaussian ones, reducing variance.

We analyze quantum Yang-Mills theory on R2\mathbb{R}^2 using a novel discretization method based on an algebraic analogue of stochastic calculus. Such an analogue involves working with "Gaussian" free fields whose covariance matrix is indefinite rather than positive definite. Specifically, we work with Lie-algebra valu…

2016-07-25abs ↗pdf ↗

The paper models financial correlation matrices using permutation invariant Gaussian models and predicts market anomalies.

problem Modeling and predicting financial correlation matrices from high-frequency data.
method Constructing permutation invariant Gaussian matrix models with 4 parameters, using graph theory and polynomial functions.
result The permutation invariant Gaussian matrix model predicts the expectation values of cubic and quartic polynomials with strong evidence of fit.

New method estimates animal density using acoustic data, accounting for unknown call identities.

problem Estimating animal density or call density from acoustic data with unknown call identities.
method Monte Carlo Expectation-Maximization (MCEM) method to resolve unknown call identities.
result Estimates are within 15% of expert-constructed estimates and incorporate uncertainty about call identities.

Derives a general derivative identity for conditional mean in Gaussian noise.

problem Understanding conditional mean in Gaussian noise channels.
method Derives a general derivative identity for the conditional mean of X{\bf X} given Y=y{\bf Y}={\bf y} in a Markov chain UXY{\bf U} \leftrightarrow {\bf X} \leftrightarrow {\bf Y}.
result Provides a unifying view of conditional mean identities and derives new ones.

Develops a novel ML smoothing method for incomplete data in state-space models.

problem Estimating states in stochastic systems with incomplete information.
method Introduces score function and conditional observed information matrices for incomplete data, and uses them to derive the ML smoother.
result The ML smoother provides more accurate state estimates with lower standard errors compared to the standard ML state estimator.

We present a formula for the trace of any symmetric power of a n×nn\times n matrix (with coefficients in a field) in terms of the ordinary powers of the matrix, an arbitrarily chosen linear function which vanishes on the identity matrix, and n2n-2 polynomial functions defined recursively.

2014-11-03abs ↗pdf ↗

Study ridge regression for non-identically distributed data with varying variances.

problem Investigate high-dimensional regression with non-identical data variance.
method Propose a random effect model and use tools from random matrix theory.
result Highlight the double descent phenomenon in high-dimensional regression for certain variance profiles.

Explicit matrix presentations of Blanchfield pairings and twisted pairings for torus knots.

problem Computing explicit matrix presentations of Blanchfield and twisted Blanchfield pairings for torus knots.
method Using a taut identity to construct a chain complex with few generators, and describing the twisted Alexander module.
result Explicit matrix presentations of the Blanchfield pairing and twisted pairings for (m,n)(m,n)-torus knots.

Improved covariance matrix estimation for portfolio optimization with guaranteed PSD and controlled conditioning.

problem Guaranteeing positive semidefinite ness and controlling spectral conditioning in IQ estimators.
method Introducing squeezing identity and atomic-IQ parameterization to construct structured channel matrices with PSD guarantees and analytic eigen floor for conditioning control.
result Atomic-IQ improves Sharpe ratios and delivers a more stable risk profile compared to standard estimators.

The paper optimizes regret using covariance between costs and decisions.

problem Optimizing expected regret in decision-making problems.
method Developed derivative theory of covariance regret functional, derived Gâteaux derivative, and extended to constrained optimization.
result Gradient of covariance regret is the cost covariance matrix, with implications for portfolio optimization.

Lower bounds on private estimation of Gaussian covariance matrices.

problem Private estimation of Gaussian covariance matrices under various parameter regimes.
method Stein-Haff identity and fingerprinting lemma extensions.
result Lower bounds match existing upper bounds in the widest known parameters.

New algorithm for robust Boolean matrix factorization handles noise and missing data.

problem Robust probabilistic Boolean matrix factorization in the presence of noise and missing values.
method Probabilistic Expectation Maximization algorithm without latent factor assumptions.
result Outperforms state-of-the-art probabilistic algorithms on real data.

Determinantal averaging corrects inversion bias in distributed Newton's method.

problem Inverting a sum of distributed matrices is biased; local averages are incorrect.
method Reweighting local estimates of the Newton's step proportionally to the determinant of the local Hessian estimate, then averaging them.
result Determinantal averaging provides the first known asymptotically consistent distributed Newton step.

Geometrodynamics derived from Riemannian manifolds using geospin matrix.

problem Formulating dynamics on Riemannian manifolds using Cartan structural equations.
method Introducing four real dynamical variables and applying them to Cartan structural equations.
result Rewritten Cartan structural equations in a real geometrodynamical form.

Improved covariance matrix estimation for multiple classes with limited data.

problem Estimating covariance matrices for multiple classes with scarce data.
method Coupled regularized sample covariance matrix estimator (RSCM) that combines pooled SCM and scaled identity matrix for regularization.
result The coupled RSCM estimators outperform cross-validation in classification tasks with comparable accuracy but faster computation.

A new method for non-negative matrix factorization using generalized dual divergence.

problem Non-negative matrix factorization for various noise structures.
method Theoretical framework based on generalized dual Kullback-Leibler divergence, with algorithms developed and proven convergence using Expectation-Maximization.
result Generalizes existing methods and provides an alternative for non-negative matrix factorizations.

This paper develops a path-first theory using signatures and jump lifts for self-exiting processes.

problem Developing a universal coordinate system for various types of paths and processes.
method Using signatures, jump lifts, and expected signatures, the paper presents a geometricity framework with algebraic properties and obstructions.
result The framework links various mathematical concepts and offers four main contributions to understanding and modeling self-exiting processes.

Transformers interpreted as probabilistic Laplacian Eigenmaps steps.

problem Improving transformer performance through probabilistic interpretation.
method Probabilistic Laplacian Eigenmaps model derivation and graph diffusion step.
result Subtracting identity from attention matrix improves transformer performance.

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance of the data. However, PCA has two major weaknesses. Firstly, it only considers li…

2017-02-17abs ↗pdf ↗

The paper extends ternary algebra concepts using cube roots of unity.

problem Extending algebraic structures from binary to ternary multiplication.
method Introducing ternary associator, commutator, and Lie algebra at cube roots of unity.
result Derived an identity for ternary commutator based on GA(1,5)GA(1,5).

The paper explores various option pricing models by considering the volume of transactions and its impact on volatility.

problem The classical BSM model's assumption of identical Brownian processes for value and volume of transactions is challenged.
method The paper derives and analyzes 2D, 3D, and nonlinear BSM-like equations by considering the volume of transactions and agents' expectations.
result The introduction of volume into option pricing models leads to more complex and accurate equations.

A determinantal point process (DPP) is a probabilistic model of set diversity compactly parameterized by a positive semi-definite kernel matrix. To fit a DPP to a given task, we would like to learn the entries of its kernel matrix by maximizing the log-likelihood of the available data. However, log-likelihood is non-co…

2014-11-04abs ↗pdf ↗

We analyze algorithms for approximating a function f(x)=Φxf(x) = Φx mapping d\Re^d to d\Re^d using deep linear neural networks, i.e. that learn a function hh parameterized by matrices Θ1,...,ΘLΘ_1,...,Θ_L and defined by h(x)=ΘLΘL1...Θ1xh(x) = Θ_L Θ_{L-1} ... Θ_1 x. We focus on algorithms that learn through gradient descent on the population …

2018-02-16abs ↗pdf ↗

We estimate generic statistical properties of a structural credit risk model by considering an ensemble of correlation matrices. This ensemble is set up by Random Matrix Theory. We demonstrate analytically that the presence of correlations severely limits the effect of diversification in a credit portfolio if the corre…

2011-02-18abs ↗pdf ↗

We show that a simple randomized sketch of the matrix multiplicative weight (MMW) update enjoys (in expectation) the same regret bounds as MMW, up to a small constant factor. Unlike MMW, where every step requires full matrix exponentiation, our steps require only a single product of the form eAbe^A b, which the Lanczos …

2019-03-07abs ↗pdf ↗