WISDoM uses the Wishart distribution to analyze neurological data like EEG and brain connectivity.
problem Characterizing deviations of covariance or correlation matrices from expected values.
method WISDoM framework for quantifying deviations from the Wishart distribution.
result Validated on EEG feature ranking and classification of autism subjects.
The paper develops scalable Bayesian models for dynamic covariance matrices using Gaussian processes.
problem Modeling dynamic and heteroskedastic covariance matrices for multivariate time series.
method Gradient-based variational inference for Wishart and inverse Wishart processes, with modifications for scalability and factoring.
result The modified models can scale to high-dimensional covariance matrices and outperform multivariate GARCH in covariance forecasting.
Bayesian framework for analyzing heterogeneous covariance data with a novel MoE-Wishart model.
problem Analyzing complex multivariate systems with varying covariance structures.
method Comprehensive Bayesian framework using mixture-of-experts Wishart model with predictor-dependent mixture weights.
result Accurate subpopulation recovery and estimation in heterogeneous covariance scenarios.
A non-Hermitean extension of paradigmatic Wishart random matrices is introduced to set up a theoretical framework for statistical analysis of (real, complex and real quaternion) stochastic time series representing two "remote" complex systems. The first paper in a series provides a detailed spectral theory of non-Hermi…
Research on random matrices and machine learning consistency.
problem Understanding consistency in machine learning and random matrix theory.
method Analytical and theoretical approaches to Laguerre matrices, Wishart matrices, and machine learning algorithms.
result Derived necessary and sufficient conditions for inverse moments of matrices and consistency of machine learning algorithms.
A new method for deep Wishart processes improves kernel-based models.
problem Inference in deep Wishart processes is challenging due to the need for flexible distributions over positive semi-definite matrices.
method Developed a novel approach to flexible distributions over positive semi-definite matrices using the Bartlett decomposition of the Wishart probability density. Used this to create an approximate posterior for the DWP.
result Improved performance of inference in the DWP compared to DGP with equivalent prior.
Study on Gaussian ensemble of matrix products with mixed moments computed.
problem Understanding the statistical properties of matrix products of Gaussian matrices.
method Analysis of a multi-Wishart ensemble and enumeration of non-crossing pairings.
result Mixed moments of the product matrix are computed and found to be weighted by Fuss-Catalan numbers at large N. Deep kernel processes unify various models using Gram matrices and kernel functions.
problem Unified representation of various deep learning models.
method Defining deep kernel processes with progressively transformed Gram matrices and sampling from inverse Wishart distributions.
result Deep Gaussian processes, BNNs, infinite BNNs, and infinite BNNs with bottlenecks can all be written as deep kernel processes.
Improved variational approximation for deep Wishart process models.
problem Improving predictive performance of deep Wishart process models.
method Generalizing the Bartlett decomposition of the Wishart distribution to allow linear combinations of rows and columns.
result Better predictive performance achieved with minimal additional computation cost.
In this paper, we obtain a property of the expectation of the inverse of compound Wishart matrices which results from their orthogonal invariance. Using this property as well as results from random matrix theory (RMT), we derive the asymptotic effect of the noise induced by estimating the covariance matrix on computing…
This work deals with the simulation of Wishart processes and affine diffusions on positive semidefinite matrices. To do so, we focus on the splitting of the infinitesimal generator, in order to use composition techniques as Ninomiya and Victoir or Alfonsi. Doing so, we have found a remarkable splitting for Wishart proc…
We introduce a stochastic process with Wishart marginals: the generalised Wishart process (GWP). It is a collection of positive semi-definite random matrices indexed by any arbitrary dependent variable. We use it to model dynamic (e.g. time varying) covariance matrices. Unlike existing models, it can capture a diverse …
New framework for calculating multivariate risk measures using Wishart process.
problem Quantifying multivariate risk measures in financial markets.
method Introducing a new analytical framework based on the Wishart process.
result Explicit computation of conditional tail risk measures up to two dimensions.
Study analyzes eigenvalue distributions of non-i.i.d. Wishart matrices using replica analysis and belief propagation.
problem Eigenvalue distribution of non-i.i.d. Wishart matrices.
method Replica analysis and belief propagation.
result Determines asymptotic eigenvalue distribution and proposes an algorithm based on belief propagation.
Iterative method 'Concent' corrects spectrum bias in covariance matrices.
problem Consistent bias in the spectrum of covariance matrices.
method 'Concent' iterative algorithm.
result Corrects spectrum bias for small and moderate dimensions.
Study on likelihood functions, associative equations, and Frobenius manifolds.
problem Maximum likelihood estimation and associativity equations in statistical models.
method Analyzes the cone of concentration matrices, log-likelihood function, and Frobenius manifolds.
result Maximum likelihood degree is indexed by components of Frobenius residuals.
We consider a short rate model, driven by a stochastic process on the cone of positive semidefinite matrices. We derive sufficient conditions ensuring that the model replicates normal, inverse or humped yield curves.
Proposes a new method for publishing covariance matrices while maintaining privacy and preserving matrix properties.
problem Publishing covariance matrices while ensuring differential privacy and maintaining positive semi-definiteness.
method Uses a Wishart distribution to generate matrix noise for differential privacy in principal component analysis.
result Demonstrates better utility compared to the Laplace mechanism and provides a near optimal bound.
New method allows generating independent data matrices from summary statistics.
problem Generating independent data matrices from summary statistics like mean and covariance.
method Thinning a Wishart random matrix based on sample mean and covariance.
result It is possible to generate two independent data matrices from summary statistics.
Random matrix theory is used to assess the significance of weak correlations and is well established for Gaussian statistics. However, many complex systems, with stock markets as a prominent example, exhibit statistics with power-law tails, that can be modelled with Levy stable distributions. We review comprehensively …
Algorithm detects and estimates correlated signals in spiked matrices.
problem Detect and estimate correlated signals in spiked matrices.
method Proposes an efficient algorithm based on counting edge-decorated cycles.
result Algorithm succeeds under certain signal-to-noise ratio conditions.
The paper explores Cholesky decompositions for symmetric matrices and their geometric properties.
problem Understanding the structure and properties of symmetric matrices through Cholesky decompositions.
method Introducing cones of symmetric matrices, proving Cholesky-type factorizations, and showing geometric properties.
result Each symmetric matrix admits an uncountable family of Cholesky-type factorizations, and these cones are isometric Riemannian manifolds.
We present an original and novel method based on random matrix approach that enables to distinguish the respective role of temporal autocorrelations inside given time series and cross correlations between various time series. The proposed algorithm is based on properties of Wigner eigenspectrum of random matrices inste…
Random matrix theory improves financial market analysis by smoothing out noise.
problem Choosing an appropriate epoch for computing empirical cross-correlation matrices in financial markets.
method Power mapping to apply non-linear distortion to short epoch correlation matrices, controlling noise and removing degeneracy of zero eigenvalues.
result Interesting properties of eigenvalue spectra are found in simulated and empirical return matrices.
Study reveals an equivalence principle for the spectrum of random inner-product kernel matrices in polynomial scaling.
problem Understanding the spectrum of random kernel matrices in polynomial scaling regimes.
method Investigates random matrices with nonlinear kernel functions applied to inner products of uniformly distributed vectors.
result The spectrum of the random kernel matrix is asymptotically equivalent to a simpler matrix model through free additive convolution.
Complex systems are typically represented by large ensembles of observations. Correlation matrices provide an efficient formal framework to extract information from such multivariate ensembles and identify in a quantifiable way patterns of activity that are reproducible with statistically significant frequency compared…
New lower bounds for sampling from log-concave distributions in higher dimensions.
problem Proving lower bounds for sampling from log-concave distributions in higher dimensions.
method Multiscale construction inspired by geometric measure theory and reduction to block Krylov algorithms.
result Query lower bounds for sampling from log-concave distributions in higher dimensions are established.
We introduce a mean-reverting SDE whose solution is naturally defined on the space of correlation matrices. This SDE can be seen as an extension of the well-known Wright-Fisher diffusion. We provide conditions that ensure weak and strong uniqueness of the SDE, and describe its ergodic limit. We also shed light on a use…
The paper updates Bayesian CMA-ES with normal Wishart and proves lower expected covariance.
problem Improving the Bayesian CMA-ES algorithm with normal Wishart prior.
method Revisits Bayesian CMA-ES, proves lower expected covariance in normal Wishart, and presents a generalized model.
result Proves that the expected covariance is lower in the normal Wishart prior model due to convexity of the inverse.
Improves signal detection in non-Gaussian noise using transformed data.
problem Signal detection in rank-one signal-plus-noise data matrices.
method Pre-transforming matrix entries and using linear spectral statistics for hypothesis testing.
result Sharp phase transition of largest eigenvalues in spiked rectangular matrices.
We investigate serial correlation, periodic, aperiodic and scaling behaviour of eigenmodes, i.e. daily price fluctuation time-series derived from eigenvectors, of correlation matrices of shares listed on the Johannesburg Stock Exchange (JSE) from January 1993 to December 2002. Periodic, or calendar, components are dete…
Paper explores Elliptical Wishart distributions in signal processing and machine learning.
problem Estimating parameters of Elliptical Wishart distributions.
method Proposes fixed point and Riemannian optimization algorithms for maximum likelihood estimation.
result Characterizes existence, uniqueness, and convergence of the MLE.
In order to pursue the issue of the relation between the financial cross-correlations and the conventional Random Matrix Theory we analyse several characteristics of the stock market correlation matrices like the distribution of eigenvalues, the cross-correlations among signs of the returns, the volatility cross-correl…
Paper proposes a method for estimating complex low-rank matrices from phase-only measurements.
problem Estimating complex low-rank matrices from magnitude-only measurements.
method A hierarchical prior model with a Gaussian-Wishart distribution is used to promote low-rankness. A variational EM algorithm is developed to solve the problem.
result The proposed method is less sensitive to initialization and performs well with random initialization.
Study proposes a new model for joint survival annuity valuation.
problem Valuation of joint survival annuities and options.
method Linear-rational Wishart mortality model based on stochastic matrix affine process.
result Derives closed-form expression for joint survival annuity and option.
Estimates KRR risk from training data for various kernels and hyperparameters.
problem Predicting the generalization error of Kernel Ridge Regression.
method Introduces SCT and KARE to approximate KRR risk from training data.
result KARE provides an excellent approximation of KRR risk and helps select good kernels.
New matrix ensembles better match deep neural network spectral densities.
problem Theoretical spectral density models for deep networks do not match empirical observations.
method Introduced new matrix ensemble classes to better fit observed spectral densities.
result Theoretical models for deep networks are significantly flawed.
New method uses KL-divergence to create non-informative priors for multivariate Gaussian.
problem Handling hyperparameters for non-informative limits in multivariate Gaussian conjugate priors.
method Using scaled KL-divergence between multivariate Gaussians to construct Wishart and normal-Wishart conjugate priors.
result Forming non-informative priors without violating Wishart shape parameter restrictions.
Model credit risk with non-stationary correlations using random matrices.
problem Estimating non-stationary asset correlations for credit risk modeling.
method Random matrix ensemble to model non-stationary correlations, averaging over an ensemble of correlation matrices.
result Explicit results show heavy tails prevail over diversification benefits even with small correlations.
PCA can detect a low-rank signal but is suboptimal for non-Gaussian matrices and synchronization problems.
problem Understanding the optimal and suboptimal performance of PCA in spiked random matrix models.
method Analysis of spiked random matrix models, including Gaussian and non-Gaussian Wigner ensembles, and synchronization problems.
result PCA achieves optimal detection for Gaussian Wigner ensembles under benign priors but is suboptimal for non-Gaussian matrices and synchronization problems.
Researchers develop a new SMC sampler for Wishart processes to improve dynamic covariance inference.
problem Challenging inference of dynamic covariance in various scientific fields.
method Introduce Sequential Monte Carlo (SMC) sampler for the Wishart process.
result SMC sampling provides more robust estimates and out-of-sample predictions of dynamic covariance.
Bayesian inference for stochastic differential equations using Wishart diffusions.
problem Inferring stochastic differential equations for regression and dynamical modeling.
method Bayesian non-parametric approach with semi-parametric Wishart processes.
result Modeling diffusion in stochastic differential equations improves performance and avoids overfitting.
Spectral portfolio theory links neural networks to wealth dynamics via SGD weight matrices.
problem Understanding wealth dynamics from neural network training.
method Direct identification of weight matrices as portfolio allocation matrices, linking SGD forces to portfolio dynamics.
result Spectral properties of SGD weight matrices transition between additive and multiplicative regimes, influencing wealth dynamics.
Researchers derive an explicit Laplace transform for integrated Volterra Wishart process.
problem Modeling and pricing financial instruments with complex covariance structures.
method Explicit expression for conditional Laplace transform of integrated Volterra Wishart process, linking to matrix Riccati equations.
result Derivation of Laplace transform for a special case of convolution kernel, leading to efficient pricing methods.
Clusters of financial market states identified over 2006-2019.
problem Understanding the statistical properties of financial markets.
method Clustering analysis of correlation matrices constructed from sliding epochs.
result Financial markets can be classified into distinct states with transitions indicating precursors to catastrophic events.
Optimal data splitting improves covariance matrix estimation in large datasets.
problem Improving large covariance matrix estimation in high-dimensional settings.
method Focus on holdout method, derive closed-form error expression, connect to eigenvalue variance.
result Optimal train-test split scales as square root of matrix dimension.
Bayesian framework transfers knowledge between domains with limited labeled data.
problem Improving prediction performance in target domain with limited labeled data.
method Bayesian transfer learning framework using joint Wishart density for precision matrices.
result Superior performance compared to state-of-the-art methods on synthetic and real-world data.
A new method clusters subjects based on brain networks without vectorizing fMRI data.
problem Distortion of clustering results when simplifying fMRI data structure.
method Wishart mixture models for multiple-view clustering of brain networks.
result Identifies multiple underlying pairs of associations between subject clusters and brain sub-networks.