A hierarchical Gaussian prior model improves low-rank matrix completion.
problem Low-rank matrix completion with improved structure exploitation.
method Hierarchical Gaussian prior model with GAMP embedded variational Bayesian inference.
result The proposed method outperforms state-of-the-art matrix completion methods.
Paper analyzes convergence of distributed inference using BP in linear Gaussian models.
problem Distributed inference convergence in linear Gaussian models.
method Factor graphs, Gaussian belief propagation, local computation, message passing.
result Message information matrix converges to a unique positive definite limit matrix at a doubly exponential rate.
NGD improves multivariate Gaussian inference by optimizing Fisher information.
problem Efficiently optimizing multivariate Gaussian models.
method Natural Gradient Descent applied to multivariate Gaussian parameters.
result NGD updates are more efficient for symmetric covariance matrices.
New method estimates multivariate Gaussian fields using sparse precision matrix.
problem Estimating covariance matrices for large multivariate Gaussian fields.
method Sparse Precision Matrix Selection (SPS) algorithm for multivariate GRFs.
result Theoretical rates of convergence for estimated covariance and parameters validated.
A scalable Gaussian process model using a mixture-of-experts approach.
problem Training Gaussian process models is computationally expensive and not scalable.
method A mixture-of-experts model with low-dimensional matrix inversions and importance sampling.
result The model offers comparable performance to Gaussian process regression at a lower computational cost.
Paper introduces a new method for Gaussian Processes that improves prediction and hyper-parameter optimization.
problem Efficiently predicting unknown functions and optimizing hyper-parameters in Gaussian Processes.
method Sequential randomized low-rank matrix factorization for incremental predictions and hyper-parameter optimization.
result The proposed method outperforms existing approaches in terms of accuracy and computational efficiency.
A new optimization algorithm for Gaussian Variational Inference on precision matrices.
problem Complex models with positive definite constraints on covariance matrices.
method Manifold Gaussian Variational Bayes (MGVBP) with natural gradient updates.
result Empirically validated as a feasible and efficient solution for VI in complex models.
New MVG mechanism improves differential privacy for matrix-valued queries.
problem Lack of optimal methods for matrix-valued queries in differential privacy.
method Proposes MVG mechanism using matrix-variate Gaussian noise.
result Proves MVG mechanism preserves (ε,δ)-differential privacy. Paper improves efficiency in matrix computations for Gaussian processes.
problem Efficiency in matrix computations for Gaussian processes.
method Variance reduction via matrix factorization.
result Factorized estimator can be up to 1,000 times more efficient.
We use matricial free energy to regularize autoencoders, producing Gaussian-like codes.
problem Generating Gaussian-like codes for autoencoders.
method Define a differentiable loss function based on singular values of the code matrix, minimizing matricial free energy.
result Minimizing matricial free energy results in Gaussian-like codes that generalize.
Efficiently clusters nodes in Gaussian graphical models from data.
problem Clustering nodes in Gaussian graphical models directly from data.
method Clusters nodes based on the similarity of their network neighborhoods defined by partial correlations. Uses matrix factors for limited data.
result Demonstrates improved clustering of nodes in Gaussian graphical models.
Study on Gaussian ensemble of matrix products with mixed moments computed.
problem Understanding the statistical properties of matrix products of Gaussian matrices.
method Analysis of a multi-Wishart ensemble and enumeration of non-crossing pairings.
result Mixed moments of the product matrix are computed and found to be weighted by Fuss-Catalan numbers at large N. Introduces a new model for directed relationships in Gaussian data.
problem Learning directed relationships in Gaussian data.
method Developed a new directed graphical model (GGIM) from Gaussian data, leveraging stationary Gaussian processes on graphs.
result GGIMs can be framed as a LASSO problem and have a bound on the difference from the l1-norm penalized maximum log-likelihood estimate. The paper analyzes how Gaussian kernel parameters affect posterior covariance in Gaussian processes.
problem Understanding the influence of Gaussian kernel parameters on posterior covariance in Gaussian processes.
method Geometric analysis and a posteriori error estimation techniques from adaptive finite element methods.
result The bandwidth parameter and spatial distribution of observations significantly influence posterior covariance and its matrix.
Generalizes randomized SVD for better matrix approximations using Gaussian vectors.
problem Computing accurate rank-k approximations of matrices with limited data.
method Extends randomized SVD to multivariate Gaussian vectors, incorporating prior knowledge and using Gaussian processes.
result Demonstrates improved accuracy in approximating matrices and Hilbert-Schmidt operators.
New algorithm recovers sparse, generic mixing matrix from covariance of mixed data.
problem Recovering independent components from mixed Gaussian data.
method Sparse and generic mixing matrix, efficient algorithm.
result Efficiently recovers mixing matrix from covariance of mixed data.
ISEE method efficiently estimates large precision matrices in Gaussian graphical models.
problem Estimating large precision matrices in ultra-large Gaussian graphical models.
method ISEE method combines sparse modeling and large covariance matrix estimation.
result ISEE method can recover graphical structure with significant probability and efficient estimation of link strengths.
The paper connects Gaussian matrix models to cohomological field theories using topological recursion.
problem Understanding Gaussian matrix model means in all genera.
method Explicit relation between Gaussian means and KPMM, topological recursion.
result Coefficients of Gaussian means in all genera are polynomials in special times weighted by ancestor invariants.
Efficiently computes matrix square roots and their inverses for large matrices.
problem Computing matrix square roots and inverses for large matrices efficiently.
method Combines Krylov subspace methods with rational approximation for quadratic-time computation.
result Achieves 4 decimal places of accuracy with fewer than 100 matrix-vector multiplications.
New bounds for private matrix approximation using Gaussian noise and Dyson Brownian Motion.
problem Private approximation of symmetric matrices with Gaussian noise.
method Viewing Gaussian noise as Dyson Brownian Motion to track eigenvalue and eigenvector evolution.
result Improved bounds on Frobenius-distance utility for private matrix approximation.
Efficient deep learning with matrix Gaussian posteriors.
problem Efficiently modeling correlations in deep neural networks.
method Employing matrix variate Gaussian posterior distribution with approximate covariance matrices and incorporating pseudo-data.
result Achieved more efficient representation of correlations and connections with Gaussian Processes.
This work analyzes self-attention matrices using random matrix theory.
problem Understanding the theoretical behavior of self-attention layers in neural networks.
method Asymptotic spectral analysis of the attention matrix, Gaussian equivalence, and linearization.
result The singular value distribution of the attention matrix is asymptotically characterized by a linear model.
Develops a new MCMC-based Wishart prior for Gaussian Process covariance matrix.
problem Difficult inference for multivariate Gaussian Processes with multiple lengthscale parameters.
method Introduces a self-assembled Wishart prior and uses MCMC for Bayesian inference on kernel hyperparameters.
result Demonstrates the effectiveness of the new prior in GP-based learning with empirical results.
Develops a Gaussian-based message-passing algorithm for noisy matrix completion.
problem Noisy matrix completion problems.
method Gaussian parameterized belief propagation algorithm.
result Advantages over traditional methods in non-Gaussian noise scenarios.
Extends spectral number variance convergence to random matrix ensembles for twisted Laplacians.
problem Spectral number variance convergence for twisted Laplacians and Dirac operators.
method Extends Rudnick's approach to Gaussian ensembles for twisted Laplacians and Dirac operators.
result Convergence to Gaussian ensembles for twisted Laplacians and Dirac operators.
Study on overlaps of singular vectors in Gaussian matrix submatrices.
problem Analyzing overlaps of singular vectors in submatrices of Gaussian matrices.
method Utilizes dynamics of singular vectors and specific resolvents for Brownian trajectories.
result Explicit forms for limiting rescaled mean squared overlaps in the bulk of spectra.
GPyTorch accelerates GP inference using GPU hardware.
problem Inefficient GP inference tools on modern hardware.
method Blackbox Matrix-Matrix (BBMM) inference with GPU acceleration.
result Significant speedup in GP inference and approximations.
Develops a Gaussian model to compute the Alexander polynomial of knots.
problem Computing the Alexander polynomial of knots.
method Uses perturbed Gaussian functions, Heisenberg algebra, and tensor-contraction formalism.
result Associates a Gaussian function to a knot whose partition function recovers the Alexander polynomial.
Paper proposes a generalized precision matrix for t-Student distributions to improve portfolio optimization.
problem Limitations of inverse covariance matrix in non-Gaussian settings.
method Exploits local dependence function to define generalized precision matrix (GPM) for multivariate t-Student distribution.
result GPM leads to statistically significant lower out-of-sample variances in minimum-variance portfolios.
PACE-GGM uses Gaussian mechanism for private covariance estimation.
problem Private estimation of covariance matrices in high dimensions.
method Data-adaptive selection of entries, Gaussian mechanism, maximum-entropy reconstruction.
result Consistent improvements in estimation error compared to Gaussian mechanism and baselines.
TGP enhances collaborative filtering with side information using Gaussian Processes.
problem Improving collaborative filtering with side information.
method Formulated a Tucker Gaussian Process (TGP) that incorporates low-rank matrix factorisation and side information.
result Enhanced predictive performance for collaborative filtering problems.
Improved neural network inference with eigenvalue correction.
problem Inference of flexible variational posteriors is computationally expensive.
method Eigenvalue correction to matrix-variate Gaussian posterior.
result Empirically, the method outperforms existing algorithms.
Transposable data represents interactions among two sets of entities, and are typically represented as a matrix containing the known interaction values. Additional side information may consist of feature vectors specific to entities corresponding to the rows and/or columns of such a matrix. Further information may also…
Paper offers robust recovery for 1-bit sensing with partial Gaussian circulant matrices.
problem Accurately recovering vectors from 1-bit measurements using structured matrices.
method Correlation-based optimization with randomly signed partial Gaussian circulant matrices and generative models.
result Recovery guarantees match those for i.i.d. Gaussian matrices but with faster computation.
We simplify matrix computations for block matrices, especially useful for covariance and correlation matrices.
problem Complex computations for block matrices, especially for covariance and correlation matrices.
method Obtained a canonical representation for block matrices, facilitating computation of various matrix operations.
result Simplified computation of matrix operations for block matrices, particularly useful for covariance and correlation matrices.
Spectral clustering performance depends on eigenvector fluctuations, shown to be Gaussian.
problem Predicting the performance of spectral clustering.
method General spike random matrix model and rotational invariance of noise.
result Fluctuations of eigenvector entries are Gaussian in large-dimensional regime.
We propose a novel hierarchical model for multitask bipartite ranking. The proposed approach combines a matrix-variate Gaussian process with a generative model for task-wise bipartite ranking. In addition, we employ a novel trace constrained variational inference approach to impose low rank structure on the posterior m…
Corrected whitening restores orthogonality in high-dimensional spherical Gaussian mixtures.
problem In high-dimensional data, standard whitening fails to preserve orthogonality of mixture means.
method Derived exact limits for whitened means dot products using random matrix theory, constructed a corrected whitening matrix.
result Corrected whitening allows for improved estimation of spherical Gaussian mixtures in the large-dimensional regime.
Proposes a new method for selecting regularization parameters in sparse precision matrix estimation.
problem Selecting an appropriate regularization parameter for sparse precision matrix estimation.
method Developed a closed-form matrix-valued regularization parameter based on the sampling distribution of optimality conditions.
result The proposed method achieves comparable estimation accuracy and superior support recovery to cross-validation, with significant runtime improvements.
A new method clusters rows of a matrix of point processes.
problem Challenges in analyzing structured point process data.
method Mixture model of multi-level marked point processes, combined with ES algorithm and FPCA.
result An efficient method for clustering rows of a matrix of point processes.
New iterative solvers speed up Gaussian process regression with derivatives.
problem Scaling Gaussian process regression with derivatives for high-dimensional problems and large budgets.
method Iterative solvers using fast matrix-vector multiplications and pivoted Cholesky preconditioning.
result Bayesian optimization with derivatives can now scale to high-dimensional problems and large evaluation budgets.
The paper models financial correlation matrices using permutation invariant Gaussian models and predicts market anomalies.
problem Modeling and predicting financial correlation matrices from high-frequency data.
method Constructing permutation invariant Gaussian matrix models with 4 parameters, using graph theory and polynomial functions.
result The permutation invariant Gaussian matrix model predicts the expectation values of cubic and quartic polynomials with strong evidence of fit.
Paper connects neural networks to Gaussian processes for understanding double-descent.
problem Understanding the double-descent phenomenon in neural networks.
method Uses techniques from random matrix theory and Gaussian processes.
result Establishes a connection between NNGP and random matrix theory for neural networks.
Detects anomalies in Gaussian graphical models using contrastive estimation.
problem Detecting structural changes in Gaussian graphical models.
method Two-step approach: background precision matrix estimation and contrastive foreground precision estimation using ADMM.
result Significant improvement in precision and recall for detecting structural changes.
Improved perturbation reduces matrix condition number to O(n) with minimal storage.
problem Reducing the condition number of deterministic matrices for efficient algorithmic use.
method Introduced pattern matrices and sparse perturbations with dependent entries.
result Condition number reduced to O(n) with O(n) random numbers in O(log n) precision.
New method trains sparse Gaussian processes without matrix inversion.
problem Costly training of Gaussian processes at scale.
method Inverse-free approach using matmul-only natural-gradient updates.
result Significantly improved stability and convergence in training.
Paper characterizes and samples from the Matrix Generalized Inverse Gaussian distribution.
problem Properties and sampling methods for Matrix Generalized Inverse Gaussian distribution.
method Characterizes unimodality and solves Algebraic Riccati Equation for mode. Proposes importance sampling method.
result Proposed sampling method is more efficient than existing approaches.
Quantum-assisted Gaussian process speeds up data regression.
problem High computational complexity of Gaussian process regression for large datasets.
method Quantum-assisted sparse Gaussian process regression using random Fourier features.
result Achieves polynomial-order computational speedup compared to classical methods.