Paper proposes a new covariance estimator ensuring positive semi-definite matrices.
problem Estimating spot covariance matrices while maintaining positive semi-definiteness.
method Modification of the Fourier covariance estimator with a symmetric positive semi-definite constraint.
result The estimator is consistent and produces accurate positive semi-definite matrices.
Extends Gaussian process theory to Banach spaces.
problem Extending Gaussian process theory to Banach spaces.
method Investigates the connection between Gaussian processes and Gaussian random elements in reproducing kernel Banach spaces.
result Characterizes positive definite functions that arise from covariance operators in Banach space setting.
Abstract: Review and definitions of generalised spin structures, their connections, and symmetry algebra.
problem Understanding and characterizing generalised spin structures and their properties.
method Definitions, basic notions, connections, covariant Lie derivative, covariant Cartan calculus, symmetry algebra.
result Characterization of homogeneous generalised spin structures.
Paper defines and proves geometric uniqueness of Einstein field equations.
problem Einstein field equations characteristic Cauchy problem
method Covariant definition of double null data, proving geometric uniqueness
result Double null data fully covariant and geometrically unique
Proposes a new Sliced-Wasserstein distance for covariance matrices in M/EEG signals.
problem Efficiently dealing with distributions of covariance matrices in M/EEG multivariate time series.
method Defines a Sliced-Wasserstein distance for symmetric positive definite matrices and applies it to brain-age prediction and Brain Computer Interface applications.
result Demonstrates computational efficiency and strong theoretical guarantees for the proposed distance.
Three definitions of a differential form on a tangent structure are considere. It is proved that the (covariant) definition given by Souriau (as a collection of forms indexed by the plaques) is equivalent to a smooth section of the corresponding vector bundle if the space does not have transverse points.
This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be directly extended to use a nonconvex penalty for sparsity inducing. Generally, a…
Paper proposes a deep learning method for better covariance matrix forecasting.
problem Suboptimal predictive performance in traditional matrix volatility forecasting.
method Riemannian-geometry-aware deep learning framework for symmetric positive definite matrices.
result Our method outperforms traditional approaches in predictive accuracy.
We introduce and study covariance fields of distributions on a Riemannian manifold. At each point on the manifold, covariance is defined to be a symmetric and positive definite (2,0)-tensor. Its product with the metric tensor specifies a linear operator on the respected tangent space. Collectively, these operators form…
Improved method for computing Fréchet means on SPD matrices.
problem Computing Fréchet means on the manifold of SPD matrices.
method Random matrix theory-based approach for estimating Fréchet means.
result Significantly outperforms state-of-the-art methods in experiments.
Paper proposes a new algorithm for graph learning with covariance constraints.
problem Graphical models and factor analysis not jointly leveraged in graph learning processes.
method Penalized maximum likelihood estimation of an elliptical distribution with Riemannian optimization.
result Effectiveness of the proposed approach demonstrated on real-world data sets.
Unified learning bound for covariate and concept shifts.
problem Generalization under distribution shift in machine learning.
method Support-agnostic definitions of covariate and concept shifts using entropic optimal transport, leading to a unified error bound applicable to various loss functions and label spaces.
result Development of estimators for shifts with concentration guarantees and the DataShifts algorithm for quantifying and estimating the error bound.
This note improves correlation stress tests using geodesic distance.
problem Improving financial risk management through better covariance stress tests.
method Proposes a new geometrically invariant definition of correlation stress tests.
result Demonstrates a submanifold approach to stress testing covariance matrices.
Predict covariance from features using convex optimization.
problem Predicting the covariance of a Gaussian vector from another feature vector.
method A generalized linear model with convex optimization for fitting parameters.
result Predicted covariance matrices are symmetric positive definite.
New findings on optimization landscape of Toeplitz covariance estimation.
problem Understanding the geometry of the Gaussian maximum-likelihood objective for Toeplitz covariance estimation.
method Overparameterized Carathéodory representation of positive definite Toeplitz covariance matrices, focusing on both amplitudes and frequencies.
result Joint optimization of amplitudes and frequencies leads to a benign population landscape, allowing for global recovery of the true Toeplitz covariance.
Method estimates sparse inverse covariance and partial correlation matrices efficiently.
problem Sparse high-dimensional inverse covariance and partial correlation matrix estimation.
method Two-stage estimation method using partial regression with positive semi-definiteness.
result Efficient estimation of inverse covariance and partial correlation matrices with derived non-asymptotic rates.
New method for estimating financial covariance matrices efficiently.
problem Noisy covariance matrix estimation in high-dimensional financial data.
method Cluster financial time series into groups, apply shrinkage to ensure positive definiteness.
result Proposed methods provide reliable estimates and outperform other estimators.
Study on estimating distances between covariance operators and Gaussian processes.
problem Estimating distances between covariance operators and Gaussian processes.
method Riemannian distances, concentration results for Hilbert space-valued random variables, RKHS covariance and cross-covariance operators.
result Both distances converge in the Hilbert-Schmidt norm and can be consistently and efficiently estimated.
New method efficiently learns positive-definite curvature for neural nets.
problem Efficiently learn positive-definite curvature for neural net training.
method Spectral-factorized positive-definite curvature learning approach.
result Efficiently applies arbitrary matrix roots and generic curvature learning.
The paper explores using historical data to improve clinical trial analysis by optimizing covariate weights.
problem Limited covariates in small clinical trials reduce the effectiveness of analysis.
method Leverage historical data to pre-specify covariate weights as a composite covariate.
result A composite covariate improves the cost/benefit ratio and reduces overfitting in small clinical trials.
Recent studies utilize multiple kernel learning to deal with incomplete-data problem. In this study, we introduce new methods that do not only complete multiple incomplete kernel matrices simultaneously, but also allow control of the flexibility of the model by parameterizing the model matrix. By imposing restrictions …
Let G be a finite connected simple graph. We define the moduli space of conformal structures on G. We propose a definition of conformally covariant operators on graphs, motivated by [25]. We provide examples of conformally covariant operators, which include the edge Laplacian and the adjacency matrix on graphs. In the …
Designing a covariance function that represents the underlying correlation is a crucial step in modeling complex natural systems, such as climate models. Geospatial datasets at a global scale usually suffer from non-stationarity and non-uniformly smooth spatial boundaries. A Gaussian process regression using a non-stat…
Proposes a new Gaussian factor for probabilistic inference with degenerate settings.
problem Handling linear dependencies among random variables in Gaussian networks.
method Introduces a parametrised factor that relaxes the positive-definite constraint of the covariance matrix.
result Accurately accommodates degeneracies in probabilistic inference without significant computational overhead.
The paper shows objective derivatives are covariant derivatives on Riemannian metrics.
problem The definition and interpretation of objective derivatives in continuum mechanics.
method Demonstrates that objective derivatives correspond to covariant derivatives on the manifold of Riemannian metrics.
result Objective derivatives are unified as covariant derivatives on the manifold of Riemannian metrics.
Develops a fast algorithm for fitting multilevel factor models.
problem Fitting multilevel factor models with covariance structure.
method Novel expectation-maximization algorithm tailored for multilevel factor models.
result Shows efficient computation of inverse of positive definite MLR matrix.
Like most learning algorithms, the multilayer perceptrons (MLP) is designed to learn a vector of parameters from data. However, in certain scenarios we are interested in learning structured parameters (predictions) in the form of symmetric positive definite matrices. Here, we introduce a variant of the MLP, referred to…
Introduces intrinsic Riemannian cross-covariance for manifold-valued random objects.
problem Covariance estimation for random objects on Riemannian manifolds.
method Defines covariance and correlation via parallel transport.
result Proposed covariance is independent of coordinate choices.
Defines natural tensors for submanifolds of pseudo-Riemannian manifolds.
problem Characterizing tensors for submanifolds of pseudo-Riemannian manifolds.
method Constructs geodesic normal coordinates and expresses metric coefficients as polynomials in curvature and second fundamental form derivatives.
result Natural tensors are linear combinations of contractions of curvature and second fundamental form derivatives.
We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization problems. Recently, it was shown that the underlying principle behind their succ…
We generalize Hansen--Strobl's definition of H-twisted Courant algebroid such that the twist H of the Jacobi identity is a 4-form in the kernel of the anchor map and is closed under a naturally occurring exterior covariant derivative. We give examples and define a cohomology.
Regularized EM algorithm improves clustering performance with small sample sizes.
problem Performance reduction in EM algorithm due to small sample size and poorly conditioned covariance matrices.
method Regularized EM algorithm that uses prior knowledge to ensure positive definiteness of covariance matrices.
result The regularized EM algorithm outperforms standard EM in clustering tasks with small sample sizes.
We quantify causal bias in continuous treatment settings.
problem Identifying and quantifying causal bias in continuous treatment scenarios.
method Developed a novel characterization of causal bias in structural causal models, proving conditions for zero bias and efficient estimation.
result Causal bias can be estimated efficiently under certain structural equation restrictions, allowing for causal regularization of predictive models.
This paper derives radial fields on manifolds of symmetric positive definite matrices.
problem Lack of an expression for radial fields on manifolds of symmetric positive definite matrices.
method Derives an expression for radial fields on manifolds of symmetric positive definite matrices.
result Derives an expression for radial fields on manifolds of symmetric positive definite matrices.
This work presents a parametrized family of divergences, namely Alpha-Beta Log- Determinant (Log-Det) divergences, between positive definite unitized trace class operators on a Hilbert space. This is a generalization of the Alpha-Beta Log-Determinant divergences between symmetric, positive definite matrices to the infi…
Unified approach to Bayesian inference with guarantees on covariance matrices.
problem Approximate Bayesian inference with PSD guarantees.
method Bayes-Newton methods extending Newton's method for optimisation.
result Novel algorithms with PSD covariance matrices.
A new way to describe correlation matrices makes modeling easier.
problem Describing correlation matrices in a flexible and positive-definite way.
method Introduces a novel parametrization that allows unrestricted vectors for correlation matrices.
result The new parametrization ensures positive definiteness without additional constraints.
Paper quantizes heavy-tailed data for near optimal estimation rates.
problem Estimating parameters from heavy-tailed data with quantization.
method Truncate and dither data, then uniformly quantize; achieves near minimax rates.
result Near optimal estimation rates achievable with quantized data.
The paper explores totally geodesic submanifolds in SPD matrices and their properties.
problem Characterizing and understanding totally geodesic submanifolds in SPD matrices.
method Detailed geometric analysis and projection properties of SPD matrices.
result A non-linear projection on totally geodesic submanifolds has the minimizing property.
In the study of conformal geometry, the method of elliptic partial differential equations is playing an increasingly significant role. Since the solution of the Yamabe problem, a family of conformally covariant operators (for definition, see section 2) generalizing the conformal Laplacian, and their associated conforma…
ITSPACE improves covariance alignment faster than other methods.
problem Optimizing covariance matrices for machine learning tasks.
method Proximal majorization-minimization method that directly optimizes the Bures-Wasserstein objective.
result ITSPACE achieves lower BW gap solutions faster than other methods.
We find a closed-form determinant for a specific sparse covariance matrix model.
problem Finding the determinant of a specific class of sparse positive definite matrices.
method Using Fourier transform of local factors, Normal Factor Graph Duality Theorem, and Matrix Determinant Lemma.
result We derive a closed-form expression for the determinant.
Gaussian graphical models are semi-algebraic subsets of the cone of positive definite covariance matrices. Submatrices with low rank correspond to generalizations of conditional independence constraints on collections of random variables. We give a precise graph-theoretic characterization of when submatrices of the cov…
Defines constraint tensor for null hypersurfaces, providing explicit geometry.
problem Defining constraint tensor for null hypersurfaces with any topology.
method Explicit definition in extrinsic geometry, covariant for any topology.
result Simple form of constraint tensor on transverse submanifolds.
Riemannian geometry has been applied to Brain Computer Interface (BCI) for brain signals classification yielding promising results. Studying electroencephalographic (EEG) signals from their associated covariance matrices allows a mitigation of common sources of variability (electronic, electrical, biological) by constr…
We introduce a stochastic process with Wishart marginals: the generalised Wishart process (GWP). It is a collection of positive semi-definite random matrices indexed by any arbitrary dependent variable. We use it to model dynamic (e.g. time varying) covariance matrices. Unlike existing models, it can capture a diverse …
Regularized EM algorithm improves GMM clustering in low sample settings.
problem Numerical instability and convergence issues in EM-GMM for low sample support.
method Regularized EM algorithm that maximizes penalized GMM likelihood, ensuring positive definiteness and structured covariance matrices.
result The regularized EM algorithm leads to better performing EM for structured covariance matrix models or low sample settings.
Efficiently solves large portfolio optimization problems by reducing and sparsifying covariance matrices.
problem Large and dense covariance matrices limit efficient portfolio optimization.
method Dimension reduction and increased sparsity based on machine learning predictions.
result Improved portfolio performance and reduced runtime compared to full dense covariance matrices.