We consider the problem of joint estimation of structured inverse covariance matrices. We perform the estimation using groups of measurements with different covariances of the same unknown structure. Assuming the inverse covariances to span a low dimensional linear subspace in the space of symmetric matrices, our aim i…
Structured credal learning separates covariate shift and label disagreement.
problem Uncertainty in real-world learning tasks due to covariate shift and noisy labels.
method Introduces a structured credal learning framework that explicitly separates these sources.
result Geometric bounds and decomposition reveal how covariate shifts affect label disagreement contributions.
The covariant canonical formalism is a covariant extension of the traditional canonical formalism of fields. In contrast to the traditional canonical theory, it has a remarkable feature that canonical equations of gauge theories or gravity are not only manifestly Lorentz covariant but also gauge covariant or diffeomorp…
New spectral clustering method handles discrete covariates for better community detection.
problem Community detection in networks with discrete covariates.
method Spectral algorithm that separates latent network structure from observed covariates.
result Achieves perfect clustering with high probability in large, sparse networks.
Novel approach for SEM in small samples with p>n.
problem Small sample size and p>n issues in factor-based SEM. method Reformulates covariance structure into self-covariance and cross-covariance, defines a feasible set with relative error constraint.
result Improved stability and directional information in small-sample settings.
Abstract: Review and definitions of generalised spin structures, their connections, and symmetry algebra.
problem Understanding and characterizing generalised spin structures and their properties.
method Definitions, basic notions, connections, covariant Lie derivative, covariant Cartan calculus, symmetry algebra.
result Characterization of homogeneous generalised spin structures.
Graphical models for covariance matrices improve structure learning.
problem Learning structure in graphical models for covariance matrices.
method Structural learning via ℓ1-penalized loss minimization. result Method outperforms alternatives in simulations and real-world applications.
New methods rank players using covariates and comparisons, outperforming existing algorithms.
problem Ranking players based on incomplete and noisy pairwise comparisons.
method Three spectral ranking methods incorporating player covariates.
result Proposed methods outperform existing algorithms in simulations.
Study analyzes bond price covariation robustly under no-arbitrage conditions.
problem Identifying the number of statistically relevant factors in the bond market.
method Nonparametric analysis of realized covariations in a general no-arbitrage setting.
result A high number of factors is needed to describe term structure evolution and term structure of volatility varies over time.
Method cleans covariance matrices for better statistical inference.
problem Reducing estimation noise in covariance matrices for better statistical inference.
method Robust yet flexible hierarchical ansatz with bootstrap procedure.
result Lower realized risk in global minimum variance portfolios.
Novel neural GP kernels learn stable, flexible covariance structures.
problem Scalable and flexible covariance kernels for Gaussian processes.
method Directly learn kriging coefficients and conditional standard deviations using deep neural architectures exploiting permutation-equivariant structure.
result Improved training stability and data efficiency with expressive, non-stationary kernels.
Nonsingular estimation of high dimensional covariance matrices is an important step in many statistical procedures like classification, clustering, variable selection an future extraction. After a review of the essential background material, this paper introduces a technique we call slicing for obtaining a nonsingular …
Study on Blaschke locus with covariance metric properties.
problem Riemannian structure of Blaschke locus.
method Analysis of Blaschke locus as a manifold, study of covariance metric properties.
result Geodesics in Blaschke locus have infinite length with respect to the covariance metric.
Study covariant derivatives of eigenfunctions on curved spaces, proving they are scalar multiples of the functions.
problem Understanding covariant derivatives of eigenfunctions on curved spaces.
method Analyzing the Laplace-Beltrami operator on Riemannian manifolds with constant curvature.
result Covariant derivatives of eigenfunctions are scalar multiples of the functions, and these scalars are polynomials in the eigenvalue.
A new model integrates covariates with grade of membership analysis for better latent structure recovery.
problem Improving latent structure recovery in multivariate categorical data analysis.
method Covariate-assisted grade of membership model exploiting shared low-rank simplex geometry.
result Auxiliary covariates can provably improve latent structure recovery, leading to faster convergence rates.
Nash integrates covariate-specific side info into sparse regression via neural networks.
problem Sparse linear regression struggles with covariates exhibiting structure or coming from heterogeneous sources.
method Neural Adaptive Shrinkage (Nash) framework that integrates side information into sparse regression via neural networks. Uses split variational empirical Bayes algorithm.
result Nash improves accuracy and adaptability over existing methods in real data experiments.
New methods test correlation between network structure and node features.
problem Assessing correlation between network structure and node-level covariates.
method Four novel methods based on linear models and canonical correlation analysis.
result Theoretical guarantees and computational efficiency for testing network dependency.
It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated high-dimensional data with unknown mean and dependence structures. Matrix-variate appr…
Proposes a convex method to estimate GGMs with covariates.
problem Improving conditional independence structure estimation with covariates.
method Convex optimization framework for joint estimation of mean and precision matrix.
result Improved theoretical guarantees and practical utility demonstrated.
This work develops a model to distinguish network and covariate information.
problem Identifying unique network and covariate information.
method Low-rank model with two-step estimation: spectral method followed by refinement.
result The method accurately recovers joint and individual components.
Two spectral algorithms for community detection in graphs with covariates are compared.
problem Detecting community structure in graphs with covariates.
method Two model-based spectral algorithms are presented and compared.
result The second algorithm often better estimates block assignments by accounting for vertex covariates.
This paper introduces a new data-driven methodology for estimating sparse covariance matrices of the random coefficients in logit mixture models. Researchers typically specify covariance matrices in logit mixture models under one of two extreme assumptions: either an unrestricted full covariance matrix (allowing correl…
Regularized EM algorithm improves GMM clustering in low sample settings.
problem Numerical instability and convergence issues in EM-GMM for low sample support.
method Regularized EM algorithm that maximizes penalized GMM likelihood, ensuring positive definiteness and structured covariance matrices.
result The regularized EM algorithm leads to better performing EM for structured covariance matrix models or low sample settings.
SOLVAR efficiently analyzes cryo-EM data's structural variability.
problem Analyzing continuous heterogeneity in cryo-EM data.
method Low-rank assumption on covariance matrix for tractable estimation.
result Accurately captures dominant components of structural variability.
This paper is the first work to propose a network to predict a structured uncertainty distribution for a synthesized image. Previous approaches have been mostly limited to predicting diagonal covariance matrices. Our novel model learns to predict a full Gaussian covariance matrix for each reconstruction, which permits …
This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking the prior structure information into account in the estimation procedure is benef…
We use the Nash embedding theorem to construct generators for the space of algebraic covariant derivative curvature tensors.
New methods estimate covariance for matrix data without assuming fixed size or specific distributions.
problem Estimating covariance for high-dimensional matrix data without distributional assumptions.
method Unified framework for bandable covariance estimation with rank one approximation, robust to heavy-tailed data.
result Proposed estimators are rate-optimal and perform well in simulations and real applications.
We investigate the relationship between the structure of a discrete graphical model and the support of the inverse of a generalized covariance matrix. We show that for certain graph structures, the support of the inverse covariance matrix of indicator variables on the vertices of a graph reflects the conditional indepe…
Proposes CoDEAL for estimating heterogeneous treatment effects in panel data models.
problem Estimating heterogeneous treatment effects in causal panel data models with covariate effects.
method Covariate-Adjusted Deep Causal Learning (CoDEAL) integrating neural networks and autoencoders.
result Establishes theoretical guarantees and demonstrates compelling performance in simulations and real data.
Diagonal transformations preserve independence structures in non-Gaussian distributions.
problem Preserving independence structures in non-Gaussian distributions.
method Diagonal nonlinear transformations of multivariate normal variables.
result Independence structures are preserved in non-Gaussian distributions under diagonal transformations.
We study the problem of recovering the structure underlying large Gaussian graphical models or, more generally, partial correlation graphs. In high-dimensional problems it is often too costly to store the entire sample covariance matrix. We propose a new input model in which one can query single entries of the covarian…
Co-trading networks reveal dynamic market structures and improve covariance estimation.
problem Modeling high-dimensional stock covariances in US equity markets.
method Co-trading-based pairwise similarity measure for constructing dynamic networks, spectral clustering, robust covariance estimator.
result Co-trading networks capture time-evolving stock dependencies and improve portfolio performance.
We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) problem using operator-valued kernels. We show that some of the existing formulations of this problem are special cases of our framework. We then propose a c…
Study high-dimensional covariance matrix estimators for complex portfolios, improving financial metrics.
problem Estimating covariance matrices in high-dimensional portfolios with nested and one-factor structures.
method Combining random matrix theory, free probability, deterministic equivalents, and two-step covariance estimators.
result Two-step estimators improve financial metrics in complex and one-factor covariance models.
A unified framework for Poisson and Jacobi structures from 2-covariant tensors
problem Constructing Poisson and Jacobi structures from non-degenerate 2-covariant tensors
method Deriving a formula for the Schouten-Nijenhuis bracket of the associated bivector field
result Recovering classical brackets associated with symplectic, locally conformally symplectic, cosymplectic, and contact geometries
The paper analyzes how Gaussian kernel parameters affect posterior covariance in Gaussian processes.
problem Understanding the influence of Gaussian kernel parameters on posterior covariance in Gaussian processes.
method Geometric analysis and a posteriori error estimation techniques from adaptive finite element methods.
result The bandwidth parameter and spatial distribution of observations significantly influence posterior covariance and its matrix.
This paper focuses on the estimation of the sample covariance matrix from low-dimensional random projections of data known as compressive measurements. In particular, we present an unbiased estimator to extract the covariance structure from compressive measurements obtained by a general class of random projection matri…
Flexible Cox model for time-dependent covariates with complex sparsity patterns.
problem Lack of flexibility in enforcing specific sparsity patterns in time-dependent Cox models.
method Proposes a flexible framework for variable selection in time-dependent Cox models, accommodating complex selection rules.
result Achieves accurate estimation with low false alarm rates for complex covariate structures.
DRUM transfers cardiac arrest models across registries with missing covariates.
problem Clinical prediction models fail when key training covariates are unavailable at deployment.
method DRUM transfers models to target populations with structurally missing covariates, optimizing worst-case predictive performance over unknown target distributions.
result DRUM yields better-calibrated predictions and improved clinical classification performance across sites.
Scalable GP model handles functional covariates and multitasks.
problem Uncertainty quantification in complex mechanical systems with time-dependent inputs.
method Introduced a fully separable kernel structure for functional covariates and multitask problems, leveraging Kronecker structure for scalability.
result The model significantly improves over single task GPs, requiring fewer samples for accurate predictions.
Holomorphic structures on quantum flag manifolds uniquely defined.
problem Defining unique holomorphic structures on quantum flag manifolds.
method Constructing covariant q-deformed holomorphic structures. result Holomorphic structures are unique for simple relative Hopf modules.
This paper analyzes generalization for linear models with spiked covariance structures.
problem Understanding the generalization performance of linear models with spiked covariance structures.
method Derives the generalization error for two simple models with spiked covariances using random matrix theory.
result The eigenvector and eigenvalue corresponding to the spike significantly influence the generalization error.
Paper explores geometry of covariance matrices using associated bundles.
problem Geometry of fixed-rank covariance matrices.
method Associated bundle approach to Bures--Wasserstein geometry.
result Established a one-to-one correspondence between geodesics.
This paper compares HMC and RNN expressivity using SRT.
problem Comparing expressivity of HMC and RNN models.
method Embed HMC and RNN in a GUM, use SRT to compare structured covariance series.
result Conditions for realizing covariance series by GUM, HMC, or RNN.
Generative models often fail to preserve joint structure despite matching marginals.
problem Generative models fail to capture complex dependencies beyond univariate marginals.
method Introduced D_Sigma(P,Q) = ||Sigma_P - Sigma_Q||_F to measure covariance-level dependence fidelity.
result Covariance-level divergence can lead to structural instability in downstream inference.
We develop a more efficient NGD method for structured parameters.
problem Computational challenges in NGD for structured parameter spaces.
method Local-parameter coordinates to simplify Fisher-matrix computations.
result New structured second-order algorithms and learning methods.
Energy trees handle complex data structures with multiple variable types.
problem Handling intricate data structures with various types of covariates.
method Energy trees, a regression and classification model, use energy statistics to accommodate structured covariates of different types.
result Energy trees maintain statistical foundations, interpretability, and robustness to overfitting.