Partial covariance factorizes in path diagrams, simplifying analysis.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Method estimates sparse inverse covariance and partial correlation matrices efficiently.
Unified method for inference on partially identified causal effects using covariates.
We study the problem of recovering the structure underlying large Gaussian graphical models or, more generally, partial correlation graphs. In high-dimensional problems it is often too costly to store the entire sample covariance matrix. We propose a new input model in which one can query single entries of the covarian…
Estimates covariance matrices for matrix-variate data via core covariance geometry.
CONCERT improves transfer learning by borrowing partial information from auxiliary datasets.
New method for causal inference with observed covariates improves learning rates.
Develops a regression model for partially observed dynamic tensor data.
Classifies scalar second-order PDEs with low-dimensional symmetry groups.
In this paper, we investigate community detection in networks in the presence of node covariates. In many instances, covariates and networks individually only give a partial view of the cluster structure. One needs to jointly infer the full cluster structure by considering both. In statistics, an emerging body of work …
Model improves covariance estimation from shared and distinct datasets.
In the study of conformal geometry, the method of elliptic partial differential equations is playing an increasingly significant role. Since the solution of the Yamabe problem, a family of conformally covariant operators (for definition, see section 2) generalizing the conformal Laplacian, and their associated conforma…
CovRegRF estimates covariance matrix from covariates using random forests.
We study covariance matrix estimation for the case of partially observed random vectors, where different samples contain different subsets of vector coordinates. Each observation is the product of the variable of interest with a Bernoulli random variable. We analyze an unbiased covariance estimator under this mod…
The covariance structure of multivariate functional data can be highly complex, especially if the multivariate dimension is large, making extensions of statistical methods for standard multivariate data to the functional data setting challenging. For example, Gaussian graphical models have recently been extended to the…
The paper explores how multiway data from PDEs can be accurately tracked using EnKF with specific covariance and precision estimators.
Diagonal transformations preserve independence structures in non-Gaussian distributions.
We conduct a study of the aliased spectral densities of Matérn covariance functions on a regular grid of points, providing clarity on the properties of a popular approximation based on stochastic partial differential equations; while others have shown that it can approximate the covariance function well, we find that i…
Inference for normal and Monte Carlo distributions using minimum relative entropy.
In this work, we propose a new Gaussian process regression (GPR) method: physics information aided Kriging (PhIK). In the standard data-driven Kriging, the unknown function of interest is usually treated as a Gaussian process with assumed stationary covariance with hyperparameters estimated from data. In PhIK, we compu…
The paper shows objective derivatives are covariant derivatives on Riemannian metrics.
Flexible DNN for survival data, avoiding proportional hazards assumption.
Study reveals limits of PLS in multi-modal learning with correlated signals.
Geodesic sprays on Finsler manifolds studied with covariant coefficients.
Proposes a partially linear structure to capture nonlinear relationships in mixture of experts models.
Building on the Utiyama principle we formulate an approach to Lagrangian field theory in which exterior covariant differentials of vector-valued forms replace partial derivatives, in the sense that they take up the role played by the latter in the usual jet bundle formulation. Actually a natural Lagrangian can be writt…
This paper provides estimation and inference methods for an identified set's boundary (i.e., support function) where the selection among a very large number of covariates is based on modern regularized tools. I characterize the boundary using a semiparametric moment equation. Combining Neyman-orthogonality and sample s…
New insights into how high-dimensional models handle covariate shifts.
Method tackles missing covariates in large-scale datasets.
The value of an asset in a financial market is given in terms of another asset known as numeraire. The dynamics of the value is non-stationary and hence, to quantify the relationships between different assets, one requires convenient measures such as the means and covariances of the respective log returns. Here, we dev…
Bayesian approach learns linear networks from high-dimensional data.
Paper proposes a method to classify EEG signals with missing data.
The exact meaning of the noise spectrum of eigenvalues of the covariance matrix is discussed. In order to better understand the possible phenomena behind the observed noise, the spectrum of eigenvalues of the covariance matrix is studied under a model where most of the true eigenvalues are zero and the parameters are n…
This study examines the relationship between PLS and OLS regression using eigenvalue distributions.
We introduce a new test for detection of power-law cross-correlations among a pair of time series - the rescaled covariance test. The test is based on a power-law divergence of the covariance of the partial sums of the long-range cross-correlated processes. Utilizing a heteroskedasticity and auto-correlation robust est…
We derive an efficient method to perform clustering of nodes in Gaussian graphical models directly from sample data. Nodes are clustered based on the similarity of their network neighborhoods, with edge weights defined by partial correlations. In the limited-data scenario, where the covariance matrix would be rank-defi…
This is the first of two papers where we address and partially confirm a conjecture of Deser and Schwimmer, originally postulated in high energy physics. The objects of study are scalar Riemannian quantities constructed out of the curvature and its covariant derivatives, whose integrals over compact manifolds are invar…
Much recent work has concerned sparse approximations to speed up the Gaussian process regression from the unfavorable O(n3) scaling in computational time to O(nm2). Thus far, work has concentrated on models with one covariance function. However, in many practical situations additive models with multiple covariance func…
High-dimensional time series data exist in numerous areas such as finance, genomics, healthcare, and neuroscience. An unavoidable aspect of all such datasets is missing data, and dealing with this issue has been an important focus in statistics, control, and machine learning. In this work, we consider a high-dimensiona…
Study variance-optimal hedging of forward curve derivatives under stochastic volatility.
New findings on optimization landscape of Toeplitz covariance estimation.
Proposes a method to learn conditional VAEs from datasets with missing covariates.
Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an eigenvalue problem on the sample covariance matrix. In this paper we consider the situa…
Missing data is an important challenge when dealing with high dimensional data arranged in the form of an array. In this paper, we propose methods for estimation of the parameters of array variate normal probability model from partially observed multiway data. The methods developed here are useful for missing data impu…
While sparse inverse covariance matrices are very popular for modeling network connectivity, the value of the dense solution is often overlooked. In fact the L2-regularized solution has deep connections to a number of important applications to spectral graph theory, dimensionality reduction, and uncertainty quantificat…
In this paper, we introduce a new machine learning (ML) model for nonlinear regression called the Boosted Smooth Transition Regression Trees (BooST), which is a combination of boosting algorithms with smooth transition regression trees. The main advantage of the BooST model is the estimation of the derivatives (partial…
Active-set algorithm improves Cox regression for shape-restricted covariates.
We develop the notion of renormalized energy in CR geometry, for maps from a strictly pseudoconvex pseudohermitian manifold to a Riemannian manifold. This energy is a CR invariant functional, whose critical points, which we call CR-harmonic maps, satisfy a CR covariant subelliptic partial differential equation. The cor…