Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

128256383511 · Jun 202019922001200920172026
48 results for covariance estimation

Paper proposes a new covariance estimator ensuring positive semi-definite matrices.

problem Estimating spot covariance matrices while maintaining positive semi-definiteness.
method Modification of the Fourier covariance estimator with a symmetric positive semi-definite constraint.
result The estimator is consistent and produces accurate positive semi-definite matrices.

Method estimates sparse inverse covariance and partial correlation matrices efficiently.

problem Sparse high-dimensional inverse covariance and partial correlation matrix estimation.
method Two-stage estimation method using partial regression with positive semi-definiteness.
result Efficient estimation of inverse covariance and partial correlation matrices with derived non-asymptotic rates.

New methods estimate covariance for matrix data without assuming fixed size or specific distributions.

problem Estimating covariance for high-dimensional matrix data without distributional assumptions.
method Unified framework for bandable covariance estimation with rank one approximation, robust to heavy-tailed data.
result Proposed estimators are rate-optimal and perform well in simulations and real applications.

Extends covariance estimation with multiple targets for better performance.

problem Improving covariance estimation for multiple targets.
method Combines multiple constant matrices with sample covariance matrix, derives estimators and proves convergence.
result The multi-target linear shrinkage estimator outperforms other estimators in various situations.

New method improves covariance estimation for weighted samples.

problem Improving covariance estimation for weighted sample data.
method Asymptotic non-linear shrinkage formulas for covariance and precision matrix estimators of weighted sample covariances.
result Asymptotic non-linear shrinkage formulas for covariance and precision matrix estimators of weighted sample covariances.

Paper presents a new framework for covariance matrix estimation with geometric insights.

problem Challenges in covariance matrix estimation, especially in finding suitable models and efficient estimation methods.
method General framework for linear restrictions on different transformations of the covariance matrix, including matrix logarithm and its inverse.
result Yields an MM-estimator with MM-estimation allowing for straightforward asymptotic and finite sample analysis.

Proposes a robust method for predicting missing outcomes in covariate shift adaptation.

problem Predicting missing outcomes in test data with covariate shift.
method Doubly robust estimator for covariate shift adaptation via importance weighting, incorporating an additional estimator for the regression function.
result Shows robustness against density-ratio estimation errors, maintaining consistency if either estimator is consistent.

Study nonparametric covariance function estimation for noisy data.

problem Estimating covariance function from discrete noisy data in high dimensions.
method Adaptive learning-based estimators, including deep learning.
result Established oracle inequality and convergence rates for deep learning estimators.

Paper develops an online covariance estimator for nonsmooth stochastic approximation problems.

problem Estimating covariance in nonsmooth, potentially non-monotone settings.
method Online batch-means covariance matrix estimator.
result Estimator achieves convergence rate of O(dn1/8+ε)O(\sqrt{d}n^{-1/8+\varepsilon}).

The graphical lasso (glasso) is a widely-used fast algorithm for estimating sparse inverse covariance matrices. The glasso solves an L1 penalized maximum likelihood problem and is available as an R library on CRAN. The output from the glasso, a regularized covariance matrix estimate a sparse inverse covariance matrix e…

2011-11-11abs ↗pdf ↗

New estimator handles covariate shift with closed-form solution and super-efficiency.

problem Handling covariate shift in missing data and causal inference problems.
method Minimum Wasserstein distance estimation framework.
result Closed-form expression and super-efficiency relative to semiparametric efficient estimator.

New covariance estimator for financial portfolios.

problem Estimating large financial covariances in non-stationary environments.
method Exponentially weighted averages and cross-validation for nonlinearly shrinking sample eigenvalues.
result Our estimator performs well in large dimensions compared to existing estimators.

New method improves online covariance estimation for SGD.

problem Improving online covariance estimation for SGD.
method Proposes a de-biased covariance estimator that eliminates second-order derivatives.
result Achieves a convergence rate of n(α1)/2lognn^{(α-1)/2} \sqrt{\log n}, outperforming existing methods.

PACE-GGM uses Gaussian mechanism for private covariance estimation.

problem Private estimation of covariance matrices in high dimensions.
method Data-adaptive selection of entries, Gaussian mechanism, maximum-entropy reconstruction.
result Consistent improvements in estimation error compared to Gaussian mechanism and baselines.

Study on estimating distances between covariance operators and Gaussian processes.

problem Estimating distances between covariance operators and Gaussian processes.
method Riemannian distances, concentration results for Hilbert space-valued random variables, RKHS covariance and cross-covariance operators.
result Both distances converge in the Hilbert-Schmidt norm and can be consistently and efficiently estimated.

New method estimates covariance matrices without restrictive assumptions.

problem Estimating high-dimensional covariance matrices under restrictive assumptions.
method Distributionally robust covariance estimation problems with mild conditions.
result Robust estimators are efficient, consistent, and perform well.

SCOPE estimator improves covariance and precision matrix estimation.

problem Estimating covariance and precision matrices accurately.
method Distributionally robust optimization with convex spectral divergence.
result SCOPE estimator reduces spectral bias and improves condition number.

We consider the problem of joint estimation of structured inverse covariance matrices. We perform the estimation using groups of measurements with different covariances of the same unknown structure. Assuming the inverse covariances to span a low dimensional linear subspace in the space of symmetric matrices, our aim i…

2015-11-20abs ↗pdf ↗

New methods improve portfolio risk minimization by estimating covariance matrix more accurately.

problem Uncertainty in estimating covariance matrix leads to unreliable hedge trades.
method Proposes two new estimators of the inverse covariance matrix using l2 and l1 norms.
result Portfolio formed using proposed estimators achieves substantial risk reduction and improved returns.

Paper optimizes private PCA for covariance estimation in statistics.

problem Private estimation of covariance matrices and principal components.
method Developed differentially private estimators for spiked covariance model.
result Established minimax rates of convergence for principal components and covariance matrix estimation.

Improved 2-bit covariance estimator with reduced operator norm error and no tuning needed.

problem Improving 2-bit covariance estimation with reduced operator norm error and no tuning needed.
method Proposed a new 2-bit covariance matrix estimator using triangular dithering scales.
result Improved operator norm error rate that depends on effective rank of covariance matrix, closing theoretical gap.

Robustly estimates linear regression coefficients with adversarial and noisy data.

problem Estimating robust linear regression coefficients with adversarial and noisy data.
method Adversarial robust weighted Huber regression with polynomial computational complexity.
result Derives an estimation error bound that depends on the stable rank and condition number of the covariance matrix.

New method balances covariates for stable causal survival effect estimation.

problem Estimating causal survival effects in data with conditionally-independent censoring.
method Covariate-balancing approach to empirically stable and asymptotically efficient estimation.
result Validated theoretical results in synthetic and semi-synthetic data.

Lower bounds on private estimation of Gaussian covariance matrices.

problem Private estimation of Gaussian covariance matrices under various parameter regimes.
method Stein-Haff identity and fingerprinting lemma extensions.
result Lower bounds match existing upper bounds in the widest known parameters.

Paper tackles unbounded density ratio estimation for covariate shift adaptation.

problem Understudied challenge in statistical learning: unbounded density ratios.
method Three-step estimation method: relative density ratio, truncation, and transformation.
result Established rigorous convergence guarantees for density ratio and regression estimators.

This paper introduces a new data-driven methodology for estimating sparse covariance matrices of the random coefficients in logit mixture models. Researchers typically specify covariance matrices in logit mixture models under one of two extreme assumptions: either an unrestricted full covariance matrix (allowing correl…

2020-01-14abs ↗pdf ↗

Linear and Quadratic Discriminant analysis (LDA/QDA) are common tools for classification problems. For these methods we assume observations are normally distributed within group. We estimate a mean and covariance matrix for each group and classify using Bayes theorem. With LDA, we estimate a single, pooled covariance m…

2011-11-07abs ↗pdf ↗

Neural networks speed up covariance estimation in spatial Gaussian processes.

problem Efficiently estimating covariance parameters in spatial Gaussian processes.
method Training neural networks to approximate maximum likelihood estimates.
result Neural network estimates are as accurate as ML methods but much faster.

The paper proposes a method to estimate treatment effects using CAR designs with additional covariates.

problem Estimating distributional treatment effects in CAR designs with additional covariates.
method Flexible distribution regression framework that incorporates additional covariates using machine learning methods.
result The proposed estimator attains the semiparametric efficiency bound for distributional treatment effects under CAR.

Novel approach for SEM in small samples with p>np>n.

problem Small sample size and p>np>n issues in factor-based SEM.
method Reformulates covariance structure into self-covariance and cross-covariance, defines a feasible set with relative error constraint.
result Improved stability and directional information in small-sample settings.

Paper develops efficient mechanisms for estimating variance and covariance under differential privacy in the add-remove model.

problem Estimating variance and covariance under differential privacy in the add-remove model.
method Developed mechanisms based on the Bézier mechanism, a novel moment-release framework.
result Proved minimax optimality of the Bézier-based estimator in the high-privacy regime and demonstrated its better utility in instance-wise analysis.