This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking the prior structure information into account in the estimation procedure is benef…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “structured estimation”
This research tackles uncertainty estimation in autoregressive structured prediction tasks.
problem Ensuring safety and robustness of AI systems through accurate uncertainty estimation.
method Develops a unified probabilistic ensemble-based framework for token-level and sequence-level uncertainty estimation.
result Provides baselines for error and out-of-domain detection on translation and speech recognition datasets.
The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that data is drawn identically from a generating distribution. Introducing sparsity a…
The paper proposes a method to estimate latent structures in multivariate data without assuming their existence.
problem Estimating latent structures in multivariate distributions that are difficult to identify and reflect the data generating mechanism.
method A model-free approach using a multiscale nonparametric maximum likelihood estimator.
result The method captures meaningful discrete structure at different scales and integrates them to yield an interpretable discrete representation.
New method uses adversarial training for structural model estimation.
problem Estimating structural models with high accuracy.
method Adversarial training between generator and discriminator.
result Adversarial estimator achieves parametric efficiency under correct specification.
Fast estimation of Kendall's Tau and conditional Kendall's Tau matrices under structural assumptionsmath.ST
New estimators reduce computation for Kendall's tau and conditional Kendall's tau matrices under structural assumptions.
problem Efficient estimation of Kendall's tau and conditional Kendall's tau matrices for large dimensions.
method Averaging pairwise estimates over blocks or conditional estimates, exploiting structural assumptions.
result Improved estimators with reduced computational cost and similar error level.
We consider the problem of joint estimation of structured inverse covariance matrices. We perform the estimation using groups of measurements with different covariances of the same unknown structure. Assuming the inverse covariances to span a low dimensional linear subspace in the space of symmetric matrices, our aim i…
While considerable advances have been made in estimating high-dimensional structured models from independent data using Lasso-type models, limited progress has been made for settings when the samples are dependent. We consider estimating structured VAR (vector auto-regressive models), where the structure can be capture…
Proposes a neural density estimator that adapts to low-dimensional structures and integrates into generative models.
problem Challenges in implementing neural density estimators and lack of theoretical understanding.
method Structure-agnostic neural density estimator that is easy to implement and provably adaptive.
result Adapts to low-dimensional structures and achieves faster convergence rates.
New method improves causal structure discovery with Prior-Fitted Networks.
problem Errors in likelihood estimation limit proper causal structure discovery.
method Amortized causal discovery with Prior-Fitted Networks.
result Significant gains in structure recovery compared to baselines.
Study clarifies variance of stratification estimators for causal effects.
problem Estimating average causal effects with discrete covariates.
method Combines insights from potential outcomes, causal diagrams, and structural models.
result Derives expressions for the variance of stratification estimators.
We consider learning high-dimensional multi-response linear models with structured parameters. By exploiting the noise correlations among responses, we propose an alternating estimation (AltEst) procedure to estimate the model parameters based on the generalized Dantzig selector. Under suitable sample size and resampli…
New estimators improve sparse semiparametric additive modeling.
problem Sparse semiparametric additive modeling with structured sparsity.
method Combines group subset selection with shrinkage for nonconvex optimization.
result New estimators outperform alternatives in synthetic and real-world data.
Unified framework for structured principal subspace estimation with bounds and rates.
problem Structured principal subspace estimation problems.
method Unified framework, minimax lower and upper bounds, information-geometric complexity.
result Minimax rates of convergence for specific settings, including optimal rates for non-negative PCA/SVD.
Bayesian model averaging improves causal effect estimation by averaging over multiple models.
problem Estimating causal effects under linear Structural Causal Models (SCMs).
method Bayesian model averaging using Gaussian scale mixture distributions for computational efficiency.
result Bayesian model averaging is optimal for causal effect estimation.
Double Machine Learning estimators are asymptotically inadmissible under structure-agnostic models.
problem Minimax estimators may be inadmissible under structure-agnostic models.
method Exhibit second-order (U-statistic) estimators that asymptotically dominate DML estimators.
result Double Machine Learning estimators are asymptotically inadmissible under structure-agnostic models.
Surveying joint Gaussian graphical models to identify shared structures across domains.
problem Estimating shared structures across different data sources.
method Statistical inference of joint Gaussian graphical models.
result Improved estimation power for high-dimensional data.
New method estimates causal structure from sparse data.
problem Inferring causal structure from sparse observational data.
method Log-likelihood of sparsely mixed ICA with penalty terms.
result Proposed method outperforms existing methods.
We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure posterior. The DAG samples can then be used to construct estimators for the posterior …
Estimates CATEs for structured treatments using a new decomposition method.
problem Estimating conditional average treatment effects for complex data types.
method Generalized Robinson decomposition, isolating causal estimand, arbitrary model plugging, quasi-oracle convergence guarantee.
result Demonstrates superior performance in CATE estimation compared to prior work.
GraphITE estimates individual effects of graph-structured treatments.
problem Estimating individual effects of complex treatment structures.
method Graph neural networks and Hilbert-Schmidt Independence Criterion regularization.
result GraphITE outperforms baselines in estimating treatment effects for large numbers of treatments.
Estimates multiple related causal graphs with shared causal order.
problem Discovering multiple related Gaussian DAGs with shared causal order.
method Proposes a -regularized MLE for joint estimation of linear structural equation models.
result Joint estimator achieves better sample complexity and consistency in causal order recovery.
In this paper, we propose an adaptive group lasso procedure to efficiently estimate structural breaks in cointegrating regressions. It is well-known that the group lasso estimator is not simultaneously estimation consistent and model selection consistent in structural break settings. Hence, we use a first step group la…
Estimates manifold dimension using local graph structure.
problem Estimating the intrinsic dimension of manifolds from data.
method Regression on local PCA coordinates, focusing on local graph structure.
result Proposed QE and TLS estimators outperform existing methods.
Paper introduces structured sparsity estimators for Generalized Linear Models.
problem Estimating structured sparsity in GLMs with debiased estimators.
method Extends Stucky and van de Geer's results to GLMs with structured sparsity.
result Proves oracle inequalities for structured sparsity estimators in GLMs.
Study robust mean estimation under coordinate-level corruptions using Hamming distance.
problem Robust mean estimation under realistic coordinate-level corruptions.
method Introduce a novel Hamming distance-based measure and present information-theoretic analysis.
result Data cleaning-inspired approaches can match information theoretic bounds for robust mean estimation.
It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated high-dimensional data with unknown mean and dependence structures. Matrix-variate appr…
StrNN uses neural network structures to learn conditional independencies.
problem Learning conditional independencies in neural networks.
method Designing masks for neural networks based on binary matrix factorization.
result StrNN improves density estimation and causal inference.
Unified framework for gradient estimation in combinatorial spaces.
problem Scaling relaxed gradient estimators to large combinatorial distributions.
method Introducing stochastic softmax tricks within the perturbation model framework.
result Stochastic softmax tricks improve model performance and discover more latent structure.
We study some similarities between almost product Riemannian structures and almost Hermitian structures. Inspired by the similarities, we prove lower eigenvalue estimates for the Dirac operator on compact Riemannian spin manifolds with locally product structures. We also provide some examples (limiting manifolds) for t…
Gaussian graphical models (GGMs) are probabilistic tools of choice for analyzing conditional dependencies between variables in complex systems. Finding changepoints in the structural evolution of a GGM is therefore essential to detecting anomalies in the underlying system modeled by the GGM. In order to detect structur…
We define (higher rank) spinorially twisted spin structures and deduce various curvature identites as well as estimates for the eigenvalues of the corresponding twisted Dirac operators.
New method learns unbiased treatment representations from structured high-dimensional data.
problem Estimating causal effects from high-dimensional, structured treatments.
method Contrastive learning approach to learn unbiased treatment representations.
result The method identifies causal factors and discards non-causal ones, leading to unbiased causal effect estimates.
A new method infers causal gene regulatory networks from parallel CRISPR interventions and transcriptomic data.
problem Learning causal gene regulatory networks from observational data is complicated by lack of identifiability and a combinatorial solution space.
method A continuous optimization framework that leverages observational and interventional data to infer a single causal structure, assuming a linear Structural Equation Model (SEM).
result A provably consistent estimator of the true DAG under mild assumptions.
New method estimates causal effects with multi-valued, time-varying treatments.
problem Estimating causal effects with complex time-varying exposures.
method Combines machine learning and semiparametric efficiency theory.
result Proposes an efficient, asymptotically normal estimator for marginal structural models.
Hallucinations in models are mislinked estimates, not errors.
problem Hallucinations in generative models as failures to link estimates to plausible causes.
method Formalized hallucinations, showed even optimal estimators hallucinate, provided a general lower bound on hallucinate rate, reframed hallucination as structural misalignment, and experimentally supported theory.
result Hallucinations are structural misalignments between loss minimization and human-acceptable outputs, leading to estimation errors.
Debiased Machine Learning of Conditional Average Treatment Effects and Other Causal Functionsstat.ME
This paper provides estimation and inference methods for the best linear predictor (approximation) of a structural function, such as conditional average structural and treatment effects, and structural derivatives, based on modern machine learning (ML) tools. We represent this structural function as a conditional expec…
We address structured covariance estimation in elliptical distributions by assuming that the covariance is a priori known to belong to a given convex set, e.g., the set of Toeplitz or banded matrices. We consider the General Method of Moments (GMM) optimization applied to robust Tyler's scatter M-estimator subject to t…
Proposes Exogenous Matching for efficient counterfactual estimation.
problem Efficient estimation of counterfactual expressions in general settings.
method Transforms variance minimization into conditional distribution learning.
result Outperforms other importance sampling methods in counterfactual estimation.
Method estimates group structure in panel data using variance information.
problem Estimating group structure in panel data with unknown groups.
method Proposes a method to estimate unobserved groupings for panel data models using variance information.
result Superior performance compared to existing methods in simulations and empirical applications.
Post-estimation smoothing improves prediction accuracy with structural indices.
problem Using natural structural indices in machine learning without losing robustness.
method A post-estimation smoothing operator that separates from the original predictor.
result Post-estimation smoothing improves accuracy over original predictors under simple conditions.
Improved likelihood estimation for singular distributions using deep models.
problem Estimating singular distributions using deep generative models.
method Data perturbation to avoid singularity issues in likelihood estimation.
result Consistent estimation of target distribution with desirable rates.
Biclustering structures in data matrices were first formalized in a seminal paper by John Hartigan (1972) where one seeks to cluster cases and variables simultaneously. Such structures are also prevalent in block modeling of networks. In this paper, we develop a unified theory for the estimation and completion of matri…
New method for estimating and testing impulse responses in high-dimensional VAR systems.
problem Statistical inference for impulse responses in sparse, high-dimensional vector autoregressions.
method Local projection equations and de-sparsified estimators combined with a non-regularized contemporaneous impact matrix.
result Valid inference procedures for structural impulse responses in high-dimensional systems.
New metrics improve uncertainty estimation on graph data.
problem Current GNNs focus only on nodewise scores, limiting uncertainty estimation.
method Proposed edgewise metrics for uncertainty estimation on graphs.
result GNN models with structured prediction perform better in uncertainty estimation.
A method combines deep learning and G-estimation for causal mediation analysis.
problem Estimating structural mediation parameters under unmeasured confounding.
method UNIT method using TARNet for representation learning and G-estimation.
result Improved precision of structural parameter estimator through better representation learning.
Paper tackles matrix estimation under arbitrary noise, achieving minimax optimality.
problem Noisy low-rank-plus-sparse matrix recovery under arbitrary dependence.
method Incoherent-constrained least-square estimator, novel energy spreading result.
result Achieves minimax optimality in estimating structured Markov transition kernels.
It is important to learn various types of classifiers given training data with noisy labels. Noisy labels, in the most popular noise model hitherto, are corrupted from ground-truth labels by an unknown noise transition matrix. Thus, by estimating this matrix, classifiers can escape from overfitting those noisy labels. …