Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

118237355473 · Jun 202019922001200920172026
48 results for nuisance estimation

New method for inference on strongly identified functionals even when nuisance functions are weakly identified.

problem Inference on continuous linear functionals of weakly identified nuisance functions defined by conditional moment restrictions.
method Proposes penalized minimax estimators for both the primary and debiasing nuisance functions, which can converge to fixed limits regardless of nuisance identifiability.
result Proves the asymptotic normality of a debiased estimator for the functional of interest, leading to asymptotically valid confidence intervals.

New method improves robustness of double robust estimators under complete misspecification.

problem Improper performance of double robust estimators when all nuisance functions are misspecified.
method DR+ACC, an adaptive correction clipping method.
result DR+ACC ensures bounded error and maintains semiparametric efficiency.

Optimal tuning for estimating ECC in proportional asymptotics.

problem Estimating Expected Conditional Covariance (ECC) under proportional asymptotics.
method Debiased ridge regression estimators for nuisance functions, sample splitting strategies, and asymptotic variance analysis.
result Prediction-optimal tuning parameters may not minimize asymptotic variance of ECC estimator.

We provide non-asymptotic excess risk guarantees for statistical learning in a setting where the population risk with respect to which we evaluate the target parameter depends on an unknown nuisance parameter that must be estimated from data. We analyze a two-stage sample splitting meta-algorithm that takes as input ar…

2019-01-25abs ↗pdf ↗

Bayesian active learning tackles nuisance parameters, leading to bias and dilemmas.

problem Bayesian active learning with nuisance parameters leads to bias and dilemmas.
method Characterizes and mitigates negative interference by accurately estimating nuisance parameters.
result The extent of negative interference can be extremely large, and accurate estimation of nuisance parameters is critical.

Bayesian method corrects bias in treatment effect estimation.

problem Estimating treatment effects from observational data with high-dimensional nuisance parameters.
method Bayesian debiasing, targeted modeling, sample splitting.
result Marginal posterior for ATE satisfies Bernstein-von Mises theorem under correct nuisance model specification.

Optimal first-order methods are shown to be fundamental limits in functional estimation.

problem Optimal functional estimation under weak conditions.
method Formalization of functional estimation with black-box nuisance function estimates and derivation of minimax lower bounds.
result First-order methods are optimal under weak conditions, but higher-order methods can outperform them when nuisance function structure is known.

New estimator optimizes black-box model errors in semiparametric estimation.

problem How nuisance estimation errors affect low-dimensional target parameters in semiparametric models.
method Proposed a new estimator achieving a sharper rate of convergence.
result The first-order stochastic error of nuisance estimation can be eliminated.

Corrects mismatch in consistency of nuisance estimators for doubly robust methods.

problem Mismatch in consistency of nuisance estimators in doubly robust methods.
method Calibrated debiased machine learning (calibrated DML) with isotonic regression adjustment.
result Calibrated DML yields doubly robust asymptotic normality with slower convergence of nuisance estimators.

Framework for multi-task learning with semiparametric models and nuisance parameters.

problem Improving parameter estimation from diverse, heterogeneous datasets.
method Late fusion multi-task learning framework with two-step process: individual task learning followed by adaptive aggregation.
result The method achieves faster convergence rates compared to individual task learning when tasks share similar parametric components.

A new framework evaluates HTE estimators using relative error.

problem Lack of robust evaluation methods for HTE estimators.
method Proposes a relative error-based evaluation framework and neural network architecture to estimate nuisance parameters and robustly compare HTE estimators.
result Demonstrates reliable comparisons and improved HTE estimation through the proposed framework and learning algorithm.

We propose the orthogonal random forest, an algorithm that combines Neyman-orthogonality to reduce sensitivity with respect to estimation error of nuisance parameters with generalized random forests (Athey et al., 2017)--a flexible non-parametric method for statistical estimation of conditional moment models using rand…

2018-06-09abs ↗pdf ↗

Extends robust methods for causal inference, improving estimator performance.

problem Estimating causal effects in the presence of latent confounders.
method Minimax kernel machine learning for doubly robust functionals.
result Proposed method leads to robust and high-performance estimators.

Proposes efficient estimators for weighted cumulative treatment effects in observational studies.

problem Inconsistent and inefficient estimators due to model misspecification and lack of overlap.
method Double/debiased machine learning for weighted cumulative causal effects.
result Proposed estimators are consistent, asymptotically linear, and reach semiparametric efficiency bounds.

New method corrects biased predictions and uncertainty estimates in classification with nuisance parameters.

problem Tackles biased predictions and invalid uncertainty estimates in classification with nuisance parameters.
method Proposes a method that estimates ROC across the entire nuisance parameter space to devise invariant cutoffs.
result Demonstrates effective domain adaptation and valid prediction sets with high power.

AutoBayes automates Bayesian graph exploration for robust machine learning.

problem Learning representations invariant to nuisance variations in machine learning.
method Automated Bayesian inference framework exploring different graphical models.
result Significant performance improvement with nuisance-invariant machine learning pipelines.

Double machine learning provides n\sqrt{n}-consistent estimates of parameters of interest even when high-dimensional or nonparametric nuisance parameters are estimated at an n1/4n^{-1/4} rate. The key is to employ Neyman-orthogonal moment equations which are first-order insensitive to perturbations in the nuisance param…

2017-11-01abs ↗pdf ↗

Optimal CATE estimation with structured contrast functions using KRR.

problem Estimating CATEs with complex response functions in RKHS.
method Unified two-stage kernel ridge regression method for structured contrast functions.
result Minimax rates governed by contrast function complexity, enabling adaptation.

A new method debiases multiple target parameters without IFs.

problem Debiasing multiple target parameters in nonparametric models.
method Kernel Debiased Plug-in Estimation (KDPE) using TMLE and reproducing kernel Hilbert spaces.
result KDPE simultaneously debiases all pathwise differentiable target parameters.

Method estimates heterogeneous causal effects on networks using orthogonal learning.

problem Challenges in estimating causal effects on networks due to treatment effects on both treated and neighbors, and network homophily.
method Two-stage orthogonal learning framework: first stage uses graph neural networks for nuisance components, second stage residualizes and interpretable attention-based model for causal effects.
result Improves heterogeneous effect estimation and supports interpretable analyses.

The paper uses neural networks to estimate treatment effects even with many confounders.

problem Estimating treatment effects with a growing number of confounders.
method General optimization framework using neural networks to approximate nuisance functions.
result Neural networks can handle a diverging number of confounders and alleviate the curse of dimensionality.

New methods improve estimation accuracy in noisy settings.

problem Estimating treatment effects in the presence of treatment noise.
method Developed new structure-agnostic cumulant estimators and practical procedures for higher-order robustness.
result Demonstrated that existing DML estimator is suboptimal for non-Gaussian treatment noise and introduced ACE procedures for improved accuracy.

Sharp bounds on ATE with unmeasured confounders, valid even when misspecified.

problem Bounding average treatment effects with unmeasured confounders.
method Distributionally robust optimization, double sharpness, double validity.
result Proposes estimators with robustness properties for valid bounds.

NURD improves model performance by distilling representations independent of nuisance variables.

problem Models trained under spurious correlations may fail on data with different nuisance-label relationships.
method Developed Nuisance-Randomized Distillation (NURD) to find representations independent of nuisance variables.
result NURD finds representations that perform better regardless of nuisance-label relationships.

The paper discusses selecting predictive models for causal inference, highlighting the challenges and proposing a solution.

problem Selecting the best predictive models for causal inference from a variety of machine learning models.
method The paper proposes using RextriskR ext{-risk}, flexible estimators, and splitting data to compute risks for model selection.
result The proposed method controls both outcome errors for treated and non-treated individuals, addressing the issue of model selection for causal inference.

This guide simplifies high-probability regret bounds in empirical risk minimization.

problem High-probability regret bounds in empirical risk minimization.
method Modular presentation, three-step recipe, localized Rademacher complexity, local maximal inequalities, metric-entropy integrals.
result Recover familiar rates for various function classes and derive regret bounds for nuisance components.

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we propose a selective machine learning framework for making inferences about a fini…

2019-11-05abs ↗pdf ↗

New method for clustering tasks with heterogeneous data.

problem Clustered multitask learning with semiparametric and heterogeneous nuisances.
method Adaptive fused orthogonal estimator with Neyman-orthogonal losses and data-driven fusion penalties.
result Achieves exact clustering recovery and pooled parametric convergence rates.

Improved estimators for causal inference using cross-fitting and undersmoothing.

problem Estimating expected conditional covariance in causal inference.
method Double cross-fit doubly robust (DCDR) estimators with undersmoothing for non-smooth nuisance functions.
result DCDR estimators achieve n\sqrt{n}-consistency and asymptotic normality under minimal conditions.

Paper estimates noise covariance in correlated multi-task linear models.

problem Estimating noise covariance in multi-task high-dimensional linear models with correlated noise.
method Uses multi-task elastic-net and lasso estimators to estimate noise covariance, correcting bias in squared residual matrix.
result Develops a novel estimator of noise covariance that converges at rate n1/2n^{-1/2}, matching oracle estimator under suitable conditions.

Theory establishes optimal rates for estimating linear functionals without structural assumptions.

problem Estimating linear functionals of unknown nuisance components without structural assumptions.
method Structure-agnostic framework, doubly robust estimators, first-order debiasing.
result Characterization of minimax optimal rates and regimes for double robustness.

Paper proposes a new DR estimator for adaptive experiments with improved performance.

problem Improving policy evaluation in adaptive experiments with dependent samples.
method Adaptive-fitting variant of sample-splitting for non-Donsker nuisance estimators.
result Proposed DR estimator shows better performance than other estimators with dependent samples.

Study uses deep neural networks for inference in partially linear models with dependent data.

problem Inference in partially linear models with dependent data.
method First stage deep neural network (DNN) estimation followed by n\sqrt{n}-consistent and asymptotically normal estimator.
result The DNN-estimated finite dimensional parameter achieves n\sqrt{n}-consistency and asymptotic normality.

We address challenges in estimating parameters from adaptively collected data.

problem Estimating parameters from data collected adaptively leads to non-normal asymptotic distributions.
method We develop semi-parametric estimators that account for adaptivity in data collection.
result Our estimators are asymptotically normal under certain conditions.

The joint PLDA model, is a generalization of PLDA where the nuisance variable is no longer considered independent across samples, but potentially shared (tied) across samples that correspond to the same nuisance condition. The original work considered a single nuisance condition, deriving the EM and scoring formulas fo…

2018-03-09abs ↗pdf ↗

ICA accurately estimates treatment effects even with confounders.

problem Estimating treatment effects in the presence of confounding variables.
method Uses Independent Component Analysis (ICA) to identify latent sources and estimate mixing coefficients.
result Linear ICA can consistently estimate multiple treatment effects, even with Gaussian confounders, and is more sample-efficient than Orthogonal Machine Learning (OML).

CNN improves causal inference by controlling time-structured covariates.

problem Estimating the effect of early retirement on health outcomes while controlling for time-structured covariates.
method Used CNN to fit nuisance models explaining treatment and outcome, combining them into an augmented inverse probability weighting estimator.
result Uniformly valid inference achieved through CNN, providing rates of convergence and uniformly valid inference guarantees.