Bayesian nonparametric machine learning improves instrumental variable inference.
problem Estimating causal effects with nonlinear relationships.
method Bayesian Additive Regression Trees (BART) for estimating functions and Dirichlet Process mixtures for error terms.
result Dramatic improvements in inference with nonlinear data, no manual tuning required.
Method constructs nonparametric prediction intervals with finite-sample guarantees.
problem Nonparametric instrumental variable regression with finite-sample coverage.
method Conformal inference framework applied to NPIV, combining with various estimators.
result Distribution-free, finite-sample coverage over chosen IV shifts.
Kernel method improves instrumental variable regression rates.
problem Nonparametric instrumental variable regression with weak instruments.
method Kernel-based two-stage least-squares method, strong L 2 L_2 L 2 convergence analysis. result Minimax optimal rates for instrumental regression under standard assumptions.
New method for causal inference with observed covariates improves learning rates.
problem Causal inference with observed covariates in nonparametric instrumental variable regression.
method Introduces novel Fourier measure for partial smoothing and adapts kernel lengthscales for anisotropic smoothness.
result Upper and lower learning rates for KIV-O show interpolation between NPIV and NPR rates.
Instrumental variable (IV) regression is a strategy for learning causal relationships in observational data. If measurements of input X and output Y are confounded, the causal relationship can nonetheless be identified if an instrumental variable Z is available that influences X directly, but is conditionally independe…
DFIV uses deep features for IV regression, achieving optimal rates.
problem Optimal IV regression with deep features for complex target functions.
method Two-stage approach: deep feature learning followed by IV regression.
result DFIV achieves minimax optimal learning rate under certain conditions.
New methods for estimating complex causal effects in econometrics.
problem Estimating causal parameters in short panel data models using nested nonparametric instrumental variable regression.
method Introducing techniques to limit ill-posedness in nested NPIV, providing explicit mean square rates and efficient inference.
result Explicit mean square rates for nested NPIV and efficient inference for causal parameters.
Unified analysis of neural networks in NPIV using 2SLS and MFLD.
problem Global convergence of neural networks in NPIV.
method Lifted perspective through MFLD, penalty gradient approach for bilevel optimization.
result First global convergence result of neural networks for 2SLS in NPIV.
Perturbation theory improves nonparametric instrumental variable estimation accuracy.
problem Improving nonparametric instrumental variable estimation accuracy in high-dimensional settings.
method Perturbative approach based on physics perturbation theory, extending kernel ridge methods with higher-order corrections.
result First-order perturbative corrections reduce prediction error by up to 99% in high-dimensional ill-defined cases.
New algorithm for nonparametric IV regression using stochastic gradients.
problem Identifying causal effects in the presence of unobservable confounders.
method Functional stochastic gradient descent for NPIV regression.
result Superior stability and competitive performance compared to existing methods.
Estimates long-term effects using past experiments as instruments with many weak instruments.
problem Estimating long-term causal effects with limited short-term outcomes and many weak instruments.
method Nonparametric instrumental variable inference with many weak instruments, using past experiments as instruments.
result Automatic debiased machine learning estimators for linear functionals of the structural function and its minimum-norm projection are efficient in the many-weak-instruments regime.
New method avoids IV limitations for flexible estimation.
problem Nonparametric estimation of IV regressions with multiple solutions.
method Minimax penalized estimator avoiding identification and closedness conditions.
result Strong L 2 L_2 L 2 convergence rate without closedness condition. A new method learns outcome-aware spectral features for causal effect estimation.
problem Estimation of causal effects in the presence of hidden confounders.
method Augmented Spectral Feature Learning framework that minimizes a contrastive loss derived from an augmented operator incorporating outcome information.
result Our method remains effective even under spectral misalignment.
This paper establishes that so-called instrumental variables enable the identification and the estimation of a fully nonparametric regression model with Berkson-type measurement error in the regressors. An estimator is proposed and proven to be consistent. Its practical performance and feasibility are investigated via …
Spectral feature learning improves IV regression for causal effect estimation.
problem Estimating causal effects in the presence of hidden confounders.
method Two-stage least squares estimator based on spectral features.
result Performance of the method depends on strong spectral alignment and slow eigenvalue decay.
DFIV uses deep neural nets to learn nonlinear features in IV regression.
problem Learning causal relationships from observational data with nonlinear interactions.
method DFIV trains deep neural nets to define nonlinear features on instruments and treatments, alternating training to compose stages 1 and 2.
result DFIV outperforms state-of-the-art methods on IV benchmarks and off-policy policy evaluation.
Paper develops PGMM framework for debiased inference on nonparametric IV estimators.
problem Automatic debiased inference on nonparametric IV functionals.
method Penalized GMM (PGMM) framework for functionals of IV estimators.
result PGMM-based debiased estimator performs well, achieving near-nominal coverage.
New algorithms for IV regression with streaming data, avoiding matrix inversions.
problem Instrumental variable regression with streaming data.
method Viewing IV regression as a stochastic optimization problem, developing algorithms that avoid matrix inversions and mini-batches.
result Rates of convergence of order O ( log T / T ) \mathcal{O}(\log T/T) O ( log T / T ) and O ( 1 / T 1 − ι ) \mathcal{O}(1/T^{1-ι}) O ( 1/ T 1 − ι ) for linear models. New method for debiased inference without assuming exact solutions in inverse problems.
problem Dealing with inverse problems where exact solutions may not exist.
method Nonparametric instrumental variable analysis without structural equations.
result Valid inference on functionals of inverse problems without assuming exact solutions.
Study on Q Q Q -function estimation for continuous state-action MDPs, deriving rates and conditions.
problem Estimating Q Q Q -function in off-policy evaluation for continuous state-action Markov decision processes. method Reformulated as nonparametric instrumental variables (NPIV) problem, derived minimax lower bounds, proposed sieve two-stage least squares estimator.
result First minimax lower bounds for Q Q Q -function and its derivatives in sup-norm and L 2 L^2 L 2 -norm, same as classical nonparametric regression. Develops methods to identify and estimate causal effects with instrumental variables.
problem Causal inference with confounded treatment assignment and unobserved variables.
method General nonparametric causal framework, debiased machine learning, semiparametric theory.
result Consistent and asymptotically normal estimators for average treatment effect.
Kernel methods identify treatment effects with unobserved confounding using negative controls.
problem Learning causal relationships with unmeasured confounding.
method Kernel ridge regression algorithms for nonparametric treatment effects.
result Uniform consistency and finite sample rates of convergence proved.
Simplifies IV regression for high-dimensional instruments.
problem Nonlinear instrumental variable regression with high-dimensional instruments.
method Combines kernelized IV methods with an adaptive regression algorithm.
result Faster convergence and adaptability to feature dimensionality.
We present a novel algorithm for non-linear instrumental variable (IV) regression, DualIV, which simplifies traditional two-stage methods via a dual formulation. Inspired by problems in stochastic programming, we show that two-stage procedures for non-linear IV regression can be reformulated as a convex-concave saddle-…
New algorithm protects privacy in IVaR regression while maintaining accuracy.
problem Privacy leakage in classical IVaR methods.
method Noisy two-stage gradient descent with differential privacy guarantees.
result Achieves statistical efficiency and privacy in IVaR regression.
A new boosting method corrects endogeneity bias in instrumental variable regression.
problem Endogeneity bias in instrumental variable regression.
method Causal Gradient Boosting (boostIV) that builds on gradient boosting algorithm.
result boostIV is consistent and performs well in finite samples compared to other methods.
DML-IV improves IV regression for learning decision policies by reducing bias.
problem Spurious correlations in offline datasets caused by hidden confounders.
method Double/debiased machine learning (DML) framework to reduce bias in two-stage IV regression.
result DML-IV outperforms state-of-the-art methods and learns high-performing policies.
Estimates linear model from noisy covariates and instruments using spectral regularization.
problem Estimating a linear model from many noisy covariates and instruments.
method Two-stage least squares with spectral regularization of canonical correlations.
result Upper and lower bounds on estimation error, proving optimality of the method with noisy data.
Modern data analysis depends increasingly on estimating models via flexible high-dimensional or nonparametric machine learning methods, where the identification of structural parameters is often challenging and untestable. In linear settings, this identification hinges on the completeness condition, which requires the …
Improved IV estimates by weighting on compliance reduces noise in treatment effect estimation.
problem Noisy IV estimates in settings with non-random treatment receipt.
method Weighting observations by estimated compliance, leveraging machine learning for compliance estimation.
result Compliance weighting reduces IV variance, improving precision of treatment effect estimates.
Proposes RDIV for IV estimation avoiding limitations of existing methods.
problem Nonparametric estimation of IV regressions with practical limitations.
method Tikhonov-regularized DeepIV regression with model selection.
result Matches state-of-the-art convergence rate and provides rigorous guarantees.
New methods for estimating and inferring nonparametric structural functions and elasticities.
problem Estimating and inferring nonparametric structural functions and their derivatives.
method Data-driven sieve dimension choice and uniform confidence bands construction.
result Optimal estimation and inference procedures with minimax rates of convergence.
Proposes a method to estimate causal effects of continuous treatments using instrumental variables.
problem Estimating causal effects of continuous treatments in the presence of unmeasured confounders.
method Introduces a novel framework using instrumental variables and a uniform regular weighting function to identify and estimate average dose-response functions.
result Establishes the asymptotic properties of the proposed methods for estimating average dose-response functions.
AI uses language models to find instrumental variables quickly.
problem Finding valid instrumental variables is a challenging and heuristic process.
method Uses large language models to search for new instrumental variables through narratives and counterfactual reasoning.
result Demonstrates the effectiveness of multi-step and role-playing prompting strategies for LLMs.
Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric non-linear regression models and better interpretability and scalability than the non-…
Paper optimizes estimation of quadratic functionals in nonparametric IV models.
problem Optimal estimation of a nonlinear functional in ill-posed inverse regression.
method Adaptive, minimax estimation using leave-one-out, sieve NPIV estimator with data-driven sieve dimension selection.
result Adaptive estimator achieves minimax optimal rate in various ill-posed cases.
PAN+SR tackles scalable symbolic regression for large p p p datasets.
problem Symbolic regression struggles with large number of input variables and measurement error.
method Combines ab initio nonparametric variable selection with SR to pre-screen and reduce search complexity.
result PAN+SR consistently enhances 19 SR methods' performance on challenging datasets.
New adaptive test for NPIV models controls size and has superior power.
problem Testing inequality and equality restrictions in nonparametric IV models.
method Adaptive hypothesis test based on modified leave-one-out sample quadratic distance.
result Adaptive test attains the adaptive minimax rate of testing in L 2 L^{2} L 2 . Novel quasi-Bayesian method for IV regression using machine learning models.
problem Uncertainty quantification in IV regression with machine learning models.
method Quasi-Bayesian procedure based on kernelized IV models and dual formulation.
result Established minimax optimal contraction rates and scalable inference algorithm.
The paper uses graph learning to detect valid instruments in high-dimensional data for house pricing.
problem Endogeneity bias and invalid instrument validation in high-dimensional data.
method Merge variable selection algorithms and probabilistic graphs to estimate house prices and causal structure.
result Efficient data-driven instrument selection and invalid instrument purge in high-dimensional data.
Proposes a robust IV estimator using optimal transport for corrupted or adversarial data.
problem Lack of robustness in traditional IV estimators for corrupted or adversarial data.
method Integrates data-derivative information through optimal transport to address geometric aspects of data.
result Improves robustness against data corruption and adversarial attacks.
New method for inference on strongly identified functionals even when nuisance functions are weakly identified.
problem Inference on continuous linear functionals of weakly identified nuisance functions defined by conditional moment restrictions.
method Proposes penalized minimax estimators for both the primary and debiasing nuisance functions, which can converge to fixed limits regardless of nuisance identifiability.
result Proves the asymptotic normality of a debiased estimator for the functional of interest, leading to asymptotically valid confidence intervals.
Paper introduces EnCounteR for estimating causal effects using encouragement data.
problem Challenges in estimating causal effects due to incomplete randomization and limited encouragement data.
method Introduces a generalized IV estimator, EnCounteR, leveraging both observational and encouragement data.
result Demonstrates superior performance of EnCounteR over existing methods.
Transformers can handle endogeneity in linear regression using IV methods.
problem Endogeneity in in-context linear regression models.
method Transformer architecture with gradient-based bi-level optimization and in-context pretraining.
result Transformers provide more robust predictions and estimates than 2SLS in endogenous scenarios.
The paper shows how sketching data can simplify regression inference even when errors are heteroskedastic.
problem Performing robust inference with heteroskedastic errors using sketched data.
method Using random projections to sketch data, the paper shows that sketched estimates behave as if errors are homoskedastic.
result Estimation by random sampling does not have the same property, and sketched estimates are asymptotically normal with homoskedastic variance.
New algorithm learns optimal policies in strategic MDPs with private types.
problem Optimal policy learning in strategic MDPs with private types and information asymmetry.
method PLAN algorithm using instrumental variable regression and pessimism principle.
result PLAN achieves near-optimal policy with 1 / K 1 / \sqrt{K} 1/ K optimality. BGM-IV uses AI to estimate causal effects in complex data.
problem Estimating causal effects in high-dimensional, nonlinear settings with endogeneity.
method Structured latent generative modeling for posterior inference in a causally structured latent space.
result BGM-IV outperforms existing methods in high-dimensional covariate regimes.
Develops methods for causal inference in compositional data using instrumental variables.
problem Interpreting summary statistics like diversity indices as causal effects in compositional data.
method Statistical data transformations and regression techniques tailored for compositional data.
result Advantages and limitations of the proposed methods demonstrated on synthetic and real microbiome data.