Simplified tutorial on doubly robust learning for causal inference.
problem Challenges in applying doubly robust methods due to complexity and software barriers.
method Combines propensity score and outcome modeling for robust causal inference.
result Makes doubly robust learning accessible through simplified methodology and practical examples.
Proposes a neural network method to combine nonprobability and probability survey samples.
problem Combining nonprobability and probability survey samples for accurate population mean estimation.
method Uses a deep neural network to estimate sampling scores from nonprobability samples and combines them with probability sample information.
result Proposed estimators improve robustness to parametric propensity-score misspecification, especially for nonlinear selection mechanisms.
This paper investigates robust and efficient DR/RDR estimators for WATEs.
problem Lack of systematic investigation into robustness and efficiency conditions for WATE estimation.
method Proposes three RDR estimators using semiparametric efficient influence function and double/debiased machine learning.
result Demonstrates the practical relevance of the methods in medical and social sciences.
Optimally estimates a functional using nuisance function tuning and sample splitting.
problem Estimating optimal rates for a doubly robust functional.
method Combines nuisance function tuning and sample splitting strategies.
result Shows optimal rates of convergence for various estimators.
Proposes a robust estimator for high-dimensional data with heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects with many more regressors than observations.
method Doubly robust two-stage semiparametric difference-in-difference estimator using machine learning for propensity score estimation.
result Valid inference for heterogeneous treatment effects with bias correction procedures.
Natural experiment dataset reveals inconsistent treatment effect estimators.
problem Inconsistent results from over 20 estimators on a new dataset.
method Created a benchmark to evaluate estimator accuracy, derived variance formula, introduced new estimator.
result Doubly robust estimators outperform others by orders of magnitude.
Proposes a method to stabilize treatment effect estimation with unbalanced data.
problem Unbalanced treatment assignment leading to unstable propensity score estimations.
method Undersamples data for propensity score modeling and calibrates scores to match original distribution.
result The estimator retains asymptotic properties of the DML estimator and improves finite sample performance.
Develops a method for causal inference with noisy confounders.
problem Noisy measurements of confounders in treatment effects models.
method Local principal subspace approximation combining K-nearest neighbors matching and PCA.
result Estimators of treatment effects and counterfactual distributions are constructed.
Proposes MDR estimator for unbiased OPE with large action spaces.
problem Severe bias and variance tradeoffs in OPE with large action spaces.
method Marginalized Doubly Robust (MDR) estimator, reducing variance and bias.
result MDR estimator is unbiased under weaker assumptions than MIPS.
Proposes new method for calibrating treatment effect predictors.
problem Calibrating predictors of heterogeneous treatment effects.
method Causal isotonic calibration and cross-calibration.
result Achieves fast calibration rates under weak conditions.
Q-Learner estimates ratio-based treatment effects without imposing parametric structures.
problem Estimating treatment effects as ratios in non-linear settings.
method Decomposes ratio-CATE into two classification tasks, using doubly robust augmentations.
result Q-Learner outperforms other methods in low-conversion and observational data settings.
Corrects mismatch in consistency of nuisance estimators for doubly robust methods.
problem Mismatch in consistency of nuisance estimators in doubly robust methods.
method Calibrated debiased machine learning (calibrated DML) with isotonic regression adjustment.
result Calibrated DML yields doubly robust asymptotic normality with slower convergence of nuisance estimators.
Proposes stabilized weights for causal inference using isotonic calibration.
problem Stability and bias issues in inverse propensity weighting.
method Post-hoc isotonic calibration of inverse propensity weights.
result Improves performance of doubly robust estimators of average treatment effect.
Large-scale labeled dataset is the indispensable fuel that ignites the AI revolution as we see today. Most such datasets are constructed using crowdsourcing services such as Amazon Mechanical Turk which provides noisy labels from non-experts at a fair price. The sheer size of such datasets mandates that it is only feas…
When training a machine learning model with observational data, it is often encountered that some values are systemically missing. Learning from the incomplete data in which the missingness depends on some covariates may lead to biased estimation of parameters and even harm the fairness of decision outcome. This paper …
New estimator improves ATT estimation efficiency with external controls.
problem Reduced efficiency when incorporating external controls into ATT estimation.
method Proposes a novel doubly robust estimator for ATT that maintains higher efficiency than standard approaches.
result Demonstrates improved efficiency of the new estimator compared to standard approaches, even under model misspecification.
Gradient boosting estimates Riesz representer for causal inference.
problem Estimating causal quantities using traditional methods is challenging and prone to variance issues.
method Gradient boosting algorithm to directly estimate Riesz representer.
result Gradient boosting performs similarly or better than traditional methods in estimating causal quantities.
We study the problem of off-policy critic evaluation in several variants of value-based off-policy actor-critic algorithms. Off-policy actor-critic algorithms require an off-policy critic evaluation step, to estimate the value of the new policy after every policy gradient update. Despite enormous success of off-policy …
Semiparametric method removes bias in functional bilevel gradient estimation.
problem First-order bias in plug-in hypergradient when lower-level problem is nonparametric.
method Semiparametric debiasing theory based on efficient influence function leads to cross-fitted orthogonal hypergradient estimator.
result Asymptotic normality and uniform control over outer parameter established for the estimator.
New method combines strengths of two PCL approaches without density ratio estimation.
problem Estimating causal functions in Proxy Causal Learning with unobserved confounders and proxies.
method Kernel-based doubly robust estimators combining treatment and outcome bridges, density ratio-free.
result Outperforms existing methods on PCL benchmarks, including a prior doubly robust method.
Extends robust methods for causal inference, improving estimator performance.
problem Estimating causal effects in the presence of latent confounders.
method Minimax kernel machine learning for doubly robust functionals.
result Proposed method leads to robust and high-performance estimators.
Paper tackles causal inference with partially labeled data, introducing robust methods.
problem Challenges in causal inference due to partially labeled datasets and potential bias.
method Decaying missing-at-random framework and BRSS estimator for doubly robust causal inference.
result Established asymptotic normality of BRSS estimator under decaying labeling propensity scores.
A new estimator for evaluating policies in unknown environments.
problem Evaluating policies when both logging policy and value function are unknown.
method Doubly-Robust (DR) off-policy evaluation (OPE) estimator, DRUnknown, that estimates both the logging policy and value function.
result DRUnknown achieves the smallest asymptotic variance and is optimal when both models are correctly specified.
Proposes DR-ACI for causal effect intervals with temporal dependence.
problem Causal effect intervals under temporal dependence.
method Doubly robust adaptive conformal inference (DR-ACI).
result Constructs prediction intervals for causal effects.
Unified causal inference framework using distribution adaptation.
problem Estimating Average Treatment Effects (ATE) under uncertainty in propensity scores.
method Reframed as domain adaptation problem, using machine learning techniques.
result Joint Robust Estimator (JRE) achieves up to 15% reduction in MSE.
New estimators improve causal inference in machine learning studies.
problem Improving causal inference in machine learning models.
method Doubly-robust cross-fit estimators for average causal effect.
result Doubly-robust cross-fit estimators outperform other methods in simulations.
A new method estimates treatment effects without strong assumptions.
problem Treatment effect estimation with strong model assumptions.
method Distribution learning-based weighting method.
result Our method outperforms existing methods in estimating ATT.
New DR-IC estimator reduces bias and variance in OPE.
problem Estimating value of a target policy using logged data from a different policy.
method DR-IC estimator that combines parametric reward model and context-based switching rule.
result DR-IC estimator outperforms state-of-the-art OPE algorithms.
Improves robustness of propensity score estimators in challenging settings.
problem Limited overlap, small sample sizes, or unbalanced data.
method Extends calibration techniques for propensity score models, focusing on sample-splitting schemes.
result Calibration reduces variance and bias in inverse probability weighting and double/debiased machine learning frameworks.
The paper proposes an estimator to make inference of heterogeneous treatment effects sorted by impact groups (GATES) for non-randomised experiments. The groups can be understood as a broader aggregation of the conditional average treatment effect (CATE) where the number of groups is set in advance. In economics, this a…
New methods estimate policy value and gradients for deterministic policies from off-policy data.
problem Estimating policy value and gradients for deterministic policies from off-policy data.
method Proposed new doubly robust estimators based on kernelization approaches.
result Demonstrated a rate independent of horizon length for policy value and gradient estimation.
This paper unifies two types of statistical methods for estimating treatment effects.
problem Isolating online A/B-tests and off-policy evaluation.
method Establishes formal equivalence between online Difference-in-Means and off-policy Inverse Propensity Scoring methods.
result Standard online methods are mathematically equivalent to off-policy methods with optimal control variates.
New methods combine machine learning with doubly robust estimators for better treatment effect estimation.
problem Estimating average treatment effects from observational data.
method Doubly robust methods using machine learning techniques.
result Machine learning improves the performance of doubly robust estimators.
Improved estimators for causal inference using cross-fitting and undersmoothing.
problem Estimating expected conditional covariance in causal inference.
method Double cross-fit doubly robust (DCDR) estimators with undersmoothing for non-smooth nuisance functions.
result DCDR estimators achieve n \sqrt{n} n -consistency and asymptotic normality under minimal conditions. Proposes a robust algorithm for aligning large language models with human preferences.
problem Misspecification in preference models, reference policies, and reward functions.
method Doubly robust preference optimization algorithm.
result Superior and more robust performance compared to state-of-the-art algorithms.
Contextual multi-armed bandit algorithms are widely used in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health. Most of the existing algorithms have regret proportional to a polynomial function of the context dimension, d d d . In many applications ho…
Paper proves optimality of doubly robust estimators for treatment effects.
problem Estimating treatment effects in causal inference.
method Structure-agnostic framework of statistical lower bounds, using non-parametric regression and classification oracles.
result Doubly robust estimators are statistically optimal for ATE and ATT.
New method estimates causal effects in complex spaces using topological structures.
problem Challenges in estimating causal effects in non-Euclidean spaces.
method Developed a topological causal inference framework using power-weighted silhouette functions of persistence diagrams.
result Successfully quantifies topological treatment effects across various complex outcomes.
FOCaL meta-learner estimates functional treatment effects robustly.
problem Estimating heterogeneous treatment effects from functional outcomes.
method Doubly robust meta-learner FOCaL integrating functional regression.
result Direct and robust estimation of F-CATE.
A new method for analyzing adaptive experiments using kernel treatment effects.
problem Efficiently analyzing adaptive experiments that adjust treatment assignments based on outcomes.
method Kernel Treatment Effects (KTE) framework combining RKHS scores and witness functions.
result Effective for both mean shifts and higher-moment differences, outperforming adaptive baselines.
Framework combines HMM and MTGCN for spatiotemporal causal inference in clinical data.
problem Challenges in observing direct treatment effects in clinical domains.
method Integrates Hidden Markov Model and Multi Task and Multi Graph Convolutional Network for spatiotemporal data.
result Advances predictive causal inference by structurally adapting to spatiotemporal complexities.
We study decision making in environments where the reward is only partially observed, but can be modeled as a function of an action and an observed context. This setting, known as contextual bandits, encompasses a wide variety of applications including health-care policy and Internet advertising. A central task is eval…
CASP selects reliable policies for two-stage recommender systems by considering both value and support.
problem The selection of a generator in two-stage recommender systems affects both the policy value and the data support used to estimate it.
method CASP combines doubly robust value estimation with a support-burden penalty.
result CASP selects lower-burden policies when estimated value and support credibility are in tension.
Doubly robust self-training improves semi-supervised learning by balancing labeled and pseudo-labeled data.
problem Improving semi-supervised learning performance with limited labeled data.
method Introduces doubly robust self-training, a method that combines labeled and pseudo-labeled data to balance between labeled-only and pseudo-labeled-only training.
result Demonstrates superior performance of doubly robust self-training on ImageNet and nuScenes datasets.
Novel characterization of augmented balancing weights combining outcome and weighting models.
problem Improving estimation accuracy in machine learning models with balancing weights.
method Characterization of augmented balancing weights as linear models, extending to ridge and lasso regression.
result Equivalence and closed-form expressions for specific model choices, providing insights into performance.
Paper develops methods to estimate derivative of dose-response curve for continuous treatments.
problem Estimating the derivative of the dose-response curve for continuous treatments.
method Doubly robust (DR) inference method using kernel smoothing, bias-corrected IPW and DR estimators.
result Proposes novel bias-corrected IPW and DR estimators for continuous treatments.
The consistency of doubly robust estimators relies on consistent estimation of at least one of two nuisance regression parameters. In moderate to large dimensions, the use of flexible data-adaptive regression estimators may aid in achieving this consistency. However, n 1 / 2 n^{1/2} n 1/2 -consistency of doubly robust estimators is…
New algorithm reduces bias in off-policy reinforcement learning.
problem Challenges in designing off-policy reinforcement learning algorithms.
method Doubly robust off-policy actor-critic (DR-Off-PAC) with a single timescale structure.
result Establishes the first overall sample complexity analysis for a single time-scale off-policy AC algorithm.