Paper combines machine learning and model averaging for robust parameter estimation.
problem Estimating structural parameters with partially unknown functional forms.
method Pairing double/debiased machine learning with stacking for model averaging.
result DDML with stacking is more robust to unknown functional forms than single learners.
A new algorithm speeds up multi-agent reinforcement learning.
problem Complex interactions between agents in multi-agent reinforcement learning.
method Double averaging scheme for decentralized convex-concave saddle-point problems.
result The algorithm converges to the optimal solution at a global geometric rate.
Paper introduces new estimator for continuous treatment effects.
problem Estimating the average dose-response function of continuous treatments.
method Utilizes ADML and DML tools, with a novel debiasing method.
result Proves asymptotic normality and shows good performance in simulations.
The paper investigates how calibrating propensity scores improves DML estimates of average treatment effects.
problem Improving the accuracy of DML estimates in finite samples.
method Propensity score calibration within the Double/debiased machine learning framework.
result Calibrating propensity scores reduces the root mean squared error of DML estimates of average treatment effects in finite samples.
Researchers develop a method to measure treatment effects in settings with shared states.
problem Measuring treatment effects in settings with shared states like prices, recommendations, or social signals.
method Double machine learning (DML) theorem with conditions for efficient inference under shared-state interference.
result Efficient estimation of average direct effect (ADE) and global average treatment effect (GATE) in various models.
Extends double linear policy with time-varying weights and proves robust positive expectation.
problem Ensuring robustness in policy optimization with time-varying parameters.
method Employed a novel elementary symmetric polynomials characterization approach to prove robust positive expectation (RPE). Derived explicit expressions for expected cumulative gain-loss and variance.
result Proved the robust positive expectation property holds for the extended double linear policy.
High-dimensional models can outperform simpler ones in causal inference.
problem Estimating average treatment effects with many covariates.
method High-dimensional linear regression and synthetic control with many control units.
result Adding more control units can improve imputation performance even when pre-treatment fit is perfect.
Unified theory explains and mitigates double descent in data reconstruction.
problem Understanding and mitigating double descent in reduced order modeling.
method Data-Noise Averaging theory, sufficient criteria, detailed risk curve prediction, regularization mechanisms.
result Detailed risk curves predicted at reduced computational cost, instability traced to individual sensors.
Proposes AAA for efficient association estimation with confounders.
problem Summarizing log odds ratio as a function of confounders.
method Develops efficient DML estimators for AAA.
result Demonstrates practicality and effectiveness of AAA estimators.
New method improves regression estimates, reducing bias.
problem Omitted variable bias in high-dimensional linear regression.
method Post-Double-Autometrics, an alternative to Post-Double-Lasso.
result Post-Double-Autometrics outperforms Post-Double-Lasso.
Chernozhukov, Chetverikov, Demirer, Duflo, Hansen, and Newey (2016) provide a generic double/de-biased machine learning (DML) approach for obtaining valid inferential statements about focal parameters, using Neyman-orthogonal scores and cross-fitting, in settings where nuisance parameters are estimated using a new gene…
Double Q-learning has the same mean-squared error as Q-learning under certain conditions.
problem Comparing the mean-squared error of Double Q-learning and Q-learning.
method Theoretical analysis based on Lyapunov equations for both tabular and linear function approximation settings.
result The asymptotic mean-squared error of Double Q-learning is exactly equal to that of Q-learning under specific conditions.
Bayesian method for estimating ATE with robustness to model misspecification.
problem Estimating average treatment effects under unconfoundedness.
method Double robust Bayesian inference using adjusted prior and posterior distributions.
result Bayesian credible sets form asymptotically exact confidence intervals.
The paper analyzes the effectiveness of principal component regression with varying numbers of features.
problem The study examines the performance of principal component regression with different numbers of selected features.
method The analysis considers the least squares linear regression over uncorrelated Gaussian features selected in decreasing variance order. It also analyzes the prediction error in the average-case setting as the number of features and samples grow.
result The prediction error shows a 'double descent' shape as the number of features increases, and conditions are established for achieving minimum risk in the interpolating regime.
The paper extends Hodge-de Rham and Lichnérowicz Laplacians to double forms and proves vanishing theorems.
problem Extending Laplacians to double forms and proving vanishing theorems.
method Introduced a new product on double forms to establish index-free formulas for curvature terms in Weitzenböck formulas for Δ Δ Δ , Δ ~ \widetildeΔ Δ , and Δ L Δ_L Δ L . Proved vanishing theorems for Δ Δ Δ and Δ L Δ_L Δ L on symmetric double forms. result Vanishing theorems for the Hodge-de Rham Laplacian and Δ L Δ_L Δ L on symmetric double forms. New methods combine machine learning with doubly robust estimators for better treatment effect estimation.
problem Estimating average treatment effects from observational data.
method Doubly robust methods using machine learning techniques.
result Machine learning improves the performance of doubly robust estimators.
We develop methods to approximate derivatives for causal inference problems using data.
problem Estimating causal effects from data when distributions are not known.
method Constructive algorithm approximating Gateaux derivatives via finite differencing.
result Derives conditions for finite-difference approximations to preserve statistical benefits.
New target-based TD learning algorithms improve deep Q-learning convergence.
problem Improving convergence of deep Q-learning algorithms.
method Introducing averaging TD, double TD, and periodic TD algorithms.
result Established asymptotic convergence analyses for averaging TD and double TD, and finite sample analysis for periodic TD.
FIDDLE uses deep learning to estimate ATE from complex data.
problem Estimating ATE from high-dimensional, correlated covariates with sparse nonlinear effects.
method Factor-augmented deep learning for propensity and outcome models.
result FIDDLE consistently estimates ATE under model misspecification and is semiparametrically efficient.
The paper analyzes MACD using operator theory.
problem Understanding the mathematical foundation of MACD.
method Developed a functional-analytic framework interpreting MACD as a phase-corrected, smoothed derivative operator.
result MACD is structurally equivalent to a band-pass filter and can be expressed as a finite difference of delayed and doubly averaged signals.
Paper proposes ADC framework to reduce ViT SL training communication overhead.
problem Reducing communication overhead in ViT SL training.
method Two parallel compression strategies: class-agnostic merging and token discarding.
result Significantly reduces communication overhead without sacrificing accuracy.
Efficient method for pricing Bermudan moving average options using GPR-GHQ.
problem High-dimensional pricing of Bermudan moving average options in energy markets.
method Gaussian Process Regression and Gauss-Hermite quadrature.
result GPR-GHQ method efficiently handles long windows and high dimensionality.
GOE statistics emerge from surface moduli space averages.
problem Understanding spectral statistics on hyperbolic surfaces.
method Defined a smooth linear statistic, averaged over moduli space, and analyzed variance.
result GOE statistics are recovered in the large genus and high energy limits.
Study shows minimizing the norm of the ERM solution stabilizes kernel ridge-less regression.
problem Stability of kernel ridge-less regression.
method Minimizing the norm of the ERM solution to minimize CV stability.
result Interpolating solution with minimum norm minimizes CV stability.
Proposes efficient estimators for weighted cumulative treatment effects in observational studies.
problem Inconsistent and inefficient estimators due to model misspecification and lack of overlap.
method Double/debiased machine learning for weighted cumulative causal effects.
result Proposed estimators are consistent, asymptotically linear, and reach semiparametric efficiency bounds.
Paper offers anytime-valid inference for causal parameters using DML.
problem Classic DML is only valid asymptotically for a fixed sample size.
method Time-uniform DML results for anytime-valid inference.
result Valid inference at any arbitrary stopping time.
New rule reduces exploration regret to logarithmic, improving bad episode handling.
problem Improving exploration regret in average reward MDPs.
method Replacing Doubling Trick with Vanishing Multiplicative rule in EVI-based algorithms.
result Regret is logarithmic under the new rule, significantly better than linear.
Proposes RCL method to improve ATE estimation from observational data.
problem Error-compounding issue and extreme estimates in DML estimators.
method Robust Causal Learning (RCL) method to offset DML deficiencies.
result RCL estimators are more stable and perform better than DML estimators.
A semiparametric test evaluates instrument validity and complier characteristics.
problem Evaluating the validity of instruments and complier characteristics.
method Semiparametric test, doubly robust moment, machine learning update.
result Validates instrument validity and complier characteristics.
New algorithm for solving minimax problems over distributions converges to Nash equilibrium.
problem Solving minimax problems over probability distributions.
method Symmetric Mean-field Langevin Dynamics (MFL-AG and MFL-ABR) with weighted averaging and best response dynamics.
result Converges to mixed Nash equilibrium with average-iterate and last-iterate convergence.
New algorithm reduces reinforcement learning regret to sqrt(T) without strong dynamics assumptions.
problem Infinite-horizon average-reward reinforcement learning with linear MDPs.
method Approximate by discounted-reward MDPs and apply optimistic value iteration.
result Achieves O(sqrt(T)) regret with polynomial complexity.
Co-DQL improves traffic signal control using multi-agent reinforcement learning.
problem Optimizing signal timing for large-scale traffic control.
method Cooperative double Q-learning (Co-DQL) with mean field approximation and reward allocation.
result Co-DQL reduces average waiting time for vehicles in the road system.
Direct learning framework for integrating multi-source causal data.
problem Conditional average treatment effects inference from heterogeneous data.
method Direct learning framework, double robustness, causal information-aware weighting function.
result Effective causal data fusion in both homogeneous and heterogeneous scenarios.
We present an experimental and simulated model of a multi-agent stock market driven by a double auction order matching mechanism. Studying the effect of cumulative information on the performance of traders, we find a non monotonic relationship of net returns of traders as a function of information levels, both in the e…
This paper investigates robust and efficient DR/RDR estimators for WATEs.
problem Lack of systematic investigation into robustness and efficiency conditions for WATE estimation.
method Proposes three RDR estimators using semiparametric efficient influence function and double/debiased machine learning.
result Demonstrates the practical relevance of the methods in medical and social sciences.
Statistical mechanics reveals phase transitions in ε \varepsilon ε -SVR error.
problem Understanding task precision in neural representations with variability.
method Statistical mechanics applied to ε \varepsilon ε -SVR. result Double-descent phenomenon in generalization error due to ε \varepsilon ε . Bayesian method estimates QTEs from observational data.
problem Estimating nuanced characteristics of counterfactual distributions.
method Bayesian semiparametric conditional distribution regression model with double balancing score.
result Proposed method provides more accurate QTE estimates than other methods.
SHIFT improves robustness in estimating dose-response functions with heavy-tailed contamination.
problem Outliers bias estimates of average dose-response functions in heavy-tailed data.
method SHIFT combines cross-fit nuisance orthogonalization, Welsch-loss, and defensive OLS refit.
result SHIFT reduces RMSE from 1.03 to 0.33 on localized contamination test.
Post-hoc transforms can reverse model performance trends, especially in noisy settings.
problem Post-hoc transforms can reverse model performance trends, especially in noisy settings.
method Empirical study and analysis of post-hoc transforms like temperature scaling, ensembling, and SWA.
result Post-hoc reversal can prevent double descent and mitigate mismatches between test loss and test error.
Proposes a method to estimate causal effects of continuous treatments using instrumental variables.
problem Estimating causal effects of continuous treatments in the presence of unmeasured confounders.
method Introduces a novel framework using instrumental variables and a uniform regular weighting function to identify and estimate average dose-response functions.
result Establishes the asymptotic properties of the proposed methods for estimating average dose-response functions.
Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, avera…
Deep networks generalize well even when they fit training data perfectly, thanks to overparametrization.
problem Understanding generalization in overparametrized deep networks.
method Random features regression, asymptotic analysis, ensemble averaging.
result Bias remains constant beyond the interpolation threshold, while variance components decay with overparametrization.
Estimates causal effects from a single time-series without further assumptions.
problem Estimating causal effects from a single time-series without additional assumptions.
method Proposes a general class of averages of conditional causal parameters, estimated using a targeted maximum likelihood estimator (TMLE).
result Asymptotic consistency and normality of the TMLE for estimating causal parameters.
Paper estimates non-causal graphical models using covariance extension and transportation distance.
problem Estimating non-causal graphical models with smoothing relations.
method Proposes a covariance extension problem and uses transportation distance to minimize error with white noise.
result Solution is a double-sided autoregressive non-causal graphical model.
Multi-label classification is a type of supervised learning where an instance may belong to multiple labels simultaneously. Predicting each label independently has been criticized for not exploiting any correlation between labels. In this paper we propose a novel approach, Nearest Labelset using Double Distances (NLDD)…
Proposes a scalable method for counterfactual prediction using machine learning.
problem De-bias causal estimators with high-dimensional data in observational studies.
method Uses entropy balancing to learn weights minimizing Jensen-Shannon divergence, leading to robust counterfactual predictions.
result Consistent causal estimation if either propensity score or outcome model is correctly specified.
New estimator improves ATT estimation efficiency with external controls.
problem Reduced efficiency when incorporating external controls into ATT estimation.
method Proposes a novel doubly robust estimator for ATT that maintains higher efficiency than standard approaches.
result Demonstrates improved efficiency of the new estimator compared to standard approaches, even under model misspecification.
We provide adaptive inference methods, based on ℓ 1 \ell_1 ℓ 1 regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular f…