Proof of a simpler orthogonal double machine learning method.
problem Consistency and asymptotic normality of machine learning estimates.
method Alternative proof for Z-estimator in simpler setting.
result Orthogonal moments and consistency imply asymptotic normality.
DoubleML implements machine learning for causal inference in R.
problem Estimating causal effects in regression models with high-dimensional data.
method Double machine learning framework with Neyman orthogonality and sample splitting.
result Valid inference on causal parameters using machine learning methods.
New method improves efficiency analysis with big data.
problem Challenges in detecting inefficiency with big data.
method Post Double LASSO method using Neyman orthogonal moment conditions.
result Improved estimation of efficiency and inefficiency.
New method estimates treatment effects using machine learning.
problem Estimating treatment effects from observational data.
method Double/de-biased machine learning with Neyman-orthogonal scores and cross-fitting.
result Valid inferential statements about treatment effects.
The paper uses double machine learning to estimate dynamic treatment effects robustly.
problem Estimating causal effects of dynamic treatments with time-varying covariates.
method Double machine learning with Neyman-orthogonal score functions for robustness.
result Asymptotic normality and n \sqrt{n} n -consistency of the estimators under specific conditions. Improves machine learning consistency with orthogonal moment equations.
problem Improving consistency of machine learning estimates with complex nuisance parameters.
method Employing Neyman-orthogonal moment equations to improve consistency from n − 1 / 4 n^{-1/4} n − 1/4 to n − 1 / ( 2 k + 2 ) n^{-1/(2k+2)} n − 1/ ( 2 k + 2 ) . result Second-order orthogonality can improve consistency to n − 1 / ( 2 k + 2 ) n^{-1/(2k+2)} n − 1/ ( 2 k + 2 ) . New convergence guarantees for learning with unknown nuisance parameters.
problem Learning problems with unknown nuisance parameters.
method Stochastic gradient optimization with Neyman orthogonality and approximately orthogonalized updates.
result Stochastic gradient algorithms can converge under conditions of nuisance parameters.
Improves statistical learning bounds with self-concordant losses.
problem Statistical prediction with nuisance components.
method Orthogonal statistical learning with self-concordant loss.
result Non-asymptotic bounds on excess risk improved by a dimension factor.
Improves treatment effect estimates using coordinated deep learning.
problem Estimating treatment effects from observational data with high-dimensional covariates.
method Uses double machine learning with a coordinated deep learning algorithm to reduce bias.
result Demonstrates improved empirical performance through numerical experiments.
The paper develops methods to estimate treatment effects in sample selection models.
problem Evaluation of treatments when outcomes are only observed for a subpopulation due to sample selection or attrition.
method Combines selection-on-observables and instrumental variable assumptions with double machine learning for treatment evaluation.
result Proposed estimators are asymptotically normal and root-n consistent.
Double descent observed in tree-based models for genomic prediction.
problem Understanding the generalization behavior of tree-based models in machine learning.
method Systematic variation of model complexity in a genomic prediction task using whole-genome sequencing data.
result Double descent emerges only when complexity is scaled jointly across learner capacity and ensemble size.
New method for estimating global and local parameters using regularized Riesz representers.
problem Estimating global and local parameters in complex models robustly.
method Adaptive inference methods based on ℓ1 regularization, including Riesz representer as a nuisance parameter.
result Non-asymptotic and asymptotic uniform validity for honest confidence bands.
A method for interpreting SVMs using polynomial kernels, revealing model complexity.
problem Interpreting SVMs built with truncated orthogonal polynomial kernels.
method Orthogonal Representation Contribution Analysis (ORCA) with normalized Orthogonal Kernel Contribution (OKC) indices.
result The method reveals structural aspects of model complexity not captured by predictive accuracy.
A new DML method for continuous treatments uncovers causal mediation effects.
problem Estimating causal mediation effects with continuous treatments.
method Double machine learning (DML) algorithm using kernel-based doubly robust moment function.
result Asymptotic normality with nonparametric convergence rate for estimating mediated response curve.
Paper introduces GDR-learners for estimating potential outcomes from observational data.
problem Lack of theoretical property of general Neyman-orthogonality in deep generative models.
method Develops flexible GDR-learners based on various deep generative models.
result GDR-learners possess quasi-oracle efficiency and rate double robustness, asymptotically optimal.
New method offsets DML's error-compounding issue and provides more stable causal parameter estimates.
problem Estimating ATE from observational data with robustness and stability.
method Robust Causal Learning (RCL) method to offset DML's deficiencies.
result RCL estimators are more stable and perform better than DML and traditional estimators.
Serverless cloud computing speeds up double machine learning model estimation.
problem Efficiently estimating double machine learning models with minimal cloud resource management.
method Serverless computing with AWS Lambda for repeated cross-fitting.
result Demonstrates significant reduction in estimation times and costs.
Automatic debiasing for causal and policy effects using Neural Nets and Random Forests.
problem Estimating causal and policy effects from high-dimensional or non-parametric regression functions.
method Automatic learning of Riesz representation using Neural Nets and Random Forests.
result Automatic debiasing method performs well compared to state-of-the-art algorithms.
Method estimates dynamic treatment effects using machine learning and g-estimation.
problem Estimating treatment effects over time with multiple treatments and potential future outcomes.
method Double/debiased machine learning framework for dynamic treatment effects, extending Neyman orthogonal cross-fitted g g g -estimation. result Provides finite sample guarantees and allows for non-linear effect heterogeneity and high-dimensional parameterizations.
Synthetic construction of Hopf fibration in 4D space.
problem Visualizing 4D objects in 3D space.
method Double orthogonal projection method to visualize 4D space.
result Direct synthetic construction of 3-sphere fibers from 2-sphere points.
New algorithms reduce orthogonality constraint enforcement time in machine learning.
problem Efficiently solving orthogonality constraints in machine learning.
method Extending the landing algorithm to Stiefel manifold, incorporating stochastic and variance reduction techniques.
result All proposed methods achieve the same convergence rate as Riemannian counterparts enforcing constraints.
Proposes nAIPW for robust ATE estimation using neural networks.
problem Estimation of ATE with potential confounders and nonlinear relationships.
method Normalized AIPW (nAIPW) with neural networks and regularization.
result nAIPW maintains double-robustness and orthogonality properties.
SHIFT improves robustness in estimating dose-response functions with heavy-tailed contamination.
problem Outliers bias estimates of average dose-response functions in heavy-tailed data.
method SHIFT combines cross-fit nuisance orthogonalization, Welsch-loss, and defensive OLS refit.
result SHIFT reduces RMSE from 1.03 to 0.33 on localized contamination test.
Generative models are reinterpreted in statistical terms, enabling better understanding and inference.
problem Insufficient interpretability of generative models in statistical terms.
method Flow matching and orthogonalization/cross-fitting in double/debiased machine learning.
result Generative models can be used to estimate nuisance components while maintaining inferential validity.
Improved machine learning performance through structured random orthogonal embeddings.
problem Improving accuracy and speed in machine learning applications.
method Structured random orthogonal matrices for dimensionality reduction and kernel approximation.
result Significant improvement in accuracy and speed compared to existing methods.
Paper introduces new estimator for continuous treatment effects.
problem Estimating the average dose-response function of continuous treatments.
method Utilizes ADML and DML tools, with a novel debiasing method.
result Proves asymptotic normality and shows good performance in simulations.
New q-Hermite kernel improves SVM performance without scaling.
problem Improving SVM performance through novel kernel design.
method Introducing q-Hermite kernel based on q q q -Hermite I polynomials. result The q-Hermite kernel achieves competitive performance compared to classical kernels.
Double descent phenomenon explained in simple terms.
problem Understanding the surprising drop in test error in overparameterized models.
method Informal explanation using linear algebra and probability, visual intuition with polynomial regression, mathematical analysis with ordinary linear regression.
result Three factors create double descent: data undersampling, model size, and parameter count. Ablating any one of these factors prevents double descent.
New optimization algorithms on orthogonal group for machine learning.
problem Efficient optimization on the orthogonal group for machine learning tasks.
method Stochastic geometric algorithms on Lie groups.
result Strong performance on diverse machine learning tasks.
Paper proposes double quantization to reduce communication in distributed machine learning.
problem High communication overhead in synchronizing stochastic gradients and model parameters in distributed training.
method Proposes double quantization for model parameters and gradients, and three communication-efficient algorithms.
result Established performance guarantees and demonstrated effective bit reduction without performance degradation.
DoubleML is a Python library for causal inference using machine learning.
problem Estimating causal parameters in complex models with machine learning.
method Double machine learning framework for valid statistical inference.
result High flexibility and easy extension for various model specifications.
New method untangles double-twist loops efficiently.
problem Tangling of double-twist loops in 3D space.
method Geometrically defined waving procedure to untangle loops.
result Minimum complexity of untanglings is reduced.
A new double quasi-Poisson bracket on surface groups.
problem Constructing a new mathematical structure on surface groups.
method Proposing and proving a double quasi-Poisson bracket on group algebras.
result The double quasi-Poisson bracket is a noncommutative generalization of the Goldman bracket.
Quantum models show improved performance in overparameterized regimes.
problem Overfitting in quantum machine learning models.
method Analytical demonstration and numerical experiments on quantum kernel methods.
result Quantum models can operate in the modern, overparameterized regime without overfitting.
A new algorithm POGO optimizes thousands of orthogonal matrices efficiently.
problem Optimizing thousands of orthogonal constraints at scale is computationally expensive.
method Revisits Landing algorithm, uses modern adaptive optimizers, reduces hyperparameters.
result POGO optimizes thousands of orthogonal matrices in minutes, outperforming alternatives.
Book introduces ML and AI for causal inference.
problem Uncertainty in causal relationships.
method Structural equation models, DAGs, SCMs, and Double/Debiased Machine Learning.
result Improved inference in causal models using predictive tools.
New algorithms learn sparse set functions in non-orthogonal Fourier bases.
problem Learning sparse set functions in non-orthogonal Fourier bases.
method Novel algorithms using non-orthogonal Fourier transforms.
result At most n k − k log 2 k + k nk - k \log_2 k + k nk − k log 2 k + k queries for k k k non-zero Fourier coefficients. Double machine learning improves causal effect estimation by relaxing assumptions.
problem Estimating causal effects with observational data.
method Double/debiased machine learning (DML) framework.
result DML improves adjustment for nonlinear confounding relationships.
New algorithm makes machine learning fairer by removing bias from data.
problem Reduces bias in machine learning models through orthogonal data transformation.
method Orthogonal to Bias (OB) algorithm based on structural causal models.
result Promotes counterfactual fairness without sacrificing model accuracy.
A machine learning method selects optimal orthonormal bases for functional data analysis.
problem Lack of formal criteria for choosing initial orthonormal bases in functional data methods.
method Proposes a machine learning algorithm to learn and place knots for efficient orthogonal spline bases (splinets).
result Demonstrates efficiency, especially for sparse functional data and complex physical systems.
Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, avera…
R package xtdml uses DML for panel data models with fixed effects.
problem Estimating structural parameters in panel data models with fixed effects.
method Combines machine learning with statistical estimation for inference.
result Demonstrates improved performance in learning nuisance functions.
ddml aids causal inference in econometrics with machine learning.
problem Estimation of causal effects with endogenous variables and unknown functional forms.
method Double/Debiased Machine Learning (DDML) in Stata.
result Monte Carlo evidence supports using DDML with stacking for causal inference.
Paper combines machine learning and model averaging for robust parameter estimation.
problem Estimating structural parameters with partially unknown functional forms.
method Pairing double/debiased machine learning with stacking for model averaging.
result DDML with stacking is more robust to unknown functional forms than single learners.
The paper investigates how calibrating propensity scores improves DML estimates of average treatment effects.
problem Improving the accuracy of DML estimates in finite samples.
method Propensity score calibration within the Double/debiased machine learning framework.
result Calibrating propensity scores reduces the root mean squared error of DML estimates of average treatment effects in finite samples.
The paper argues for using Neyman orthogonal score for balancing in debiased machine learning.
problem Debiased machine learning requires a proper approach to balance covariates.
method The paper advocates for using Riesz regression with basis functions of X for balancing.
result Covariate balancing is only valid when the score-relevant regression error is a function of covariates alone.
New estimator optimizes black-box model errors in semiparametric estimation.
problem How nuisance estimation errors affect low-dimensional target parameters in semiparametric models.
method Proposed a new estimator achieving a sharper rate of convergence.
result The first-order stochastic error of nuisance estimation can be eliminated.
Unified approach to decomposing commutative n-ary superalgebras with skew-symmetric forms.
problem Decomposing commutative n-ary superalgebras with skew-symmetric invariant forms.
method Unified approach using derived bracket formalism and inductive orthogonal sums and generalized double extensions.
result Any commutative n-ary superalgebra with a skew-symmetric invariant form can be obtained by inductive orthogonal sums and generalized double extensions.