Proposes a three-stage debiasing framework to improve out-of-distribution accuracy.
problem Inaccurate uncertainty estimations in bias-only models damage ensemble-based debiasing performance.
method Calibrates the bias-only model to improve its uncertainty estimations, creating a three-stage ensemble-based debiasing framework.
result The three-stage debiasing framework consistently outperforms traditional methods in out-of-distribution accuracy.
A new method debiases multiple target parameters without IFs.
problem Debiasing multiple target parameters in nonparametric models.
method Kernel Debiased Plug-in Estimation (KDPE) using TMLE and reproducing kernel Hilbert spaces.
result KDPE simultaneously debiases all pathwise differentiable target parameters.
A new debiasing method for high-dimensional regression with applications to PCR.
problem Debiasing in high-dimensional statistics with i.i.d. samples and sub-Gaussian covariates.
method Spectrum-Aware Debiasing using rescaled gradient descent with spectral information.
result Achieves debiasing in broader contexts with structured dependencies, heavy tails, and low-rank structures.
A debiasing method improves nonparametric regression's statistical properties.
problem Lack of theoretical guarantees for modern nonparametric regression methods.
method Model-free debiasing method incorporating a correction term.
result Debiased estimator satisfies pointwise and uniform risk convergence, asymptotic normality.
Paper debiases multiple word embedding biases simultaneously.
problem Reduction of multiple biases in word embeddings.
method Joint multiclass debiasing approach using Word Embeddings Association Test (WEAT).
result Demonstrates reduction or complete elimination of bias in word embeddings.
A self-supervised debiasing method using rank regularization mitigates spurious correlations in neural networks.
problem Spurious correlations cause biases in deep neural networks, affecting generalization.
method Spectral analysis of latent representations, rank regularization, self-supervised pretraining, debiasing of downstream tasks.
result The proposed framework significantly improves generalization performance and outperforms supervised debiasing approaches.
This paper evaluates debiasing methods on word embeddings to reduce religious bias.
problem Social biases persist in word embeddings, potentially amplifying them in AI applications.
method Investigates and evaluates three multiclass debiasing techniques on three word embeddings.
result ConceptorDebiasing is the most effective method, reducing religious bias by 82-96%.
New debiasing methods for fine-tuned neural networks.
problem Bias in neural networks used for high-stakes decisions.
method Intra-processing methods designed for fine-tuned models.
result Demonstrated effectiveness of intra-processing methods across various datasets.
Paper develops a distributed debiased estimator for sparse statistical inference.
problem High computational costs in debiased estimator construction for high-dimensional models.
method Develops a multi-round distributed debiased estimator using both labeled and unlabelled data.
result Unlabeled data improves statistical rate of each iteration in distributed setup.
Automatic debiasing for causal and policy effects using Neural Nets and Random Forests.
problem Estimating causal and policy effects from high-dimensional or non-parametric regression functions.
method Automatic learning of Riesz representation using Neural Nets and Random Forests.
result Automatic debiasing method performs well compared to state-of-the-art algorithms.
New method neutralizes gender bias in word embeddings without losing semantic information.
problem Gender biases in word embeddings trained on human-generated corpora.
method Latent Disentanglement and Counterfactual Generation with siamese auto-encoder and gradient reversal layer.
result Our method outperforms existing debiasing methods in preserving semantic information and neutralizing gender biases.
Develops a direct debiased machine learning framework using Bregman divergence.
problem Reduces bias in machine learning estimates of causal effects or structural models.
method Neyman targeted estimation and generalized Riesz regression using Bregman divergence.
result Improves estimation of parameters of interest in causal models.
New models can't beat existing ones, so debiasing methods only slightly reduce needed labels.
problem Limiting scalability in model evaluation due to self-preferencing biases.
method Study of debiasing methods using a few high-quality labels to reduce model judgments.
result Debiasing methods can't decrease required ground truth labels by more than half when the judge is no more accurate than the model.
Semi-supervised learning debiased for better performance.
problem Bias in SSL methods impairs theoretical guarantees and empirical performance.
method Simple debiasing approach to remove risk estimate bias.
result Debiased SSL methods provide better calibrated models.
New method debiases selection bias in PU classification with exposure data.
problem Binary classification from positive and unlabeled data with selection bias.
method Automatic Debiased PUE (ADPUE) learning method.
result ADPUE outperforms traditional PU learning methods on various datasets.
Study improves statistical inference for CATEs using Lasso and DML.
problem Estimating and inferring CATEs in high-dimensional settings.
method Doubly robust estimator, Lasso regularization, debiased Lasso, DML.
result TDL (triple/debiased Lasso) achieves n \sqrt{n} n -consistency and confidence intervals. Ridge regression is revisited with debiasing and thresholding, offering advantages over Lasso.
problem High-dimensional data challenges classical ridge regression's sparsity detection and bias issues.
method Debiasing and thresholding ridge regression, introducing a wild bootstrap for confidence regions and hypothesis testing, and a hybrid bootstrap for prediction intervals.
result Debiased and thresholded ridge regression can offer similar performance to thresholded Lasso and may be preferable in some settings.
Paper develops PGMM framework for debiased inference on nonparametric IV estimators.
problem Automatic debiased inference on nonparametric IV functionals.
method Penalized GMM (PGMM) framework for functionals of IV estimators.
result PGMM-based debiased estimator performs well, achieving near-nominal coverage.
D3M debiases models by selectively removing problematic examples.
problem Model failures on underrepresented subgroups.
method Isolates and removes specific training examples that cause failures.
result Efficiently trains debiased classifiers with minimal example removal.
Improved nonparametric regression with debiasing for root-n consistency.
problem Challenges in achieving root-n consistency and normal distribution for nonparametric estimators.
method Debiasing technique by adding a correction term to nonparametric estimators.
result Achieves root-n consistency and asymptotic normality.
Paper introduces new estimator for continuous treatment effects.
problem Estimating the average dose-response function of continuous treatments.
method Utilizes ADML and DML tools, with a novel debiasing method.
result Proves asymptotic normality and shows good performance in simulations.
COMMOD debiases models with minimal and interpretable changes.
problem Inconsistent and costly model updates in fair machine learning.
method Introduced COMMOD, a novel algorithm for algorithmic fairness that minimizes changes and makes them interpretable.
result COMMOD achieves comparable performance to state-of-the-art debiasing methods while making minimal and interpretable changes.
We simplify debiasing of LASSO estimates for practical computation.
problem Bias in LASSO estimates for high-dimensional data.
method Reformulate optimization problem to compute debiasing matrix W directly.
result Efficient closed-form solution for W with unique optimal solution.
New method for debiased inference without assuming exact solutions in inverse problems.
problem Dealing with inverse problems where exact solutions may not exist.
method Nonparametric instrumental variable analysis without structural equations.
result Valid inference on functionals of inverse problems without assuming exact solutions.
New method improves robustness of neural network-based debiasing.
problem Improving robustness of neural network-based debiasing.
method Moment-constrained learning for neural networks.
result Improved performance compared to state-of-the-art benchmarks.
Develops methods to correct bias in AI feedback for more accurate alignment.
problem Systematic bias in AI feedback compared to human labels.
method Two debiased alignment methods: DDPO and DIPO.
result Methods improve alignment efficiency and performance close to human-labeled data.
Paper proposes a method to create more reliable confidence intervals for off-policy evaluations.
problem Creating reliable confidence intervals for off-policy evaluations.
method Proposes a deeply-debiasing procedure to construct efficient, robust, and flexible confidence intervals.
result Validated by theoretical results and numerical experiments, the method improves the reliability of off-policy evaluations.
Mitigates confirmation bias in SSL by adjusting pseudo labels dynamically.
problem Confirmation bias in semi-supervised learning leads to errors in pseudo labels.
method TaMatch framework adjusts scaling ratio to debias pseudo labels and dynamically adjusts target distribution.
result TaMatch significantly outperforms existing methods in SSL tasks.
Paper proposes methods to reduce bias and variance in recommender systems.
problem Bias in recommender systems due to users' preferences.
method Proposes a principled approach to reduce bias and variance in DR methods, and a novel semi-parametric collaborative learning approach.
result The proposed methods outperform existing debiasing methods in both theory and experiments.
Unified theory and debiasing framework for random oblique projections in high dimensions.
problem Systematic statistical bias in random oblique projections induced by sampling.
method Unified non-asymptotic theory and debiasing framework.
result Sharp bias--variance characterizations and improved approximation accuracy.
Method trains a debiased model from a biased one by focusing on samples that contradict the bias.
problem Training neural networks can lead to biased predictions due to spurious correlations.
method Train a pair of neural networks, intentionally biasing one and debiasing the other by focusing on contradictory samples.
result Our method significantly improves training against various types of biases, sometimes outperforming explicit supervision methods.
Javanmard and Montanari propose a debiased estimator for high-dimensional regression.
problem Bias in high-dimensional regression models.
method Debiased LASSO estimator.
result Debiased LASSO yields asymptotically normal estimators and valid hypothesis tests.
New method debiases counterfactual distributions using observational data.
problem Estimating counterfactual distributions under interventions without relying on observational data.
method Flow-matching approach to learn counterfactual distributions from observational data.
result Deconfounding flows outperform existing debiased counterfactual distribution estimators.
ADML combines debiased learning with data-driven model selection for efficient inference.
problem Debiased machine learning estimators can be unstable and biased in nonparametric models.
method Data-driven model selection techniques combined with debiased machine learning.
result ADML estimators yield superefficient inference for pathwise differentiable parameters.
This paper introduces a novel online inference method for high-dimensional GLMs.
problem Real-time analysis of sequentially collected data in high-dimensional settings.
method Adaptive stochastic gradient descent with online debiasing for dynamic objective functions.
result Established the asymptotic normality of the Adaptive Debiased Lasso (ADL) estimator.
Proposes online debiasing estimators for adaptive linear regression.
problem Adaptive data collection leads to non-normal asymptotic behavior in simple methods.
method Online debiasing estimators that correct distributional anomalies.
result Asymptotic normality and minimax lower bound for proposed estimators.
Unified framework for automatic debiased machine learning for various statistical parameters.
problem Inference on smooth functionals of nonparametric M-estimands.
method Unified framework using gradient, Hessian, and linear approximation; solves two risk minimization problems.
result Efficient autoDML estimators with double robustness and robustness to misspecification.
DeBayes uses Bayesian methods to create fair network embeddings.
problem Ensuring fairness in network embeddings for high-impact applications.
method Bayesian approach to learn debiased network embeddings.
result DeBayes produces fairer network embeddings for link prediction.
Study proves NN matching is equivalent to Riesz regression for debiased machine learning.
problem Addressing bias in machine learning models.
method Interprets NN matching as Riesz regression and derives it from LSIF.
result NN matching is shown to be equivalent to Riesz regression.
Optimal first-order methods are shown to be fundamental limits in functional estimation.
problem Optimal functional estimation under weak conditions.
method Formalization of functional estimation with black-box nuisance function estimates and derivation of minimax lower bounds.
result First-order methods are optimal under weak conditions, but higher-order methods can outperform them when nuisance function structure is known.
DKGM improves image quality by debiasing kernel-based models.
problem Improving image quality in generative models without losing detail.
method Two-stage framework: KDE for density estimation, debiasing algorithm inspired by stochastic approximation.
result DKGM achieves comparable image quality to state-of-the-art models on CIFAR10.
The paper debiases mini-batch approximations in deep learning for more accurate optimization and uncertainty quantification.
problem Bias in mini-batch approximations distorts the shape of quadratic approximations used in deep learning.
method Developed and evaluated debiasing strategies for mini-batch approximations.
result Debiasing strategies improve the accuracy of second-order optimization and uncertainty quantification in deep learning.
This paper examines fairness and arbitrariness in bias mitigation methods.
problem Understanding how different bias mitigation strategies affect individual predictions and whether they introduce arbitrariness.
method FRAME framework to evaluate bias mitigation through five dimensions: Impact Size, Change Direction, Decision Rates, Affected Subpopulations, and Neglected Subpopulations.
result Significant differences in the behaviors of debiasing methods were exhibited, highlighting the limitations of current fairness criteria and the inherent arbitrariness in the debiasing process.
Paper develops efficient DML estimators for multiway clustered data without cross-fitting.
problem Efficient inference in models with multiway clustered dependence.
method Neyman-orthogonal moment conditions combined with localisation-based empirical process approach.
result Valid inference achieved without cross-fitting, showing debiased GMM estimators are asymptotically linear and normal.
Develops methods to identify and estimate causal effects with instrumental variables.
problem Causal inference with confounded treatment assignment and unobserved variables.
method General nonparametric causal framework, debiased machine learning, semiparametric theory.
result Consistent and asymptotically normal estimators for average treatment effect.
New algorithm finds unbiased subnetworks in biased datasets.
problem Finding unbiased subnetworks in biased neural networks.
method Debiased Contrastive Weight Pruning (DCWP) algorithm.
result DCWP significantly outperforms state-of-the-art debiasing methods.
Book introduces ML and AI for causal inference.
problem Uncertainty in causal relationships.
method Structural equation models, DAGs, SCMs, and Double/Debiased Machine Learning.
result Improved inference in causal models using predictive tools.
Bayesian method improves SS settings by leveraging unlabeled data.
problem Improving parameter estimation in semi-supervised settings with unlabeled data.
method Bayesian approach using debiasing of summary statistics.
result Concrete theoretical results validate the method's efficiency and robustness.