Debiasing techniques can worsen gender bias in text classification, but a tweak improves both.
problem Debiasing techniques can inadvertently increase gender bias in text classification.
method Investigated traditional debiasing techniques and found they worsen bias. Suggested a minor adjustment.
result A minor adjustment to debiasing techniques can reduce gender bias while maintaining high classification accuracy.
Few-shot image classification is improved by correcting CNNs' texture bias.
problem Few-shot image classification performance is hindered by CNNs' texture bias.
method Corrected CNNs' texture bias using a simpler method than state-of-the-art approaches.
result State-of-the-art performance on miniImageNet task achieved.
Reduces gender classification bias by learning race-invariant face representations.
problem Societal bias in gender recognition systems.
method Adversarially trained autoencoder model to learn race-invariant face representations.
result Achieved a significant drop of over 40% in racial bias surrogate metric with race invariant representations.
The paper addresses bias in stratified classification models and proposes a calibration method.
problem Stratified sampling introduces bias in classification models, affecting ranking performance.
method Developed an analytical solution to optimize ROC curve for stratified sampling bias.
result The proposed ranking algorithm effectively addresses stratified sampling bias in classification models.
Study shows gender bias in occupation classification tasks.
problem Gender bias in machine learning for occupation classification.
method Analyzed impact of explicit gender indicators in semantic representations of biographies.
result True positive rates differ between genders, correlating with existing gender imbalances.
Study shows exponential error reduction in multiclass classification without bias-variance trade-off.
problem Multiclass classification with margin conditions.
method Analysis of classification error under hard-margin conditions.
result Exponential decrease in classification error without bias-variance trade-off.
Study uncovers bias in image classification models using attribution maps.
problem Data bias in image classification models.
method Created an artificial dataset with known bias, trained CNNs, and used attribution maps to inspect decisions.
result Different attribution map techniques highlight bias better than others, and metrics support bias identification.
Bayesian method corrects bias in class-aggregated values.
problem Bias in aggregated values from classification algorithms.
method Bayesian inference with constraints on model parameters.
result Outperforms existing methods in mean squared error.
Paper unifies bias and variance models for classification.
problem Different frameworks for bias and variance in classification.
method Unified Tumer & Ghosh and James approaches.
result Closed form relationships between 0/1 loss and squared error loss.
A new bias score method optimizes fairness in classification.
problem Ensuring fairness in binary classification under group constraints.
method Introducing bias scores and developing a post-hoc approach to adapt to fairness constraints.
result The method maintains high accuracy while ensuring fairness constraints.
This work extends implicit bias analysis to multiclass classification using a new loss framework.
problem The implicit bias of gradient descent on multiclass data without explicit regularization.
method Employing the PERM framework to introduce a multiclass extension of the exponential tail property.
result Extended implicit bias result to multiclass classification using a new loss framework.
Ensembles improve classifier performance by reducing bias, not variance.
problem Improving classifier performance through ensemble methods.
method Extended bias-variance decomposition for classification tasks, introducing dual reparameterization.
result Ensembling reduces bias in classifiers, contrary to the traditional view.
Reduces gender bias in patient notes while maintaining medical classification accuracy.
problem Bias in natural language processing of patient notes.
method Identifying and removing gendered language using BERT-based classifiers, then augmenting data to maintain performance.
result Minimal degradation in health condition classification tasks with data augmentation.
The Pinned AUC metric hides unintended bias when class distributions vary.
problem Unintended bias in classification models.
method Examines the Pinned AUC metric and its limitations.
result Pinned AUC can obscure different types of unintended bias.
Adversarial domain adaptation reduces sample bias in high energy physics classifier.
problem Sample bias in high energy physics classifier training.
method Adversarial domain adaptation using neural networks with gradient reversal layer.
result Successful bias removal on simulated events at the LHC.
Paper introduces metrics to detect unintended bias in text classifiers.
problem Unintended bias in machine learning classifiers.
method Threshold-agnostic metrics considering various score distribution variations across groups.
result New metrics reveal subtle unintended bias in public models.
Reduces false positives in classifying rare online platforms.
problem Challenges in accurately identifying rare online platforms with ML.
method Calibrated probabilities and ensembles to reduce bias.
result Significantly reduces false positives in rare event detection.
Algorithm corrects bias in classification data.
problem Underrepresentation and intersectional bias in classification data.
method Estimate group-wise drop-out rates with small unbiased data, construct reweighting scheme, and present algorithm.
result Efficiently approximate loss of any hypothesis on true distribution.
New algorithm corrects bias in LDP-released data for better analysis.
problem Bias in data released under Local Differential Privacy (LDP).
method Inverse Weierstrass Private Stochastic Gradient Descent (IWP-SGD).
result Converges to true population risk minimizer at O(1/n) rate. New method debiases selection bias in PU classification with exposure data.
problem Binary classification from positive and unlabeled data with selection bias.
method Automatic Debiased PUE (ADPUE) learning method.
result ADPUE outperforms traditional PU learning methods on various datasets.
New method reduces model bias and variance by adjusting training sample weights based on label uncertainty.
problem Tradeoff between model bias and variance in classification models.
method Estimate label uncertainty, adjust training sample weights, and fine-tune decision boundary.
result Improves model performance and reduces variance in physical activity recognition.
The paper corrects bias in synthetic data for imbalanced learning.
problem Challenges in balancing false positive and negative rates in imbalanced data.
method Proposes a bias correction procedure to generate synthetic data for minority groups.
result Enhances prediction accuracy while avoiding overfitting.
Graph data sets often contain isomorphism bias, artificially inflating model performance.
problem Isomorphism bias in graph data sets causing inflated model performance.
method Analysis of 54 graph data sets, recommendations for model setup, open sourcing new data sets.
result Graph data sets commonly contain isomorphism bias, artificially inflating model performance.
Research shows bias in machine learning can be due to algorithmic flaws, not just data.
problem Underestimation bias in machine learning algorithms.
method Initial research to understand factors contributing to bias in classification algorithms.
result Regularization methods to address overfitting can also accentuate bias.
Corrects bias in learned generative models using likelihood-free importance weighting.
problem Bias in learned generative models relative to true data distribution.
method Estimate likelihood ratio using a classifier, apply importance weighting.
result Consistently improves goodness-of-fit metrics for deep generative models.
New ensemble approach reduces bias and variance for outlier detection.
problem Improving accuracy in outlier detection for multi-dimensional data.
method Sequential ensemble approach CARE that reduces bias and variance.
result CARE outperforms or matches individual baselines and state-of-the-art ensembles.
The paper examines bias in ML models using the Adult dataset.
problem Understanding and mitigating bias in machine learning models.
method Mathematical framework for fair learning, Disparate Impact index, and evaluation of bias reduction methods.
result Some common bias reduction methods are ineffective.
AdaGrad on linear problems converges to SVM direction.
problem Understanding AdaGrad's implicit bias on linear classification.
method Characterizing AdaGrad's convergence direction as a quadratic optimization problem.
result AdaGrad converges to a direction similar to SVM's solution.
Study how optimization methods' choices affect the solutions they find.
problem Characterize the solutions found by optimization methods under different potentials and norms.
method Examined mirror descent, natural gradient descent, and steepest descent for underdetermined linear regression and separable linear classification.
result The specific global minimum reached by an algorithm can be characterized by the potential or norm of the optimization geometry, independent of hyperparameters.
Matrix SMD converges to unique solution minimizing Bregman divergence.
problem High-dimensional multi-output classification and matrix completion problems.
method Stochastic Mirror Descent with matrix parameters and matrix mirror functions.
result Matrix SMD converges exponentially to the unique solution minimizing Bregman divergence.
New findings show DNC is not optimal for deep models, revealing a low-rank bias.
problem Theoretical limitations of DNC in non-linear models and multi-class classification.
method Analysis of non-linear models of arbitrary depth in multi-class classification.
result DNC stops being optimal for DUFM when going beyond two layers or two classes, due to a low-rank bias.
Batch normalization biases linear models towards uniform margins, improving performance in binary classification.
problem Understanding the implicit bias of batch normalization in linear models and neural networks.
method Analyzing gradient descent convergence on linear models and two-layer CNNs with batch normalization.
result Gradient descent with batch normalization in linear models converges to a uniform margin classifier with an exponential convergence rate.
This work studies the implicit bias of mini-batch SGD in classification.
problem Understanding the implicit bias of mini-batch SGD in multi-class classification.
method Characterizes how batch size, momentum, and variance reduction affect convergence and max-margin behavior under different norms.
result Momentum enables small-batch convergence to an approximate max-margin solution, while variance reduction recovers the exact full-batch bias.
This work introduces a bias-variance decomposition for proper scores, improving uncertainty estimation in predictive models.
problem Reliable uncertainty estimation for predictions in safety-critical applications, especially under domain drift.
method Developed a general bias-variance decomposition for proper scores, introducing the Bregman Information as the variance term.
result The decomposition provides novel formulations for different predictive tasks, including classification and model ensembles.
Mitigates bias in text classification by weighting instances.
problem Unintended biases in text classification datasets based on demographic terms.
method Instance weighting to recover non-discrimination distribution.
result Effective mitigation of unintended biases without sacrificing generalization.
Method reduces bias in occupation classification without protected attribute data.
problem Mitigating bias in occupation classification without access to protected attributes.
method Uses word embeddings to discourage correlation between predicted occupation probability and name.
result Reduces race and gender biases without significant loss in true positive rate.
New technique reduces bias in DNN models without sensitive attribute annotations.
problem Existing bias mitigation methods require instance-level annotations and do not guarantee removal of all sensitive information.
method Representation Neutralization for Fairness (RNF) debiases only the classification head of DNN models using neutralized representations.
result RNF effectively reduces discrimination of DNN models with minimal performance degradation.
Study reduces gender bias in web data used for image recognition.
problem Gender bias in web data amplifies in machine learning models.
method Inject corpus-level constraints for calibrating structured prediction models.
result Bias amplification decreased by 47.5% and 40.5% for multilabel classification and visual semantic role labeling.
fairmodels tool detects and mitigates bias in machine learning models.
problem Bias in machine learning models leading to discrimination.
method Model-agnostic approach to bias detection, visualization, and mitigation.
result Validates fairness and eliminates bias in classification models.
Study shows how bias in optimization affects robustness in adversarial settings.
problem Understanding and mitigating implicit bias in adversarially robust models.
method Analyzes the implicit bias in robust empirical risk minimization and its impact on generalization.
result Implicit bias in optimization can significantly affect robust generalization.
Paper detects bias in AI medical models using CART.
problem Ensuring fairness in AI medical decision support systems.
method Uses Classification and Regression Trees (CART) algorithm to identify bias.
result Validated the CART approach in both synthetic and real-world data.
The paper detects and identifies bias in data using a counterfactual approach.
problem Detecting and identifying bias in data, especially in medical image classification.
method A global explanation framework using the counterfactual approach to identify bias causing artifacts.
result Black frames significantly influence Convolutional Neural Network's prediction, changing benign to malignant.
New algorithms reduce overfitting in multiclass classification.
problem Excessive reuse of test datasets in machine learning leads to overfitting, especially in multiclass classification.
method Developed computationally efficient algorithms to reduce overfitting bias in multi-class classification.
result Achieved overfitting bias of Θ(√(k/(mn)), k/n), matching known upper bounds.
Paper proposes a new MLC framework without predefined label order, improving performance and generalization.
problem Exposure bias in multi-label classification due to lack of predefined label order.
method Proposes a new framework that transforms MLC into a sequence prediction problem without predefined label order.
result The proposed method outperforms competitive baselines and has better generalization capability.
CART can bias propensity score estimates with missing data, but multiple imputation is better.
problem Bias in propensity score estimation with CART and missing data.
method Examined CART performance with different approaches to missing data: direct CART, complete case analysis, and multiple imputation.
result Multiple imputation followed by CART outperformed direct CART with missing data.
Study reveals how neural network biases align with adversarial attack frequencies.
problem Correlation between neural network biases and adversarial attacks.
method Fourier transform analysis of network implicit bias and adversarial perturbations.
result Network bias and adversarial attack frequencies are highly correlated.
Deep learning models show bias and variance are aligned, not in trade-off.
problem The classical bias-variance trade-off in deep learning models.
method Empirical evidence and theoretical analysis of bias and variance in deep learning models.
result Squared bias is approximately equal to variance for correctly classified sample points in deep learning models.
XEM improves multivariate time series classification with explainable models.
problem Multivariate time series classification challenges.
method Hybrid ensemble method combining explicit boosting-bagging and implicit divide-and-conquer.
result XEM outperforms state-of-the-art MTS classifiers on public datasets.