The paper studies and mitigates accuracy disparity in regression models.
problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.
Study shows label errors impact model disparity metrics, proposing mitigation methods.
problem Impact of label errors on model disparity metrics.
method Empirical study, characterizing label error effects; proposing estimation and relabeling methods.
result Label errors significantly affect model disparity metrics, particularly for minority groups.
DCEM algorithm reduces bias in machine learning models trained on selective labels.
problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.
Study shows explanation disparities in machine learning models are influenced by data and model properties.
problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.
Study highlights fairness issues in travel behavior prediction models.
problem Ethical challenges in travel behavior analysis using machine learning.
method Operationalized computational fairness by equality of opportunity; compared DNN and DCM; introduced absolute correlation regularization.
result Both DNN and DCM predict disparities across social groups, with DNN outperforming DCM in prediction disparities.
Following related work in law and policy, two notions of disparity have come to shape the study of fairness in algorithmic decision-making. Algorithms exhibit treatment disparity if they formally treat members of protected subgroups differently; algorithms exhibit impact disparity when outcomes differ across subgroups,…
Algorithm learns fair representations without sacrificing accuracy across groups.
problem Mitigating disparity among different demographic subgroups in classification.
method Balanced error rate and conditional alignment of representations.
result Improves utility-fairness trade-off on balanced datasets.
Paper explores fair classification with bounded disparity using finite datasets.
problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.
The paper analyzes how deep neural networks handle noisy labels and finds disparate impacts.
problem Disparate impacts of noisy labels on instances with different representation frequencies.
method Quantifying harms, analyzing solutions, and comparing their impacts on different frequency instances.
result Existing solutions lead to disparate treatments, benefiting higher-frequency instances more.
New method reduces privacy impact on model accuracy for underrepresented groups.
problem Privacy mechanisms disproportionately affect underrepresented groups in machine learning models.
method Proposes DPSGD-F, a modified DPSGD that adjusts group contributions based on clipping bias.
result DPSGD-F removes disparate impact of differential privacy on model accuracy for protected groups.
Develops a new criterion for subgroup fairness in algorithmic decision support.
problem Identifying fair recommendations in algorithms despite group-level differences.
method IJDI criterion and IJDI-Scan approach to detect and mitigate disparities.
result Identifies significant disparities in recommendations across subpopulations.
New method evaluates multiple social disparities using machine learning.
problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.
The paper introduces return parity for fairness in MDPs, addressing delayed and adverse effects.
problem Fairness in MDPs for dynamic domains with delayed and adverse effects.
method Proposes return parity, decomposes return disparity, and develops algorithms for state visitation distributional alignment.
result The proposed algorithms can successfully close the disparity gap while maintaining policy performance.
Adversarial training can lead to unfair accuracy disparities between different groups.
problem Adversarial training algorithms introduce unfair accuracy disparities between different groups of data.
method Propose a Fair-Robust-Learning (FRL) framework to mitigate unfairness in adversarial defenses.
result Empirical and theoretical validation of FRL's effectiveness in mitigating unfairness.
Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an individual bias detector used to prioritize data samples in a bias mitigation a…
Study reveals class disparities in balanced datasets through spectral imbalance.
problem Class disparities in balanced datasets are overlooked despite model performance gaps.
method Developed a theoretical framework and studied 11 encoders to diagnose spectral imbalance.
result Identified spectral imbalance as a source of class disparities in balanced datasets.
Selective regression allows abstention to improve fairness criteria.
problem Selective regression can exacerbate disparities between subgroups.
method Proposes new fairness criteria and two approaches to mitigate performance disparity.
result Proposed fairness criteria ensures performance improvement for every subgroup with reduced coverage.
Machine learning models (e.g., speech recognizers) are usually trained to minimize average loss, which results in representation disparity---minority groups (e.g., non-native speakers) contribute less to the training objective and thus tend to suffer higher loss. Worse, as model accuracy affects user retention, a minor…
Paper proposes a new algorithm to minimize AUC disparities in machine learning models.
problem Minimizing unfairness in AUC scores for machine learning models.
method Proposes a minimax learning and bias mitigation framework for AUC optimization.
result Proves the convergence of the proposed algorithm to minimize group-level AUC.
Study shows racial bias in health data, which can be reduced with simple techniques.
problem Racial bias in health indicators measured by the Medical Expenditure Panel Survey (MEPS).
method Used publicly available and nationally representative MEPS data to show bias in predictive models for care management.
result Racial bias can be significantly reduced using simple mitigation techniques.
Study shows how algorithmic prediction affects US housing market, reducing racial wealth disparities.
problem Impact of algorithmic prediction on housing market and racial wealth disparities.
method Natural experiment using digitization of housing records to study entry, allocation, and prices.
result Digitization leads to increased sale prices for minority-owned homes, reducing racial wealth disparities.
Semi-supervised learning benefits the rich more than the poor, affecting fairness.
problem Disparate impact of semi-supervised learning on different sub-populations.
method Theoretical and empirical analysis of a broad family of SSL algorithms using pseudo-labels.
result Semi-supervised learning benefits the rich more than the poor, potentially violating fairness.
Unified framework for Bayes-optimal classifiers under group fairness.
problem Mitigating disparate impacts from algorithmic predictions in high-stakes decision-making.
method Unified framework based on Neyman-Pearson argument for deriving Bayes-optimal classifiers under group fairness constraints.
result Proposes FairBayes method that directly controls disparity and achieves optimal fairness-accuracy tradeoff.
We study the phenomenon of bias amplification in classifiers, wherein a machine learning model learns to predict classes with a greater disparity than the underlying ground truth. We demonstrate that bias amplification can arise via an inductive bias in gradient descent methods that results in the overestimation of the…
Study shows how missing data from certain groups can unfairly bias risk models.
problem Data missingness without indicators of missingness can unfairly bias risk models.
method Developed an analytically tractable model of differential feature under-reporting and proposed new methods to mitigate bias.
result Under-reporting typically leads to increasing disparities in risk models.
This study simulates biases in classifiers to assess fairness.
problem Mitigating biases in predictive models to ensure fairness.
method Agent-based model (ABM) to generate synthetic datasets with controlled biases, applied to offline and online learning approaches.
result Demonstrates how biases in data affect classifier outcomes and how mitigations impact feature usage.
New method improves fairness in DP learning by preventing excessive gradient suppression.
problem Disparate impact on model predictions for minority groups in DP learning.
method Bounded adaptive clipping to prevent excessive gradient suppression.
result Improves worst-class accuracy by over 10 percentage points compared to existing methods.
The paper tackles fairness in estimating graphical models, especially for protected attributes.
problem Fairness issues in estimating graphical models, particularly for sensitive characteristics.
method Integrates pairwise graph disparity error and a tailored loss function into a multi-objective optimization problem.
result Successfully mitigates bias in graphical model estimation without compromising model performance.
Study removes bias from chest X-ray embeddings using orthogonalization.
problem Reduces bias in chest X-ray embeddings due to protected features.
method Orthogonalization technique to remove protected feature effects.
result Orthogonalization removes bias and makes predictions of protected attributes infeasible.
New framework tackles fairness in link prediction beyond demographic parity.
problem Systemic biases in link prediction can exacerbate societal inequalities.
method Formalizes limitations of existing fairness evaluations and proposes a new framework.
result Proposes a lightweight post-processing method combined with decoupled link predictors.
Paper studies fair classification of functional data.
problem Mitigating disparities in functional data classification.
method Unified framework for fairness-aware functional classification.
result Established theoretical guarantees on fairness and excess risk controls.
Models to price long term loans in the securities lending business are developed. These longer horizon deals can be viewed as contracts with optionality embedded in them. This insight leads to the usage of established methods from derivatives theory to price such contracts. Numerical simulations are used to demonstrate…
Develops methods for fair classification under linear disparity constraints.
problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.
New DP training ensures models behave similarly at training and test time.
problem Standard SGD training leads to inconsistent model behavior at training and test time.
method Differentially-Private (DP) training ensures WYSIWYG property through distributional generalization.
result DP training guarantees high-level WYSIWYG property, improving model robustness and privacy.
A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of disparate vulnerability against MIAs: unequal success rate of MIAs against diff…
In recent years, there have been significant efforts on mitigating unethical demographic biases in machine learning methods. However, very little is done for kernel methods. In this paper, we propose a new fair kernel regression method via fair feature embedding (FKR-F2E) in kernel space. Motivated by prior works on…
Geographic diversification is fundamental to risk mitigation among investors and insurers of housing, mortgages, and mortgage-related derivatives. To characterize diversification potential, we provide estimates of integration, spatial correlation, and contagion among US metropolitan housing markets. Results reveal a hi…
Study decomposes racial healthcare disparities via shifts in mediator distributions.
problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.
As algorithmic prediction systems have become widespread, fears that these systems may inadvertently discriminate against members of underrepresented populations have grown. With the goal of understanding fundamental principles that underpin the growing number of approaches to mitigating algorithmic discrimination, we …
Bayesian model identifies health disparities in disease progression.
problem Health disparities bias disease progression models.
method Interpretable Bayesian model accounting for three disparities.
result Model identifies and corrects for health disparities.
Proposes a method to quantify and decompose disparity in ML models, separating exempt and non-exempt components.
problem Quantifying disparity in ML models, especially when certain features are exempted due to their critical importance.
method Information-theoretic decomposition into exempt and non-exempt components, satisfying desirable properties.
result Proposes a measure of non-exempt disparity that satisfies all desirable properties, and shows impossibility results for observational measures.
FAIRIF improves fairness in deep learning models without changing the model architecture.
problem Improving fairness in deep learning models trained on sensitive data.
method Two-stage training algorithm that minimizes loss over a reweighted data set, balancing model performance across demographic groups.
result FAIRIF reduces disparity among different groups in classification settings, improving fairness-utility trade-offs.
End-to-end framework learns precise disparity for activity recognition.
problem Precise portrayal of intraclass disparity in activity recognition.
method Knowledge-directed adversarial learning framework with two competitive encoding distributions.
result Robust and generalizable performance on HAR benchmark datasets.
We provide the asymptotic distribution of the major indexes used in the statistical literature to quantify disparate treatment in machine learning. We aim at promoting the use of confidence intervals when testing the so-called group disparate impact. We illustrate on some examples the importance of using confidence int…
This work debiases deep chest X-ray classifiers using intra- and post-processing methods.
problem Bias in deep neural networks for chest X-ray classification.
method Intra-processing techniques (fine-tuning and pruning) and post-processing methods.
result Successfully mitigates biases in fully connected and convolutional neural networks, offering stable performance.
New method improves fairness of facial recognition systems.
problem Facial recognition systems exhibit bias across different demographic groups.
method Optimizes centroid-based scores to reduce bias in pre-trained models.
result Demonstrates significant improvement in fairness with minimal loss in accuracy.
Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the utility of these systems (or, classifiers), their training involves minimizing the e…
The paper examines how adversarial robustness affects accuracy disparity across different classes.
problem Understanding the impact of adversarial robustness on accuracy disparity across different classes.
method Linear classifiers under a Gaussian mixture model, decomposing the impact into inherent and imbalance effects.
result Adversarial robustness consistently degrades standard accuracy in balanced classes, but the class imbalance ratio plays a different role in accuracy disparity.