Study decomposes racial healthcare disparities via shifts in mediator distributions.
problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.
Study shows how algorithmic prediction affects US housing market, reducing racial wealth disparities.
problem Impact of algorithmic prediction on housing market and racial wealth disparities.
method Natural experiment using digitization of housing records to study entry, allocation, and prices.
result Digitization leads to increased sale prices for minority-owned homes, reducing racial wealth disparities.
Study shows racial bias in health data, which can be reduced with simple techniques.
problem Racial bias in health indicators measured by the Medical Expenditure Panel Survey (MEPS).
method Used publicly available and nationally representative MEPS data to show bias in predictive models for care management.
result Racial bias can be significantly reduced using simple mitigation techniques.
Controversies around race and machine learning have sparked debate among computer scientists over how to design machine learning systems that guarantee fairness. These debates rarely engage with how racial identity is embedded in our social experience, making for sociological and psychological complexity. This complexi…
Study finds racial bias in pulse oximeter readings has minimal impact on ICU ventilation rates.
problem Racial disparities in pulse oximeter readings affect clinical decisions in ICU settings.
method Causal inference using path-specific effects and doubly robust estimator.
result Minimal impact of racial discrepancies on invasive ventilation rates, but more pronounced on ventilation duration.
Develops causal framework for fair survival analysis in healthcare.
problem Fairness in survival analysis for high-stakes domains like healthcare.
method Causal framework using graphical models, conditional survival function, and Causal Reduction Theorem.
result Decomposes disparities in survival into direct, indirect, and spurious pathways.
New method evaluates multiple social disparities using machine learning.
problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.
Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions, and parole decisions-- is the perceived "neutrality" of computers. It is argued…
Improved surname geocoding and name supplements enhance race imputation accuracy.
problem Census data problems affecting race imputation accuracy.
method Fully Bayesian Improved Surname Geocoding (fBISG) and name supplements.
result Significant improvement in race imputation accuracy across all racial groups.
The paper examines how machine learning tools in justice settings can unfairly affect different racial groups.
problem Machine learning tools in justice settings can unfairly affect different racial groups.
method Exploring different ideas of racial equity and their computational trade-offs.
result Computation alone is unlikely to solve the unfairness in machine learning tools for justice settings.
COMPAS recidivism predictions show racial bias against African Americans, study finds.
problem Racial bias in recidivism prediction algorithms.
method Causal analysis using FACT, a fairness measure grounded in causal inference.
result COMPAS shows racial bias against African American defendants, robust to unmeasured confounding.
Study reveals AI skin cancer classifiers underperform for darker skin phototypes, advocating for fairness auditing.
problem AI bias in dermatology, particularly for darker skin phototypes.
method Predictive Representativity (PR) framework, evaluating classifiers on HAM10000 and BOSQUE Test sets.
result Substantial performance disparities by skin phototype, highlighting AI bias.
A machine learning model may exhibit discrimination when used to make decisions involving people. One potential cause for such outcomes is that the model uses a statistical proxy for a protected demographic attribute. In this paper we formulate a definition of proxy use for the setting of linear regression and present …
The persistence of racial inequality in the U.S. labor market against a general backdrop of formal equality of opportunity is a troubling phenomenon that has significant ramifications on the design of hiring policies. In this paper, we show that current group disparate outcomes may be immovable even when hiring decisio…
The study uses transfer learning to compare surgical outcomes across racial/ethnic subgroups.
problem Difficulty in comparing surgical outcomes due to racial/ethnic and geographic differences.
method Causal inference framework and transfer learning to incorporate data from multiple populations.
result Racial and ethnic differences in surgical outcomes are found, with non-Hispanic Black patients experiencing wide variability.
Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are often investigated as possible improvements over more classical tools such as r…
Prior work finds a diversity paradox: diversity breeds innovation, and yet, underrepresented groups that diversify organizations have less successful careers within them. Does the diversity paradox hold for scientists as well? We study this by utilizing a near-population of ~1.2 million US doctoral recipients from 1977…
Reduces gender classification bias by learning race-invariant face representations.
problem Societal bias in gender recognition systems.
method Adversarially trained autoencoder model to learn race-invariant face representations.
result Achieved a significant drop of over 40% in racial bias surrogate metric with race invariant representations.
Develops a method to quantify racial bias in law enforcement systems.
problem Quantify racial bias in law enforcement systems considering criminality and multi-stage interactions.
method Multi-stage causal framework incorporating criminality.
result Identifies three canonical scenarios of racial bias in law enforcement.
Recidivism prediction scores are used across the USA to determine sentencing and supervision for hundreds of thousands of inmates. One such generator of recidivism prediction scores is Northpointe's Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) score, used in states like California and F…
The paper studies and mitigates accuracy disparity in regression models.
problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.
Develops methods for fair classification under linear disparity constraints.
problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.
A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of disparate vulnerability against MIAs: unequal success rate of MIAs against diff…
Model proposes how regulators should oversee complex algorithms in high-stakes applications.
problem Regulating complex algorithms used in high-stakes applications like lending, testing, and hiring.
method Proposes a model where regulators are limited in learning about complex algorithms with misaligned preferences, and explores different regulatory approaches.
result Complex algorithms can improve welfare, but regulation should focus on the source of incentive misalignment for optimal results.
Following related work in law and policy, two notions of disparity have come to shape the study of fairness in algorithmic decision-making. Algorithms exhibit treatment disparity if they formally treat members of protected subgroups differently; algorithms exhibit impact disparity when outcomes differ across subgroups,…
Study shows explanation disparities in machine learning models are influenced by data and model properties.
problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.
Bayesian model identifies health disparities in disease progression.
problem Health disparities bias disease progression models.
method Interpretable Bayesian model accounting for three disparities.
result Model identifies and corrects for health disparities.
Study shows label errors impact model disparity metrics, proposing mitigation methods.
problem Impact of label errors on model disparity metrics.
method Empirical study, characterizing label error effects; proposing estimation and relabeling methods.
result Label errors significantly affect model disparity metrics, particularly for minority groups.
Proposes a method to quantify and decompose disparity in ML models, separating exempt and non-exempt components.
problem Quantifying disparity in ML models, especially when certain features are exempted due to their critical importance.
method Information-theoretic decomposition into exempt and non-exempt components, satisfying desirable properties.
result Proposes a measure of non-exempt disparity that satisfies all desirable properties, and shows impossibility results for observational measures.
To answer questions about racial inequality and fairness, we often need a way to infer race and ethnicity from names. One way to infer race and ethnicity from names is by relying on the Census Bureau's list of popular last names. The list, however, suffers from at least three limitations: 1. it only contains last names…
End-to-end framework learns precise disparity for activity recognition.
problem Precise portrayal of intraclass disparity in activity recognition.
method Knowledge-directed adversarial learning framework with two competitive encoding distributions.
result Robust and generalizable performance on HAR benchmark datasets.
Paper explores fair classification with bounded disparity using finite datasets.
problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.
We provide the asymptotic distribution of the major indexes used in the statistical literature to quantify disparate treatment in machine learning. We aim at promoting the use of confidence intervals when testing the so-called group disparate impact. We illustrate on some examples the importance of using confidence int…
Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the utility of these systems (or, classifiers), their training involves minimizing the e…
The paper examines how adversarial robustness affects accuracy disparity across different classes.
problem Understanding the impact of adversarial robustness on accuracy disparity across different classes.
method Linear classifiers under a Gaussian mixture model, decomposing the impact into inherent and imbalance effects.
result Adversarial robustness consistently degrades standard accuracy in balanced classes, but the class imbalance ratio plays a different role in accuracy disparity.
Paper tackles fairness in CCA by minimizing correlation disparity error.
problem Fairness issues in CCA.
method Framework to minimize correlation disparity error in CCA.
result Reduces correlation disparity error without sacrificing CCA accuracy.
Study highlights fairness issues in travel behavior prediction models.
problem Ethical challenges in travel behavior analysis using machine learning.
method Operationalized computational fairness by equality of opportunity; compared DNN and DCM; introduced absolute correlation regularization.
result Both DNN and DCM predict disparities across social groups, with DNN outperforming DCM in prediction disparities.
Conformal prediction sets can lead to unfair outcomes.
problem Disparate impact in decision-making with conformal prediction sets.
method Experiments with human participants to demonstrate disparate impact and propose equalizing set sizes across groups.
result Providing prediction sets that satisfy Equalized Coverage increases disparate impact compared to marginal coverage.
When the performance of a machine learning model varies over groups defined by sensitive attributes (e.g., gender or ethnicity), the performance disparity can be expressed in terms of the probability distributions of the input and output variables over each group. In this paper, we exploit this fact to reduce the dispa…
We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and auxiliary, annotated datasets. We evaluate our approach on a variety of sequence cl…
The paper analyzes how deep neural networks handle noisy labels and finds disparate impacts.
problem Disparate impacts of noisy labels on instances with different representation frequencies.
method Quantifying harms, analyzing solutions, and comparing their impacts on different frequency instances.
result Existing solutions lead to disparate treatments, benefiting higher-frequency instances more.
DCEM algorithm reduces bias in machine learning models trained on selective labels.
problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.
The paper introduces return parity for fairness in MDPs, addressing delayed and adverse effects.
problem Fairness in MDPs for dynamic domains with delayed and adverse effects.
method Proposes return parity, decomposes return disparity, and develops algorithms for state visitation distributional alignment.
result The proposed algorithms can successfully close the disparity gap while maintaining policy performance.
New method reduces privacy impact on model accuracy for underrepresented groups.
problem Privacy mechanisms disproportionately affect underrepresented groups in machine learning models.
method Proposes DPSGD-F, a modified DPSGD that adjusts group contributions based on clipping bias.
result DPSGD-F removes disparate impact of differential privacy on model accuracy for protected groups.
Deep chest X-ray classifiers show bias in predicting diagnoses.
problem Bias in deep learning classifiers predicting diagnoses from chest X-rays.
method Trained convolutional neural networks on multiple public datasets to predict 14 diagnostic labels.
result True positive rates vary significantly among different protected attributes, indicating bias.
What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral. This legal determination hinges on a definition of a protected class (ethnicity, g…
The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit decisioning, hiring, advertising, criminal justice, personalized medicine, and t…
New method to quantify feature contributions to disparity without access to decision-making model.
problem Quantifying feature contributions to disparity when decision-making model is not accessible.
method Use information theory to measure redundant statistical dependency between protected attribute and feature.
result Quantify feature contributions to disparity using information theory.