Study decomposes racial healthcare disparities via shifts in mediator distributions.
problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.
Study fair healthcare predictions without harming patients.
problem Balancing fairness and avoiding unnecessary harm in healthcare predictions.
method Formalizes Pareto-optimal approach to minimize risk disparity without causing harm, dynamically re-balancing subgroup risks.
result Demonstrates a method to train neural networks achieving fair predictions without unnecessary harm.
Develops causal framework for fair survival analysis in healthcare.
problem Fairness in survival analysis for high-stakes domains like healthcare.
method Causal framework using graphical models, conditional survival function, and Causal Reduction Theorem.
result Decomposes disparities in survival into direct, indirect, and spurious pathways.
The paper proposes a fair reinforcement learning framework to prevent healthcare disparities.
problem Unfair reinforcement learning policies in healthcare can lead to socioeconomically-disadvantaged subgroups being underprivileged.
method The paper introduces a counterfactual fairness framework and a sequential data preprocessing algorithm to achieve fair sequential decision making.
result The proposed approach greatly enhances fair access to counseling in a digital health dataset designed to reduce opioid misuse.
FOCUS addresses label quality disparity in FL for healthcare applications.
problem Label quality disparity in federated learning for healthcare applications.
method FOCUS maintains a small set of benchmark samples and computes the mutual cross-entropy between local and benchmark datasets to quantify label credibility. It then adjusts client weights based on credibility values.
result FOCUS effectively reduces the impact of noisy labels from clients, improving model performance.
Study shows racial bias in health data, which can be reduced with simple techniques.
problem Racial bias in health indicators measured by the Medical Expenditure Panel Survey (MEPS).
method Used publicly available and nationally representative MEPS data to show bias in predictive models for care management.
result Racial bias can be significantly reduced using simple mitigation techniques.
Study examines impact of fairness penalties on clinical risk prediction models.
problem Widespread health disparities in machine learning-guided clinical decision-making.
method Empirical study across multiple databases, outcomes, and sensitive attributes.
result Penalizing fairness violations nearly universally degrades model performance and fairness metrics.
Bayesian model reduces health disparities in the U.S.
problem Health and longevity gaps in the U.S. due to socio-economic factors.
method Bayesian Decision Network integrating healthcare, socio-economic data.
result Quantifiable policy actions to reduce longevity gap.
Study finds racial bias in pulse oximeter readings has minimal impact on ICU ventilation rates.
problem Racial disparities in pulse oximeter readings affect clinical decisions in ICU settings.
method Causal inference using path-specific effects and doubly robust estimator.
result Minimal impact of racial discrepancies on invasive ventilation rates, but more pronounced on ventilation duration.
Paper tackles fairness in algorithms by predicting protected class from auxiliary data.
problem Protected class membership is often unobserved in data, leading to unfair algorithmic decisions.
method Use auxiliary datasets to predict protected class from proxy variables and provide characterizations of possible disparities.
result Common disparity measures are generally unidentifiable with auxiliary data, highlighting the need for robust assessments.
The paper proposes a method to calibrate healthcare AI models for reliability and interpretability.
problem Characterizing model reliability and enabling introspection of model behavior in clinical decision making.
method A calibration-driven learning method combined with interpretability techniques based on counterfactual reasoning.
result Demonstrates the effectiveness of the proposed approach using a lesion classification problem with dermoscopy images.
Introduces causal fairness analysis to address unfairness in AI decisions.
problem Fairness issues in AI decision-making.
method Link observed disparities to underlying causal mechanisms.
result Develops Fairness Map and Fairness Cookbook.
Isthmus platform simplifies ML/AI integration in healthcare.
problem Challenges in deploying ML models in healthcare due to data quality, regulatory, and security issues.
method Turnkey, cloud-based platform addressing data quality, clinical relevance, and regulatory compliance.
result Reduces time to market for operationalizing ML/AI in healthcare.
Study shows auditing fairness of personalized interventions is impossible due to unknown ground truths.
problem Auditing fairness of personalized interventions in social services, education, and healthcare.
method Point-identification of quantities under monotone treatment response assumption, providing sensitivity analysis for violations.
result Proves impossibility of auditing fairness using standard metrics and provides methods for auditing using partially-identified ROC and xROC curves.
Proposes a federated transfer learning method to improve precision medicine models for underrepresented populations.
problem Underrepresentation of minorities in precision medicine research leads to underperforming risk prediction models.
method Two-way federated transfer learning strategy integrating diverse populations and healthcare institutions.
result Improves risk prediction models for underrepresented populations, reducing performance gaps.
The paper studies and mitigates accuracy disparity in regression models.
problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.
Study shows unequal success of membership inference attacks across different groups.
problem Unequal success of membership inference attacks across different groups.
method Established conditions for preventing MIAs and derived connections to fairness and differential privacy.
result Estimating disparate vulnerability to MIAs can lead to overestimation; suitable attacks and statistical framework provided.
The paper offers methods for testing disparate impact using confidence intervals.
problem Testing for disparate impact in machine learning.
method Asymptotic distribution of indexes and use of confidence intervals.
result The importance of using confidence intervals over single values in testing disparate impact.
Develops methods for fair classification under linear disparity constraints.
problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.
Study reveals AI skin cancer classifiers underperform for darker skin phototypes, advocating for fairness auditing.
problem AI bias in dermatology, particularly for darker skin phototypes.
method Predictive Representativity (PR) framework, evaluating classifiers on HAM10000 and BOSQUE Test sets.
result Substantial performance disparities by skin phototype, highlighting AI bias.
Following related work in law and policy, two notions of disparity have come to shape the study of fairness in algorithmic decision-making. Algorithms exhibit treatment disparity if they formally treat members of protected subgroups differently; algorithms exhibit impact disparity when outcomes differ across subgroups,…
Study shows explanation disparities in machine learning models are influenced by data and model properties.
problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.
Bayesian model identifies health disparities in disease progression.
problem Health disparities bias disease progression models.
method Interpretable Bayesian model accounting for three disparities.
result Model identifies and corrects for health disparities.
Study shows label errors impact model disparity metrics, proposing mitigation methods.
problem Impact of label errors on model disparity metrics.
method Empirical study, characterizing label error effects; proposing estimation and relabeling methods.
result Label errors significantly affect model disparity metrics, particularly for minority groups.
Proposes a method to quantify and decompose disparity in ML models, separating exempt and non-exempt components.
problem Quantifying disparity in ML models, especially when certain features are exempted due to their critical importance.
method Information-theoretic decomposition into exempt and non-exempt components, satisfying desirable properties.
result Proposes a measure of non-exempt disparity that satisfies all desirable properties, and shows impossibility results for observational measures.
End-to-end framework learns precise disparity for activity recognition.
problem Precise portrayal of intraclass disparity in activity recognition.
method Knowledge-directed adversarial learning framework with two competitive encoding distributions.
result Robust and generalizable performance on HAR benchmark datasets.
Paper explores Rashomon set models for more trustworthy medical conclusions.
problem Lack of comprehensive analysis of models in Rashomon set leads to misleading conclusions.
method Introduces Rashomon_DETECT algorithm and Profile Disparity Index (PDI).
result Combining differently behaving models in Rashomon set provides more trustworthy conclusions.
Paper explores fair classification with bounded disparity using finite datasets.
problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.
Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the utility of these systems (or, classifiers), their training involves minimizing the e…
The paper examines how adversarial robustness affects accuracy disparity across different classes.
problem Understanding the impact of adversarial robustness on accuracy disparity across different classes.
method Linear classifiers under a Gaussian mixture model, decomposing the impact into inherent and imbalance effects.
result Adversarial robustness consistently degrades standard accuracy in balanced classes, but the class imbalance ratio plays a different role in accuracy disparity.
The paper addresses fairness in machine learning by adjusting input distributions.
problem Reducing disparate impact in machine learning models over different groups.
method The approach involves learning a counterfactual distribution to adjust input variables for disadvantaged groups.
result The method can reduce disparate impact without training a new model.
Paper tackles fairness in CCA by minimizing correlation disparity error.
problem Fairness issues in CCA.
method Framework to minimize correlation disparity error in CCA.
result Reduces correlation disparity error without sacrificing CCA accuracy.
New method evaluates multiple social disparities using machine learning.
problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.
Study highlights fairness issues in travel behavior prediction models.
problem Ethical challenges in travel behavior analysis using machine learning.
method Operationalized computational fairness by equality of opportunity; compared DNN and DCM; introduced absolute correlation regularization.
result Both DNN and DCM predict disparities across social groups, with DNN outperforming DCM in prediction disparities.
The paper compares different fairness definitions under various worldviews.
problem Avoiding disparity amplification under different worldviews.
method Mathematical comparison of four fairness definitions using a theoretical framework.
result Different worldviews require different fairness definitions to avoid disparity amplification.
Conformal prediction sets can lead to unfair outcomes.
problem Disparate impact in decision-making with conformal prediction sets.
method Experiments with human participants to demonstrate disparate impact and propose equalizing set sizes across groups.
result Providing prediction sets that satisfy Equalized Coverage increases disparate impact compared to marginal coverage.
We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and auxiliary, annotated datasets. We evaluate our approach on a variety of sequence cl…
The paper analyzes how deep neural networks handle noisy labels and finds disparate impacts.
problem Disparate impacts of noisy labels on instances with different representation frequencies.
method Quantifying harms, analyzing solutions, and comparing their impacts on different frequency instances.
result Existing solutions lead to disparate treatments, benefiting higher-frequency instances more.
DCEM algorithm reduces bias in machine learning models trained on selective labels.
problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.
The paper introduces return parity for fairness in MDPs, addressing delayed and adverse effects.
problem Fairness in MDPs for dynamic domains with delayed and adverse effects.
method Proposes return parity, decomposes return disparity, and develops algorithms for state visitation distributional alignment.
result The proposed algorithms can successfully close the disparity gap while maintaining policy performance.
New method reduces privacy impact on model accuracy for underrepresented groups.
problem Privacy mechanisms disproportionately affect underrepresented groups in machine learning models.
method Proposes DPSGD-F, a modified DPSGD that adjusts group contributions based on clipping bias.
result DPSGD-F removes disparate impact of differential privacy on model accuracy for protected groups.
Deep chest X-ray classifiers show bias in predicting diagnoses.
problem Bias in deep learning classifiers predicting diagnoses from chest X-rays.
method Trained convolutional neural networks on multiple public datasets to predict 14 diagnostic labels.
result True positive rates vary significantly among different protected attributes, indicating bias.
What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral. This legal determination hinges on a definition of a protected class (ethnicity, g…
New method to quantify feature contributions to disparity without access to decision-making model.
problem Quantifying feature contributions to disparity when decision-making model is not accessible.
method Use information theory to measure redundant statistical dependency between protected attribute and feature.
result Quantify feature contributions to disparity using information theory.
Study evaluates when splitting classifiers can improve performance despite disparate treatment.
problem Impact of disparate treatment in classification models.
method Comparison of split classifiers and group-blind classifiers, quantifying performance improvement.
result Proves an equivalent expression for the benefit-of-splitting which can be efficiently computed.
Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…
Probabilistic ML improves healthcare data analysis.
problem Insufficient understanding and incomplete data in healthcare.
method Examination of probabilistic machine learning models for healthcare challenges.
result Probabilistic models enhance healthcare data analysis and model building.
Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated dataset. The present paper extends the concept of optical flow estimation via co…